-- Logs begin at Wed 2022-06-15 23:41:34 UTC, end at Thu 2022-06-16 00:52:49 UTC. -- Jun 16 00:12:08.327162 dv-cinder-843277-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 16 00:12:08.335862 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 16 00:12:08.338405 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 16 00:12:08 2022] *** Jun 16 00:12:08.338538 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 16 00:12:08.338660 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 16 00:12:08.338660 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: nodename: dv-cinder-843277-4-iscsi Jun 16 00:12:08.338660 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: machine: x86_64 Jun 16 00:12:08.338660 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: clock source: unix Jun 16 00:12:08.338660 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: pcre jit disabled Jun 16 00:12:08.338660 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: detected number of CPU cores: 4 Jun 16 00:12:08.338660 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: current working directory: / Jun 16 00:12:08.338660 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: detected binary path: /usr/bin/uwsgi-core Jun 16 00:12:08.338660 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: your processes number limit is 47680 Jun 16 00:12:08.338660 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: your memory page size is 4096 bytes Jun 16 00:12:08.339190 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: detected max file descriptor number: 2048 Jun 16 00:12:08.339190 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: lock engine: pthread robust mutexes Jun 16 00:12:08.339190 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: thunder lock: enabled Jun 16 00:12:08.339190 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 16 00:12:08.339190 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 16 00:12:08.382363 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: Python main interpreter initialized at 0x55955ed639c0 Jun 16 00:12:08.382363 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: python threads support enabled Jun 16 00:12:08.382363 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: your server socket listen backlog is limited to 100 connections Jun 16 00:12:08.382363 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: your mercy for graceful operations on workers is 90 seconds Jun 16 00:12:08.382681 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: mapped 403077 bytes (393 KB) for 2 cores Jun 16 00:12:08.382774 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: *** Operational MODE: preforking *** Jun 16 00:12:08.383036 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: *** uWSGI is running in multiple interpreter mode *** Jun 16 00:12:08.383036 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: spawned uWSGI master process (pid: 86515) Jun 16 00:12:08.383229 dv-cinder-843277-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 16 00:12:08.386847 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: spawned uWSGI worker 1 (pid: 86524, cores: 1) Jun 16 00:12:08.386847 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: spawned uWSGI worker 2 (pid: 86525, cores: 1) Jun 16 00:12:08.386847 dv-cinder-843277-4-iscsi devstack@keystone.service[86515]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 16 00:12:13.872114 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:12:13.872114 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: from cryptography.utils import int_from_bytes Jun 16 00:12:13.872790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:12:13.872790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: from cryptography.utils import int_from_bytes Jun 16 00:12:13.873145 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:12:13.873145 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: from cryptography.utils import int_from_bytes Jun 16 00:12:13.873592 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 16 00:12:13.873592 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: from cryptography.utils import int_from_bytes Jun 16 00:12:13.922927 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 00:12:13.923115 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 00:12:13.923198 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 16 00:12:13.923296 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] command line args: [] {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 00:12:13.923372 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 16 00:12:13.923549 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] command line args: [] {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 16 00:12:13.923676 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 00:12:13.923764 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ================================================================================ {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 00:12:13.923838 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 16 00:12:13.924014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ================================================================================ {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 16 00:12:13.924100 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] admin_token = **** {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.924254 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] config_dir = [] {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.924334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] admin_token = **** {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.924441 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.924522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] config_dir = [] {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.924623 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] config_source = [] {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.924703 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.924786 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] debug = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.924865 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] config_source = [] {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.924993 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.925275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] debug = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.925275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.925498 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.925594 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.925688 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.925781 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] insecure_debug = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.925888 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.925990 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.926092 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.926193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.926300 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] list_limit = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.926400 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] list_limit = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.926504 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] log_config_append = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.926605 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] log_config_append = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.926705 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.926807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.926901 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] log_dir = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.926994 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] log_dir = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.927098 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] log_file = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.927205 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] log_file = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.927317 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.927395 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.927505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.927584 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.927703 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.927829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.927907 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.928025 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.928103 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.928219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.928308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.928391 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.928471 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.928598 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.928681 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.928766 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.928853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.928933 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.929054 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.929131 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.929251 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.929371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.929466 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.929607 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.929686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.929855 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.929934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.930105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] notification_format = cadf {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.930187 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.930382 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.930644 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.930827 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] publish_errors = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.930917 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.44/identity {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.931045 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] publish_errors = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.931174 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.931271 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.931335 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.931510 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.931692 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.931692 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.931893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.932031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.932117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.932191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.932269 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] standard_threads = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.932367 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] standard_threads = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.932495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.932600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] strict_password_check = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.932680 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.932773 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.932858 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.932951 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] use_journal = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.933038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] use_eventlog = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.933117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] use_json = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.933190 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] use_journal = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.933287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] use_stderr = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.933373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] use_json = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.933446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] use_syslog = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.933524 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] use_stderr = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.933670 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] use_syslog = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.933751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.933903 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] watch_log_file = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 16 00:12:13.933989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.934144 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.934223 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.934389 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.934471 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.934626 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.934704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.934875 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.934997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.935112 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.935192 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.935351 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.935435 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.935582 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.935725 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.935850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.935931 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.936097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.936176 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.936344 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.936428 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.936574 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.936653 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.936820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.936898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.937052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.937131 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.937297 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.937383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.937539 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.937617 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.937812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.937892 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.938012 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.938090 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.938286 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.938364 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.938533 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.938620 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.938768 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.938853 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.939007 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.939091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.939262 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.939348 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.939510 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.939588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.939780 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.939860 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.940011 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.940092 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.940240 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.940326 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.940469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.940549 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.940699 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.940838 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.940934 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.941007 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.941173 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.941261 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.941400 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.941480 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.941628 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.941706 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.941858 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.941943 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.942108 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.942188 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.942339 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.942417 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.942582 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.942668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.942810 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.942889 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.943042 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.943127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.943275 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.943428 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.943510 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.943588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.943746 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.943837 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.943978 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.944072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.944203 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.944281 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.944431 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.944515 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.944670 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.944758 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.944897 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.944975 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.945277 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.945410 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.945509 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.945616 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.945712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.945807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.945900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.945995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.946089 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.946212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.946327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.946403 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.946525 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.946604 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.946748 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.946840 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.946914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.947030 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.947118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.947241 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.947351 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.947443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.947579 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.947824 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.947903 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.948023 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.948099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.948186 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.948296 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.948420 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.948527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.948617 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.948765 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.948852 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.949004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.949093 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.949234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.949357 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.949470 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.949557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.949703 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.949791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.949940 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.950019 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.950192 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.950277 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.950436 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.950524 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.950675 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.950753 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.950910 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.950990 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.951144 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.951232 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.951379 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.951458 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.951651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.951737 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.951880 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.951960 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.enabled = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.952116 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.952203 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.952355 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.952440 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.952586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.952666 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.952821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.952901 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.953056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.953134 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.953286 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.953366 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.953519 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.953606 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.953753 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.954325 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.954521 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.954601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.954762 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.954842 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.955000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.955080 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.955223 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.955299 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.955466 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.955545 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.955732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.955813 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.955975 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.956069 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.956216 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.956303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.956450 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.956531 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.956706 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.956849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.956986 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.957112 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.957112 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.957349 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.957349 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.957585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.957585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.957830 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.957958 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.958084 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.958216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.958343 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.958492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.958622 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:13.958622 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.044961 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.045251 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.045251 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.045464 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.045544 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] auth.external = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.045617 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] auth.external = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.045756 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.045845 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] auth.mapped = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.046076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.046204 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.046325 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.046410 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.046572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] auth.password = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.046655 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] auth.password = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.046817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] auth.token = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.046898 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] auth.token = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.047070 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.047154 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.047319 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.047401 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] catalog.caching = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.047645 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.047837 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.047927 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.048013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.048118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.048201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.048375 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.048457 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.048614 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.048703 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.048854 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] credential.caching = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.048943 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] credential.caching = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.049151 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.049240 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] credential.driver = sql {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.049362 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.049445 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.049615 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.049705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.049857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.049938 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.050104 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.050187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.050341 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.050423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.050597 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.050681 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.050852 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.050935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.051090 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.051172 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.051349 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.051430 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.051661 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.051745 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.051918 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.052000 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.052184 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.052265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.052431 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.052514 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.052691 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.052773 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.052934 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] federation.caching = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.053014 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] federation.caching = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.053171 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.053254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.053420 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.053508 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] federation.driver = sql {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.053670 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.053751 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.053905 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.053986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.054150 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.054230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.054390 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.054472 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.054646 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.054728 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.054884 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.054965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.055141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.055221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.055380 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.055462 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.055646 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.055729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.055892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] identity.caching = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.055971 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] identity.caching = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.056127 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.056206 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.056380 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.056462 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.056619 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.056709 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.056857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.056943 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.057106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.057187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] identity.driver = sql {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.057339 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.057429 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.057582 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.057662 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.057829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.057916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.058084 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.058174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.058317 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.058399 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.058549 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.058630 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.058782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.058871 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.059027 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.059109 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.059274 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.059354 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.059521 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.059636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.059800 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.059882 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.060047 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.060139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.060321 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.060411 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.060563 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.060643 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.060799 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.060879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.061031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.061121 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.061268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.061350 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.061499 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.061580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.061733 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.061822 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.061974 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.062055 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.062216 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.062296 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.062462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.062550 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.062695 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.062777 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.062944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.063030 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.063207 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.063301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.063445 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.063527 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.063717 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.063802 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.063966 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.064058 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.064197 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.064278 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.064435 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.064516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.064665 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.064754 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.password = **** {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.064905 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.064984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.065140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.065228 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.065388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.065476 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.065623 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.065703 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.065862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.065943 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.066112 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.066202 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.066360 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.066442 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.066591 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.066672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.066822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.066917 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.067074 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.067154 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.067321 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.067400 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.067557 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.067664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.067818 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.067905 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.068054 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.068135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.068283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.user = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.068373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.user = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.068523 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.068605 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.068780 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.068863 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.069013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.069095 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.069258 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.069338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.069506 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.069587 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.069751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.069832 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.069987 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.070068 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.070217 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.070297 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.070452 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.070533 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.070686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.070767 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.070921 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.071003 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.071151 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.071234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.071397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.071477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.071656 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.071740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.071904 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.071987 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.072151 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.072233 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.072397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.072476 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.072625 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.072705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.072871 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.072951 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.073107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.073186 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.073342 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.073425 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.073578 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.073658 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.073812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.073891 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.074057 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.074139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.074306 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.074386 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.074541 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.074620 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.074794 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.074876 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] policy.driver = sql {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.075025 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.075105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.075269 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.075352 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.075505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.075588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.075764 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.075849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] receipt.caching = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.076003 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.076084 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.076252 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.076334 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.076491 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.076571 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.076721 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.076802 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.076957 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.077039 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.077199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] resource.caching = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.077279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] resource.caching = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.077447 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.077526 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.077696 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.077778 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] resource.driver = sql {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.077934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.078015 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.078184 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.078266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.078437 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.078520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.078674 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.078755 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] revoke.caching = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.079451 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.079538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.079746 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.079827 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.079940 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.080022 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] role.cache_time = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.080176 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] role.caching = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.080256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] role.caching = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.080421 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] role.driver = sql {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.080501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] role.driver = sql {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.080652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.080732 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] role.list_limit = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.080898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.080977 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.081144 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.081227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.081392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.081473 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.081638 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.081719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.081884 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.081966 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.082129 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.082210 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.082373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.082463 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.082622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.082704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.082856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.082941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.083098 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.083186 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.083348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.083428 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.083599 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.083750 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.083864 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.083966 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.084301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.084384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.084534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.084616 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.084785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.084878 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.085032 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.085116 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.085280 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.085363 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.085528 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.085634 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.085767 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.085854 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.086015 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.086097 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.086268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.086360 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.086508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.086591 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.086740 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.086822 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.086974 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.087064 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.087203 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.087284 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.087456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.087537 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.087732 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.087816 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.087982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.088065 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.088218 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.088300 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.088456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.088538 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.088685 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.088766 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] token.cache_time = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.088922 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] token.caching = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.089004 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] token.caching = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.089161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.089243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.089405 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.089486 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] token.provider = fernet {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.089642 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.089725 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.089898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.089982 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.090145 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.090227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.090383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.090465 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.090629 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.090712 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.090873 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.090954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.091119 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.091199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] trust.driver = sql {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.091357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.091440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.091595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.091708 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.091853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.091955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.092100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.092183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.092347 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.092431 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.092580 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.092661 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.092823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.092907 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.093118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.093201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.093381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] database.connection = **** {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.093471 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] database.connection = **** {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.093625 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.093715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.093874 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.093963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.094112 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.094193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.094356 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.094437 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.095123 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.095215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.095364 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.095446 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.095602 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.095704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.095862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.095958 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.096110 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.096193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.096346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.096428 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.096591 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.096681 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.096828 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.096911 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.097076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.097158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.097313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.097403 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.097559 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.097650 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.097787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.097878 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.098025 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.098117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.098259 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.098342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 16 00:12:14.098416 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86524) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 00:12:14.098490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=86525) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 16 00:12:14.127771 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.127999 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.128087 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.128222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.128309 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.128463 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.136506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.136785 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.165099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.165330 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.165515 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.165755 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.218667 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.218830 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.270027 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.270258 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.270752 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.270991 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.336071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.336245 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.336459 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.336549 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.336675 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.336760 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.336890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.336975 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.337103 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.337198 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.337322 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.337540 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.361210 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.361443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.361553 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.361670 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.361760 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.361891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.361977 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.362109 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.362194 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.362323 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.362408 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.362539 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.362621 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.362758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.373419 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.373752 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.386655 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.386887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.386988 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.387111 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.387196 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.387333 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.387417 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.387548 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.387654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.387788 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.387872 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.388002 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86525) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.388086 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.388226 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=86524) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 16 00:12:14.404874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.404983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.405082 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 00:12:14.405167 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 00:12:14.405580 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.405665 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.405779 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 00:12:14.405863 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 16 00:12:14.406049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.406133 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.406313 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.406398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.406567 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.406651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.406819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.406910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.418090 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.418364 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.418629 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.418907 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.421086 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.421371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.421644 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.421927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.427206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.430194 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=86524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.430508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.430784 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.431060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.431335 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.431634 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.431889 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.432153 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.432418 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.432682 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.432951 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.433212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.433513 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=86524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.433797 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.434083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.434365 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.434646 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.434904 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.435171 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.435443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.435744 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.436020 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.436286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.461484 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.462615 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.462898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.463179 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.464864 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=86524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.465149 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.468705 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.468995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.469262 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.471125 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=86524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.471407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.471719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.477373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.477654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.479406 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=86524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.479719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.482126 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.482413 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.482694 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.482977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.483251 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.483525 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.483818 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.484090 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.486035 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=86524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.486323 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.486604 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.486886 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.487161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.487437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.487732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.488006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.503690 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.503909 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.507063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.507346 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.508454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.511940 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=86524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.512075 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.512511 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.515584 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.515905 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.517972 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.521109 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=86524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.521609 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.524813 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=86524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.525261 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.525554 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.525834 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.526108 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.526385 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.526659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.528475 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.528775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.529064 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.529346 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.529624 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.529905 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.547759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.547980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.548399 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.548665 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.550971 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=86524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.551266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.551541 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.551843 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.556524 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.558460 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.558538 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.560232 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.561449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.561743 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.561949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.562232 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.562511 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.562789 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.563069 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.564989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=86524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.565268 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.565548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.565838 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.566127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.576346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.576624 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.576915 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.577197 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.577475 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.577744 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.578017 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.579966 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=86524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.580262 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.580541 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.580826 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.581108 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.581386 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.581662 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.596380 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.599566 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.599736 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=86524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.602860 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.602963 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=86524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.604518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.606188 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.606308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.606503 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.606790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.607981 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.609777 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=86524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.610064 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.610887 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.614612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.616244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.618226 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.619442 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.619753 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.619872 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=86524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.620033 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.620310 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.623262 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.623553 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.623865 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.624404 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.629803 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.630087 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.630363 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.633807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=86524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.634101 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.634384 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.638186 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86525) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.638460 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.638735 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.639002 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.639272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.639558 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.639852 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.640125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.640497 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.640761 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.641022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.641300 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.642140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.642353 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86525) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.642805 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=86524) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 16 00:12:14.643088 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.643369 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.643682 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.643954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.644244 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.644520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.644803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.645178 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.645457 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.645732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.646015 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.646285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.646551 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=86524) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 16 00:12:14.680150 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55955ed639c0 pid: 86525 (default app) Jun 16 00:12:14.683591 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396435c-b0dd-4be0-ab6d-3af87b311b2e None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:14.683915 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396435c-b0dd-4be0-ab6d-3af87b311b2e None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:14.684199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396435c-b0dd-4be0-ab6d-3af87b311b2e None None] PATH_INFO: `/v3` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:14.684730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55955ed639c0 pid: 86524 (default app) Jun 16 00:12:14.688465 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 791 bytes} [Thu Jun 16 00:12:14 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:22.459422 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ca731-924f-483c-853b-2b667ad78129 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:22.460000 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ca731-924f-483c-853b-2b667ad78129 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:22.460000 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79ca731-924f-483c-853b-2b667ad78129 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:22.464352 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1/2] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:12:22.469694 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971940f6-5c60-4987-9415-4bbb22b1161d None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:22.470120 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971940f6-5c60-4987-9415-4bbb22b1161d None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:22.470801 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971940f6-5c60-4987-9415-4bbb22b1161d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:22.539258 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: INFO dbcounter [None req-971940f6-5c60-4987-9415-4bbb22b1161d None None] Registered counter for database keystone Jun 16 00:12:22.560421 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG oslo_db.sqlalchemy.engines [None req-971940f6-5c60-4987-9415-4bbb22b1161d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86525) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:12:22.566661 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writer thread running {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:12:22.745023 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG passlib.handlers.bcrypt [None req-971940f6-5c60-4987-9415-4bbb22b1161d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86525) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 00:12:22.745404 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG passlib.handlers.bcrypt [None req-971940f6-5c60-4987-9415-4bbb22b1161d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86525) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 00:12:22.801370 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-971940f6-5c60-4987-9415-4bbb22b1161d None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:22.803008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-971940f6-5c60-4987-9415-4bbb22b1161d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:22.928956 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 2/3] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 16 00:12:23.071667 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ca731-924f-483c-853b-2b667ad78129 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:23.141169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: INFO dbcounter [None req-f79ca731-924f-483c-853b-2b667ad78129 None None] Registered counter for database keystone Jun 16 00:12:23.159847 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG oslo_db.sqlalchemy.engines [None req-f79ca731-924f-483c-853b-2b667ad78129 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86524) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 16 00:12:23.166144 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writer thread running {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 16 00:12:23.287539 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79ca731-924f-483c-853b-2b667ad78129 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:23.291928 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6797f-5166-48b5-b8e6-fa9f720bcf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:23.292590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6797f-5166-48b5-b8e6-fa9f720bcf52 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:23.292883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6797f-5166-48b5-b8e6-fa9f720bcf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:23.293169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6797f-5166-48b5-b8e6-fa9f720bcf52 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:23.301423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6797f-5166-48b5-b8e6-fa9f720bcf52 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:23.352911 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9ac6797f-5166-48b5-b8e6-fa9f720bcf52 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 00:12:23.353202 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6797f-5166-48b5-b8e6-fa9f720bcf52 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:23.363266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 2/4] 10.222.0.44 () {58 vars in 1324 bytes} [Thu Jun 16 00:12:23 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:12:23.369217 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971940f6-5c60-4987-9415-4bbb22b1161d None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:23.383791 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971940f6-5c60-4987-9415-4bbb22b1161d None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:23.388171 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6d9cee-13ad-4d28-a453-629cc71767e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:23.389272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d9cee-13ad-4d28-a453-629cc71767e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:23.389558 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d9cee-13ad-4d28-a453-629cc71767e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:23.389836 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6d9cee-13ad-4d28-a453-629cc71767e2 admin admin] PATH_INFO: `/v3/projects/ec07de477e084ea786d462c55e9192b8` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:23.391349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d9cee-13ad-4d28-a453-629cc71767e2 admin admin] RBAC: Authorizing `identity:get_project(project_id=ec07de477e084ea786d462c55e9192b8)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:23.441265 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1f6d9cee-13ad-4d28-a453-629cc71767e2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 16 00:12:23.441609 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6d9cee-13ad-4d28-a453-629cc71767e2 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:23.446213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 3/5] 10.222.0.44 () {56 vars in 1207 bytes} [Thu Jun 16 00:12:23 2022] GET /identity/v3/projects/ec07de477e084ea786d462c55e9192b8 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:25.516791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750c5a4-8a64-4c1a-890c-e12881fddc69 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:25.517378 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750c5a4-8a64-4c1a-890c-e12881fddc69 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:25.517378 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6750c5a4-8a64-4c1a-890c-e12881fddc69 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:25.522064 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 3/6] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:25.527539 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af41e4b-0510-4b38-a18c-9e5b958dce69 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:25.527987 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af41e4b-0510-4b38-a18c-9e5b958dce69 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:25.528125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af41e4b-0510-4b38-a18c-9e5b958dce69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:25.546521 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-1af41e4b-0510-4b38-a18c-9e5b958dce69 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:25.548078 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-1af41e4b-0510-4b38-a18c-9e5b958dce69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:25.555902 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 4/7] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 16 00:12:25.577968 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750c5a4-8a64-4c1a-890c-e12881fddc69 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:25.589944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6750c5a4-8a64-4c1a-890c-e12881fddc69 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:25.594164 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a46c47-dfa2-48a8-a0a2-2a01aa1d5107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:25.594792 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a46c47-dfa2-48a8-a0a2-2a01aa1d5107 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:25.595085 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a46c47-dfa2-48a8-a0a2-2a01aa1d5107 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:25.595371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a46c47-dfa2-48a8-a0a2-2a01aa1d5107 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:25.603509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a46c47-dfa2-48a8-a0a2-2a01aa1d5107 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:25.605317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a46c47-dfa2-48a8-a0a2-2a01aa1d5107 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:25.614475 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 4/8] 10.222.0.44 () {58 vars in 1324 bytes} [Thu Jun 16 00:12:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:12:25.619388 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af41e4b-0510-4b38-a18c-9e5b958dce69 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:25.628513 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af41e4b-0510-4b38-a18c-9e5b958dce69 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:25.632861 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f30ed2-1d64-4e1f-bac4-4b582cbb9323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:25.633719 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f30ed2-1d64-4e1f-bac4-4b582cbb9323 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:25.634007 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f30ed2-1d64-4e1f-bac4-4b582cbb9323 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:25.634288 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f30ed2-1d64-4e1f-bac4-4b582cbb9323 admin admin] PATH_INFO: `/v3/users/5827dca4e6e6440096187e88acac47af` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:25.635689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f30ed2-1d64-4e1f-bac4-4b582cbb9323 admin admin] RBAC: Authorizing `identity:get_user(user_id=5827dca4e6e6440096187e88acac47af)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:25.637524 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f30ed2-1d64-4e1f-bac4-4b582cbb9323 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:25.639067 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 5/9] 10.222.0.44 () {56 vars in 1198 bytes} [Thu Jun 16 00:12:25 2022] GET /identity/v3/users/5827dca4e6e6440096187e88acac47af => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:27.786732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96980d0f-e246-4410-9dcd-93d5a1e5fe3b None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:27.787887 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96980d0f-e246-4410-9dcd-93d5a1e5fe3b None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:27.787887 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96980d0f-e246-4410-9dcd-93d5a1e5fe3b None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:27.789025 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 5/10] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:27.794882 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa7a73-7080-4f86-878c-d864064a94cc None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:27.795385 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa7a73-7080-4f86-878c-d864064a94cc None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:27.795645 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaa7a73-7080-4f86-878c-d864064a94cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:27.814410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-faaa7a73-7080-4f86-878c-d864064a94cc None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:27.815686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-faaa7a73-7080-4f86-878c-d864064a94cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:27.843267 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5321c-24e1-4543-8922-d259800ca1e4 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:27.843665 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5321c-24e1-4543-8922-d259800ca1e4 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:27.843964 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f5321c-24e1-4543-8922-d259800ca1e4 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:27.845316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 6/11] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:12:27.851021 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8b83b-72ac-41df-b54e-2b0a4bb45027 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:27.851321 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8b83b-72ac-41df-b54e-2b0a4bb45027 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:27.851607 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b8b83b-72ac-41df-b54e-2b0a4bb45027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:27.892263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG passlib.handlers.bcrypt [None req-a8b8b83b-72ac-41df-b54e-2b0a4bb45027 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=86524) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 16 00:12:27.892717 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG passlib.handlers.bcrypt [None req-a8b8b83b-72ac-41df-b54e-2b0a4bb45027 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=86524) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 16 00:12:27.895556 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 6/12] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:12:27.918337 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa7a73-7080-4f86-878c-d864064a94cc None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:27.938660 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-a8b8b83b-72ac-41df-b54e-2b0a4bb45027 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:27.940327 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-a8b8b83b-72ac-41df-b54e-2b0a4bb45027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:27.941481 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:28.020082 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaa7a73-7080-4f86-878c-d864064a94cc None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:28.039015 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 7/13] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:12:28.054568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb24205-68e0-4cf2-b26f-19da09809446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:28.055371 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb24205-68e0-4cf2-b26f-19da09809446 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:28.055681 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb24205-68e0-4cf2-b26f-19da09809446 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:28.055965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb24205-68e0-4cf2-b26f-19da09809446 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:28.062512 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8b83b-72ac-41df-b54e-2b0a4bb45027 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:28.067147 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb24205-68e0-4cf2-b26f-19da09809446 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:28.078315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-1fb24205-68e0-4cf2-b26f-19da09809446 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:28.078315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:28.078315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:28.078315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:28.078315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:28.078315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:28.078315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:28.078315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:28.078315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:28.078315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:28.078315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:28.078315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:28.078315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:28.078315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:28.078315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:28.078315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:28.079244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:28.079244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:28.079244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:28.079244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:28.079244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:28.079244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:28.079244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:28.079244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:28.079244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:28.079244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:28.079244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:28.079244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:28.079244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:28.079244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:28.079244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:28.079244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:28.080640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:28.080640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:28.080640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:28.080640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:28.080640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:28.080640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:28.080640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:28.080640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:28.080640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:28.080640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:28.080640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:28.080640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:12:28.080640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 7/14] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:12:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:28.085759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb24205-68e0-4cf2-b26f-19da09809446 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:28.164818 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b8b83b-72ac-41df-b54e-2b0a4bb45027 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:28.167097 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:28.167811 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:28.186587 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb24205-68e0-4cf2-b26f-19da09809446 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:28.203226 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bfe31-c331-4820-b8e0-7018a5cfc04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:28.204166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bfe31-c331-4820-b8e0-7018a5cfc04f None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:28.204453 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bfe31-c331-4820-b8e0-7018a5cfc04f None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:28.204732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1bfe31-c331-4820-b8e0-7018a5cfc04f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:28.220137 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbeb4a-999c-4b40-af6c-4e8735ccc92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:28.220862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbeb4a-999c-4b40-af6c-4e8735ccc92f None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:28.221149 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbeb4a-999c-4b40-af6c-4e8735ccc92f None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:28.221432 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bbeb4a-999c-4b40-af6c-4e8735ccc92f None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:28.222182 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbeb4a-999c-4b40-af6c-4e8735ccc92f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:28.222494 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbeb4a-999c-4b40-af6c-4e8735ccc92f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:28.223946 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bbeb4a-999c-4b40-af6c-4e8735ccc92f None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:28.235583 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 8/15] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:12:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:28.241796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbeb4a-999c-4b40-af6c-4e8735ccc92f None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:28.275078 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bfe31-c331-4820-b8e0-7018a5cfc04f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:28.276643 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1bfe31-c331-4820-b8e0-7018a5cfc04f None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:28.340837 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bbeb4a-999c-4b40-af6c-4e8735ccc92f None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:28.373642 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2528f-cedd-479c-aa39-11a7466b1732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:28.374509 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2528f-cedd-479c-aa39-11a7466b1732 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:28.374795 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2528f-cedd-479c-aa39-11a7466b1732 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:28.375068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2528f-cedd-479c-aa39-11a7466b1732 None admin] PATH_INFO: `/v3/users/5827dca4e6e6440096187e88acac47af` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:28.375544 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 8/16] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:12:28.376597 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2528f-cedd-479c-aa39-11a7466b1732 None admin] RBAC: Authorizing `identity:get_user(user_id=5827dca4e6e6440096187e88acac47af)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:28.378105 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2528f-cedd-479c-aa39-11a7466b1732 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:28.379726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 9/17] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:12:28 2022] GET /identity/v3/users/5827dca4e6e6440096187e88acac47af => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:28.381398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bfe31-c331-4820-b8e0-7018a5cfc04f None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:28.384257 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:28.385050 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2528f-cedd-479c-aa39-11a7466b1732 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:28.400206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:28.481222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1bfe31-c331-4820-b8e0-7018a5cfc04f None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:28.484984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2528f-cedd-479c-aa39-11a7466b1732 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:28.514912 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4b114-8062-4e6d-8004-13d93042e21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:28.515732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4b114-8062-4e6d-8004-13d93042e21d None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:28.516021 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4b114-8062-4e6d-8004-13d93042e21d None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:28.516302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a4b114-8062-4e6d-8004-13d93042e21d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:28.519004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629688f-933c-4bae-8ea2-7a14f7c4c818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:28.519822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629688f-933c-4bae-8ea2-7a14f7c4c818 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:28.520113 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629688f-933c-4bae-8ea2-7a14f7c4c818 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:28.520448 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629688f-933c-4bae-8ea2-7a14f7c4c818 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:28.521636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629688f-933c-4bae-8ea2-7a14f7c4c818 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:28.523102 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e629688f-933c-4bae-8ea2-7a14f7c4c818 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:28.524743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 10/18] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:28.530425 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629688f-933c-4bae-8ea2-7a14f7c4c818 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:28.535103 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4b114-8062-4e6d-8004-13d93042e21d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:28.536675 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a4b114-8062-4e6d-8004-13d93042e21d None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:28.557879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-35a4b114-8062-4e6d-8004-13d93042e21d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:28.557879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:28.557879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:28.557879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:28.557879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:28.557879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:28.557879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:28.557879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:28.557879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:28.557879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:28.557879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:28.557879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:28.557879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:28.557879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:28.557879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:28.558677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:28.558677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:28.558677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:28.558677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:28.558677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:28.558677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:28.558677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:28.558677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:28.558677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:28.558677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:28.558677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:28.558677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:28.558677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:28.558677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:28.558677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:28.558677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:28.558677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:28.559484 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:28.559484 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:28.559484 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:28.559484 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:12:28.559484 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 9/19] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:28.565385 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4b114-8062-4e6d-8004-13d93042e21d None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:28.614167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:28.620167 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:28.634294 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e629688f-933c-4bae-8ea2-7a14f7c4c818 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:28.665000 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a4b114-8062-4e6d-8004-13d93042e21d None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:28.668090 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a001f-aa0c-4ae6-8bb1-46c811463b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:28.668751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a001f-aa0c-4ae6-8bb1-46c811463b91 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:28.669040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a001f-aa0c-4ae6-8bb1-46c811463b91 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:28.669322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a001f-aa0c-4ae6-8bb1-46c811463b91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:28.670157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a001f-aa0c-4ae6-8bb1-46c811463b91 None admin] RBAC: Adding query filter params (role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab, scope.domain.id=default, user.id=5827dca4e6e6440096187e88acac47af) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:28.670474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a001f-aa0c-4ae6-8bb1-46c811463b91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:28.671969 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a001f-aa0c-4ae6-8bb1-46c811463b91 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:28.678643 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 11/20] 10.222.0.44 () {56 vars in 1322 bytes} [Thu Jun 16 00:12:28 2022] GET /identity/v3/role_assignments?user.id=5827dca4e6e6440096187e88acac47af&scope.domain.id=default&role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 233 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:28.699185 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afe76f3-7409-456d-9ba3-603110c9acfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:28.699915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe76f3-7409-456d-9ba3-603110c9acfb None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:28.700205 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe76f3-7409-456d-9ba3-603110c9acfb None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:28.700486 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afe76f3-7409-456d-9ba3-603110c9acfb None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:28.701248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe76f3-7409-456d-9ba3-603110c9acfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:28.701565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe76f3-7409-456d-9ba3-603110c9acfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:28.703021 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afe76f3-7409-456d-9ba3-603110c9acfb None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:28.722999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 10/21] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:31.112286 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a659fae-ccdc-445a-91f9-faa49932c4d6 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:31.113285 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a659fae-ccdc-445a-91f9-faa49932c4d6 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:31.113863 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a659fae-ccdc-445a-91f9-faa49932c4d6 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:31.115737 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 12/22] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:31.121503 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1131b-c1aa-40d1-a2f0-53185db8f05f None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:31.122335 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1131b-c1aa-40d1-a2f0-53185db8f05f None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:31.122817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf1131b-c1aa-40d1-a2f0-53185db8f05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:31.148735 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-faf1131b-c1aa-40d1-a2f0-53185db8f05f None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:31.150335 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-faf1131b-c1aa-40d1-a2f0-53185db8f05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:31.244918 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 11/23] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:12:31.280508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a659fae-ccdc-445a-91f9-faa49932c4d6 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:31.299860 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abe7b1-92d7-4d74-8acf-be990450dda6 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:31.300458 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abe7b1-92d7-4d74-8acf-be990450dda6 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:31.301080 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5abe7b1-92d7-4d74-8acf-be990450dda6 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:31.304962 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 12/24] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:31.309632 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd06d3-d42f-4733-86cd-1640c8f55832 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:31.309926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd06d3-d42f-4733-86cd-1640c8f55832 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:31.310438 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafd06d3-d42f-4733-86cd-1640c8f55832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:31.340623 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-dafd06d3-d42f-4733-86cd-1640c8f55832 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:31.342205 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-dafd06d3-d42f-4733-86cd-1640c8f55832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:31.405173 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a659fae-ccdc-445a-91f9-faa49932c4d6 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:31.440945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:31.454866 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcaaa87-ce18-4eba-ba2a-b8edcc6fdb26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:31.455779 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaaa87-ce18-4eba-ba2a-b8edcc6fdb26 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:31.456074 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaaa87-ce18-4eba-ba2a-b8edcc6fdb26 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:31.456358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcaaa87-ce18-4eba-ba2a-b8edcc6fdb26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:31.482023 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcaaa87-ce18-4eba-ba2a-b8edcc6fdb26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:31.483531 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcaaa87-ce18-4eba-ba2a-b8edcc6fdb26 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:31.486263 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:31.489776 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 13/25] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:31.512182 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-2bcaaa87-ce18-4eba-ba2a-b8edcc6fdb26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:31.512182 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:31.512182 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:31.512182 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:31.512182 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:31.512182 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:31.512182 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:31.512182 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:31.512182 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:31.512182 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:31.512182 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:31.512182 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:31.512182 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:12:31.512182 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:12:31.512182 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:12:31.513106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:12:31.513106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:31.513106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:31.513106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:31.513106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:31.513106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:31.513106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:31.513106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:31.513106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:31.513106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:31.513106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:31.513106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:31.513106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:31.513106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:31.513106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:31.513106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:31.513106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:31.513932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:12:31.513932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:12:31.513932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:12:31.513932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:12:31.513932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 13/26] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:31.521039 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd06d3-d42f-4733-86cd-1640c8f55832 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:31.531135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcaaa87-ce18-4eba-ba2a-b8edcc6fdb26 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:31.638331 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcaaa87-ce18-4eba-ba2a-b8edcc6fdb26 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:31.681179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6282a62b-1424-477d-99d4-a54ac2fd4342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:31.681794 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282a62b-1424-477d-99d4-a54ac2fd4342 None admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:31.682080 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282a62b-1424-477d-99d4-a54ac2fd4342 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:31.682360 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6282a62b-1424-477d-99d4-a54ac2fd4342 None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:31.683140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282a62b-1424-477d-99d4-a54ac2fd4342 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:31.684581 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6282a62b-1424-477d-99d4-a54ac2fd4342 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:31.732025 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafd06d3-d42f-4733-86cd-1640c8f55832 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:31.800544 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50137b-7da3-4550-b2a8-860db0180bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:31.801224 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50137b-7da3-4550-b2a8-860db0180bab None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:31.801564 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50137b-7da3-4550-b2a8-860db0180bab None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:31.801847 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50137b-7da3-4550-b2a8-860db0180bab None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:31.802643 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50137b-7da3-4550-b2a8-860db0180bab None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:31.802967 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50137b-7da3-4550-b2a8-860db0180bab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:31.804393 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50137b-7da3-4550-b2a8-860db0180bab None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:31.816652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 14/27] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:12:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:31.817966 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c416b98-c97c-4343-abbf-f8e48f00215e None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:31.818312 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c416b98-c97c-4343-abbf-f8e48f00215e None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:31.818635 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c416b98-c97c-4343-abbf-f8e48f00215e None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:31.820206 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 15/28] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:31.821275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f73a3-0044-4760-b392-179ed227ee13 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:31.821560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f73a3-0044-4760-b392-179ed227ee13 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:31.821839 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f73a3-0044-4760-b392-179ed227ee13 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:31.823127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 16/29] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:31.823829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f73a3-0044-4760-b392-179ed227ee13 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:31.866666 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:31.945732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f73a3-0044-4760-b392-179ed227ee13 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:31.956741 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 14/30] 10.222.0.44 () {60 vars in 1131 bytes} [Thu Jun 16 00:12:31 2022] POST /identity/v3/roles => generated 219 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:12:31.958010 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae2fdb-5c3f-42d3-ab1c-ad0b50c8fc4e None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:31.958309 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae2fdb-5c3f-42d3-ab1c-ad0b50c8fc4e None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:31.958599 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ae2fdb-5c3f-42d3-ab1c-ad0b50c8fc4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:31.991853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-23ae2fdb-5c3f-42d3-ab1c-ad0b50c8fc4e None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:31.993469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-23ae2fdb-5c3f-42d3-ab1c-ad0b50c8fc4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:32.016805 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51af214-9f22-40bf-9008-cb7e025568f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:32.017515 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51af214-9f22-40bf-9008-cb7e025568f3 None admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:32.017803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51af214-9f22-40bf-9008-cb7e025568f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:32.018123 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51af214-9f22-40bf-9008-cb7e025568f3 None admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:32.019149 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51af214-9f22-40bf-9008-cb7e025568f3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:32.020699 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51af214-9f22-40bf-9008-cb7e025568f3 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:32.112553 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:32.140877 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 15/31] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:32.142175 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0cef1-ebd7-4e1f-b0c8-007aaaba1a3b None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:32.142479 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0cef1-ebd7-4e1f-b0c8-007aaaba1a3b None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:32.142764 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca0cef1-ebd7-4e1f-b0c8-007aaaba1a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:32.160130 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-7ca0cef1-ebd7-4e1f-b0c8-007aaaba1a3b None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:32.161563 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-7ca0cef1-ebd7-4e1f-b0c8-007aaaba1a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:32.227540 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 17/32] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 00:12:31 2022] POST /identity/v3/projects => generated 301 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:12:32.229498 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51af214-9f22-40bf-9008-cb7e025568f3 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:32.234856 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 16/33] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:32.259907 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0cef1-ebd7-4e1f-b0c8-007aaaba1a3b None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:32.351972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:32.368232 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51af214-9f22-40bf-9008-cb7e025568f3 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:32.401590 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca0cef1-ebd7-4e1f-b0c8-007aaaba1a3b None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:32.415806 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455312e-318a-4215-890b-7f24e4840b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:32.416648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455312e-318a-4215-890b-7f24e4840b23 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:32.416945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455312e-318a-4215-890b-7f24e4840b23 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:32.417234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c455312e-318a-4215-890b-7f24e4840b23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:32.431798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:32.440601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c455312e-318a-4215-890b-7f24e4840b23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:32.459758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-c455312e-318a-4215-890b-7f24e4840b23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:32.459758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:32.459758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:32.459758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:32.459758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:32.459758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:32.459758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:32.459758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:32.459758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:32.459758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:32.459758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:32.459758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:32.459758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:32.459758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:32.459758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:32.459758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:32.460668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:32.460668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:32.460668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:32.460668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:32.460668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:32.460668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:32.460668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:32.460668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:32.460668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:32.460668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:32.460668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:32.460668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:32.460668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:32.460668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:32.460668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:32.460668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:32.461876 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:32.461876 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:32.461876 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:32.461876 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:32.461876 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:32.461876 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:32.461876 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:32.461876 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:32.461876 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:32.461876 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:32.461876 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:32.461876 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:12:32.461876 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 18/34] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:12:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:32.465914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaece96-f5fe-4d84-af4f-3262e91a1ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:32.465914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaece96-f5fe-4d84-af4f-3262e91a1ba7 None admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:32.465914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaece96-f5fe-4d84-af4f-3262e91a1ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:32.465914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaece96-f5fe-4d84-af4f-3262e91a1ba7 None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:32.466242 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaece96-f5fe-4d84-af4f-3262e91a1ba7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:32.467222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaece96-f5fe-4d84-af4f-3262e91a1ba7 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:32.470703 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455312e-318a-4215-890b-7f24e4840b23 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:32.496365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 17/35] 10.222.0.44 () {60 vars in 1131 bytes} [Thu Jun 16 00:12:32 2022] POST /identity/v3/roles => generated 225 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:12:32.714807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c455312e-318a-4215-890b-7f24e4840b23 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:32.762688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87b07ba-316b-45c9-9832-00dead3d3453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:32.763366 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b07ba-316b-45c9-9832-00dead3d3453 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:32.763759 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b07ba-316b-45c9-9832-00dead3d3453 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:32.764050 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87b07ba-316b-45c9-9832-00dead3d3453 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:32.764901 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b07ba-316b-45c9-9832-00dead3d3453 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:32.765219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b07ba-316b-45c9-9832-00dead3d3453 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:32.766875 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87b07ba-316b-45c9-9832-00dead3d3453 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:32.781502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 19/36] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:12:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:32.787110 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaece96-f5fe-4d84-af4f-3262e91a1ba7 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:32.820196 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4811e-195d-4e7e-8c77-8a275a9aeac4 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:32.820766 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4811e-195d-4e7e-8c77-8a275a9aeac4 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:32.821172 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a4811e-195d-4e7e-8c77-8a275a9aeac4 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:32.822842 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 20/37] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:12:32.828146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b53bed-0873-42a8-8ef0-14a192d9af97 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:32.828545 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b53bed-0873-42a8-8ef0-14a192d9af97 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:32.829182 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b53bed-0873-42a8-8ef0-14a192d9af97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:32.846579 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-91b53bed-0873-42a8-8ef0-14a192d9af97 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:32.848246 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-91b53bed-0873-42a8-8ef0-14a192d9af97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:32.851224 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:32.907782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaece96-f5fe-4d84-af4f-3262e91a1ba7 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:32.923167 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 21/38] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:12:32.945063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb4f6a-7309-438b-b255-ca6bafe546f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:32.946063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb4f6a-7309-438b-b255-ca6bafe546f7 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:32.946353 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb4f6a-7309-438b-b255-ca6bafe546f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:32.946632 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebb4f6a-7309-438b-b255-ca6bafe546f7 None admin] PATH_INFO: `/v3/users/5827dca4e6e6440096187e88acac47af` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:32.946814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b53bed-0873-42a8-8ef0-14a192d9af97 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:32.947988 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb4f6a-7309-438b-b255-ca6bafe546f7 None admin] RBAC: Authorizing `identity:get_user(user_id=5827dca4e6e6440096187e88acac47af)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:32.949510 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebb4f6a-7309-438b-b255-ca6bafe546f7 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:32.955836 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 18/39] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:12:32 2022] GET /identity/v3/users/5827dca4e6e6440096187e88acac47af => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:32.956940 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb4f6a-7309-438b-b255-ca6bafe546f7 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:33.010924 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:33.050977 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b53bed-0873-42a8-8ef0-14a192d9af97 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:33.068029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebb4f6a-7309-438b-b255-ca6bafe546f7 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:33.084579 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7f2e1-48be-4ef9-806e-c8dcc6421280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:33.085386 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7f2e1-48be-4ef9-806e-c8dcc6421280 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:33.085679 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7f2e1-48be-4ef9-806e-c8dcc6421280 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:33.085966 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7f2e1-48be-4ef9-806e-c8dcc6421280 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:33.087173 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7f2e1-48be-4ef9-806e-c8dcc6421280 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:33.088682 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7f2e1-48be-4ef9-806e-c8dcc6421280 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:33.090316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 22/40] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:33.093578 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e70630-7471-4559-af13-14824536c52c None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:33.093578 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e70630-7471-4559-af13-14824536c52c None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:33.093578 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e70630-7471-4559-af13-14824536c52c None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:33.093578 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 23/41] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:33.095776 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e70630-7471-4559-af13-14824536c52c None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:33.106524 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f19562-aa0e-4476-8cdc-165c5e135146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:33.106698 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:33.107325 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f19562-aa0e-4476-8cdc-165c5e135146 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:33.107687 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f19562-aa0e-4476-8cdc-165c5e135146 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:33.108013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f19562-aa0e-4476-8cdc-165c5e135146 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:33.109341 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f19562-aa0e-4476-8cdc-165c5e135146 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:33.110799 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f19562-aa0e-4476-8cdc-165c5e135146 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:33.113075 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 19/42] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:33.114277 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495a4fe-e190-4e0e-91a0-1fbc9aa75fdc None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:33.114571 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495a4fe-e190-4e0e-91a0-1fbc9aa75fdc None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:33.114850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7495a4fe-e190-4e0e-91a0-1fbc9aa75fdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:33.133150 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-7495a4fe-e190-4e0e-91a0-1fbc9aa75fdc None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:33.134364 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-7495a4fe-e190-4e0e-91a0-1fbc9aa75fdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:33.198662 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e70630-7471-4559-af13-14824536c52c None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:33.199791 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 20/43] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:33.200587 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495a4fe-e190-4e0e-91a0-1fbc9aa75fdc None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:33.235245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c33788-707f-4008-89e7-a725bc3a800c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:33.235974 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c33788-707f-4008-89e7-a725bc3a800c None admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:33.236228 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c33788-707f-4008-89e7-a725bc3a800c None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:33.236506 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c33788-707f-4008-89e7-a725bc3a800c None admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:33.237830 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c33788-707f-4008-89e7-a725bc3a800c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:33.239285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c33788-707f-4008-89e7-a725bc3a800c None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:33.248874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:33.263880 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 24/44] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 00:12:33 2022] POST /identity/v3/projects => generated 312 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:12:33.264677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c33788-707f-4008-89e7-a725bc3a800c None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:33.322400 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7495a4fe-e190-4e0e-91a0-1fbc9aa75fdc None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:33.333545 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:33.361404 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bb4f4c-a318-474e-a36f-2aab62d437fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:33.362302 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb4f4c-a318-474e-a36f-2aab62d437fb None admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:33.362589 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb4f4c-a318-474e-a36f-2aab62d437fb None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:33.362871 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bb4f4c-a318-474e-a36f-2aab62d437fb None admin] PATH_INFO: `/v3/domains/default/users/5827dca4e6e6440096187e88acac47af/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:33.365012 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb4f4c-a318-474e-a36f-2aab62d437fb None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=5827dca4e6e6440096187e88acac47af, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:33.366516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bb4f4c-a318-474e-a36f-2aab62d437fb None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:33.382935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 21/45] 10.222.0.44 () {58 vars in 1361 bytes} [Thu Jun 16 00:12:33 2022] PUT /identity/v3/domains/default/users/5827dca4e6e6440096187e88acac47af/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:12:33.397593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c33788-707f-4008-89e7-a725bc3a800c None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:33.440504 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f119ed-a082-46bf-92e5-6cd3a54a2014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:33.441233 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f119ed-a082-46bf-92e5-6cd3a54a2014 None admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:33.441531 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f119ed-a082-46bf-92e5-6cd3a54a2014 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:33.441818 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f119ed-a082-46bf-92e5-6cd3a54a2014 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:33.442649 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f119ed-a082-46bf-92e5-6cd3a54a2014 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:33.444225 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f119ed-a082-46bf-92e5-6cd3a54a2014 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:33.460942 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 25/46] 10.222.0.44 () {60 vars in 1131 bytes} [Thu Jun 16 00:12:33 2022] POST /identity/v3/roles => generated 223 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:12:35.398401 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6ec48-8ff1-4d41-bfb1-1cf77d008e7a None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:35.398913 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6ec48-8ff1-4d41-bfb1-1cf77d008e7a None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:35.399015 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d6ec48-8ff1-4d41-bfb1-1cf77d008e7a None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:35.400396 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 22/47] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:35.405572 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6d287-00ce-4d65-87bf-d0ebb6b52673 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:35.405996 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6d287-00ce-4d65-87bf-d0ebb6b52673 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:35.406142 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca6d287-00ce-4d65-87bf-d0ebb6b52673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:35.423441 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-8ca6d287-00ce-4d65-87bf-d0ebb6b52673 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:35.424708 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-8ca6d287-00ce-4d65-87bf-d0ebb6b52673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:35.494903 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 26/48] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:35.518178 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6ec48-8ff1-4d41-bfb1-1cf77d008e7a None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:35.522313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fd1dd-48f8-4e5b-9e36-0ef210d91537 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:35.522611 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fd1dd-48f8-4e5b-9e36-0ef210d91537 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:35.522895 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8fd1dd-48f8-4e5b-9e36-0ef210d91537 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:35.524412 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 27/49] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:12:35.529646 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c039184-3c27-4c12-8742-2c8f6c2f1f4f None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:35.530011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c039184-3c27-4c12-8742-2c8f6c2f1f4f None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:35.530303 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c039184-3c27-4c12-8742-2c8f6c2f1f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:35.548497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-7c039184-3c27-4c12-8742-2c8f6c2f1f4f None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:35.549770 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-7c039184-3c27-4c12-8742-2c8f6c2f1f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:35.596173 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:35.618916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 28/50] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:12:35.624140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d6ec48-8ff1-4d41-bfb1-1cf77d008e7a None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:35.625665 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:35.642202 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c039184-3c27-4c12-8742-2c8f6c2f1f4f None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:35.660259 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1dd439-b618-4c42-ac18-fa5e8e8b7cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:35.660997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dd439-b618-4c42-ac18-fa5e8e8b7cdd None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:35.661283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dd439-b618-4c42-ac18-fa5e8e8b7cdd None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:35.661563 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1dd439-b618-4c42-ac18-fa5e8e8b7cdd None admin] PATH_INFO: `/v3/domains/default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:35.662744 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1dd439-b618-4c42-ac18-fa5e8e8b7cdd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:35.664257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1dd439-b618-4c42-ac18-fa5e8e8b7cdd None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:35.665869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 23/51] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:35.671322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1dd439-b618-4c42-ac18-fa5e8e8b7cdd None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:35.740776 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c039184-3c27-4c12-8742-2c8f6c2f1f4f None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:35.769475 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1dd439-b618-4c42-ac18-fa5e8e8b7cdd None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:35.774976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d9b8a-0899-40a8-b8d0-1b1c0c296f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:35.775814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d9b8a-0899-40a8-b8d0-1b1c0c296f67 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:35.776107 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d9b8a-0899-40a8-b8d0-1b1c0c296f67 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:35.776394 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d9b8a-0899-40a8-b8d0-1b1c0c296f67 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:35.787939 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d9b8a-0899-40a8-b8d0-1b1c0c296f67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:35.795590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-976d9b8a-0899-40a8-b8d0-1b1c0c296f67 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:35.795590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:35.795590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:35.795590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:35.795590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:35.795590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:35.795590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:35.795590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:35.795590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:35.795590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:35.795590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:35.795590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:35.795590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:35.795590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:35.795590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:35.795590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:35.796640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:35.796640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:35.796640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:35.796640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:35.796640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:35.796640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:35.796640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:35.796640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:35.796640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:35.796640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:35.796640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:35.796640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:35.796640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:35.796640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:35.796640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:35.796640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:35.797550 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:35.797550 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:35.797550 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:35.797550 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:35.797550 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:35.797550 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:35.797550 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:35.797550 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:35.797550 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:35.797550 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:35.797550 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:35.797550 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:12:35.797550 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 29/52] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:12:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:35.803054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d9b8a-0899-40a8-b8d0-1b1c0c296f67 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:35.807377 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b11be2-a987-4bae-84cb-79f51cffef91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:35.808072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b11be2-a987-4bae-84cb-79f51cffef91 None admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:35.808370 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b11be2-a987-4bae-84cb-79f51cffef91 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:35.808655 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b11be2-a987-4bae-84cb-79f51cffef91 None admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:35.809378 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b11be2-a987-4bae-84cb-79f51cffef91 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:35.810850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b11be2-a987-4bae-84cb-79f51cffef91 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:35.837861 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 24/53] 10.222.0.44 () {60 vars in 1140 bytes} [Thu Jun 16 00:12:35 2022] POST /identity/v3/projects => generated 298 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:12:35.847103 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:35.912168 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d9b8a-0899-40a8-b8d0-1b1c0c296f67 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:35.948252 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79123c-1749-4305-abdd-411397fd9e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:35.948946 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79123c-1749-4305-abdd-411397fd9e4a None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:35.949242 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79123c-1749-4305-abdd-411397fd9e4a None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:35.949529 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c79123c-1749-4305-abdd-411397fd9e4a None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:35.950312 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79123c-1749-4305-abdd-411397fd9e4a None admin] RBAC: Adding query filter params (name=admin) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:35.950632 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79123c-1749-4305-abdd-411397fd9e4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:35.952149 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c79123c-1749-4305-abdd-411397fd9e4a None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:35.961484 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 30/54] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:12:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:35.967175 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b11be2-a987-4bae-84cb-79f51cffef91 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:35.993984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:36.074987 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b11be2-a987-4bae-84cb-79f51cffef91 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:36.107549 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee07a25-76fc-4f26-9c2d-11954377a31d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:36.108457 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee07a25-76fc-4f26-9c2d-11954377a31d None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:36.108746 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee07a25-76fc-4f26-9c2d-11954377a31d None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:36.109055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee07a25-76fc-4f26-9c2d-11954377a31d None admin] PATH_INFO: `/v3/users/5827dca4e6e6440096187e88acac47af` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:36.110252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee07a25-76fc-4f26-9c2d-11954377a31d None admin] RBAC: Authorizing `identity:get_user(user_id=5827dca4e6e6440096187e88acac47af)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:36.111757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee07a25-76fc-4f26-9c2d-11954377a31d None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:36.113953 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 25/55] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:12:35 2022] GET /identity/v3/users/5827dca4e6e6440096187e88acac47af => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:36.119498 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79123c-1749-4305-abdd-411397fd9e4a None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:36.217312 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c79123c-1749-4305-abdd-411397fd9e4a None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:36.218861 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:36.252906 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc86613-cab5-426e-a30d-92f07e4087a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:36.253719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc86613-cab5-426e-a30d-92f07e4087a9 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:36.254011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc86613-cab5-426e-a30d-92f07e4087a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:36.254295 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc86613-cab5-426e-a30d-92f07e4087a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:36.255478 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc86613-cab5-426e-a30d-92f07e4087a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:36.256985 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc86613-cab5-426e-a30d-92f07e4087a9 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:36.258657 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 31/56] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:36.264352 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee07a25-76fc-4f26-9c2d-11954377a31d None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:36.354338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:36.364934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee07a25-76fc-4f26-9c2d-11954377a31d None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:36.398188 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb8e773-3046-4766-8921-8a66397ed65b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:36.398852 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8e773-3046-4766-8921-8a66397ed65b None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:36.399376 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8e773-3046-4766-8921-8a66397ed65b None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:36.399461 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb8e773-3046-4766-8921-8a66397ed65b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:36.400276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8e773-3046-4766-8921-8a66397ed65b None admin] RBAC: Adding query filter params (role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab, scope.domain.id=default, user.id=5827dca4e6e6440096187e88acac47af) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:36.400602 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8e773-3046-4766-8921-8a66397ed65b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:36.402067 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb8e773-3046-4766-8921-8a66397ed65b None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:36.407828 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 26/57] 10.222.0.44 () {56 vars in 1322 bytes} [Thu Jun 16 00:12:36 2022] GET /identity/v3/role_assignments?user.id=5827dca4e6e6440096187e88acac47af&scope.domain.id=default&role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 530 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:37.954358 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e77ab5-279b-4127-a581-7479771b415e None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:37.954855 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e77ab5-279b-4127-a581-7479771b415e None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:37.954962 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e77ab5-279b-4127-a581-7479771b415e None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:37.956845 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 32/58] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:37.961928 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b61e02-ea2f-48c4-a65a-b7ab67c62866 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:37.962306 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b61e02-ea2f-48c4-a65a-b7ab67c62866 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:37.962496 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b61e02-ea2f-48c4-a65a-b7ab67c62866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:37.978775 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-a4b61e02-ea2f-48c4-a65a-b7ab67c62866 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:37.980003 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a4b61e02-ea2f-48c4-a65a-b7ab67c62866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:38.043471 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 27/59] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:38.069525 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e77ab5-279b-4127-a581-7479771b415e None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:38.174039 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e77ab5-279b-4127-a581-7479771b415e None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:38.207005 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0583e-7a72-40b2-bf4a-139cde7b44a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:38.207814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0583e-7a72-40b2-bf4a-139cde7b44a8 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:38.208105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0583e-7a72-40b2-bf4a-139cde7b44a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:38.208383 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0583e-7a72-40b2-bf4a-139cde7b44a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:38.209548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0583e-7a72-40b2-bf4a-139cde7b44a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:38.211006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0583e-7a72-40b2-bf4a-139cde7b44a8 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:38.212612 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 33/60] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:38.217996 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b61e02-ea2f-48c4-a65a-b7ab67c62866 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:38.299021 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:38.314530 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b61e02-ea2f-48c4-a65a-b7ab67c62866 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:38.347726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b742fc6-bfd4-4abe-9d5d-14066325724a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:38.348340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b742fc6-bfd4-4abe-9d5d-14066325724a None admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:38.348628 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b742fc6-bfd4-4abe-9d5d-14066325724a None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:38.348908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b742fc6-bfd4-4abe-9d5d-14066325724a None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:38.349623 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b742fc6-bfd4-4abe-9d5d-14066325724a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:38.351069 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b742fc6-bfd4-4abe-9d5d-14066325724a None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:38.375080 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 28/61] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 00:12:38 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:12:41.657062 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36e8d6-3eb0-496d-a5ab-74b9d21fe88d None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:41.657616 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36e8d6-3eb0-496d-a5ab-74b9d21fe88d None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:41.657616 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f36e8d6-3eb0-496d-a5ab-74b9d21fe88d None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:41.660152 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 34/62] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:41.681923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c0d81-2c98-4161-b021-d4f3b857c5c1 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:41.682447 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c0d81-2c98-4161-b021-d4f3b857c5c1 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:41.682532 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c0d81-2c98-4161-b021-d4f3b857c5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:41.709990 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8aed9b-4b07-45ec-8f31-b701a0e6eb84 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:41.710283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8aed9b-4b07-45ec-8f31-b701a0e6eb84 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:41.710567 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8aed9b-4b07-45ec-8f31-b701a0e6eb84 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:41.711971 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 35/63] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:41.712170 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-2f1c0d81-2c98-4161-b021-d4f3b857c5c1 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:41.713404 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-2f1c0d81-2c98-4161-b021-d4f3b857c5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:41.716790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9bada-f89a-466f-9bef-ac0a58227b7f None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:41.717081 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9bada-f89a-466f-9bef-ac0a58227b7f None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:41.717364 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b9bada-f89a-466f-9bef-ac0a58227b7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:41.744740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-c6b9bada-f89a-466f-9bef-ac0a58227b7f None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:41.745963 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-c6b9bada-f89a-466f-9bef-ac0a58227b7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:41.809690 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:41.845201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 29/64] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:41.859755 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 36/65] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:12:41.874186 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c0d81-2c98-4161-b021-d4f3b857c5c1 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:41.896856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9bada-f89a-466f-9bef-ac0a58227b7f None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:41.955423 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:41.995880 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c0d81-2c98-4161-b021-d4f3b857c5c1 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:41.998202 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b9bada-f89a-466f-9bef-ac0a58227b7f None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:42.033210 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e06d8b-e87c-4dc8-85c2-8864dd8fab0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:42.033794 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc0deb-87f3-4a53-a87c-93ab75aa31c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:42.034015 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e06d8b-e87c-4dc8-85c2-8864dd8fab0c None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.034331 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e06d8b-e87c-4dc8-85c2-8864dd8fab0c None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.034611 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e06d8b-e87c-4dc8-85c2-8864dd8fab0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.034716 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc0deb-87f3-4a53-a87c-93ab75aa31c0 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.034908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc0deb-87f3-4a53-a87c-93ab75aa31c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.035229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc0deb-87f3-4a53-a87c-93ab75aa31c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.045118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e06d8b-e87c-4dc8-85c2-8864dd8fab0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:42.045832 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc0deb-87f3-4a53-a87c-93ab75aa31c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:42.052989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-55e06d8b-e87c-4dc8-85c2-8864dd8fab0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:12:42.052989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:42.052989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:42.052989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:42.052989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:42.052989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:42.052989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:42.052989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:42.052989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:42.052989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:42.052989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:42.052989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:42.052989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:42.052989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:42.052989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:42.052989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:42.053829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:42.053829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:42.053829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:42.053829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:42.053829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:42.053829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:42.053829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:42.053829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:42.053829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:42.053829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:42.053829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:42.053829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:42.053829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:42.053829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:42.053829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:42.053829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:42.060707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:42.060707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:42.060707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:42.060707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:42.060707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:42.060707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:42.060707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:42.060707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:42.060707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:42.060707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:42.060707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:12:42.060707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:12:42.063247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-f9bc0deb-87f3-4a53-a87c-93ab75aa31c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:42.063247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:42.063247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:42.063247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:42.063247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:42.063247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:42.063247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:42.063247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:42.063247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:42.063247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:42.063247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:42.063247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:42.063247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:42.063247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:42.063247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:42.063247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:42.064353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:42.064353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:42.064353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:42.064353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:42.064353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:42.064353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:42.064353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:42.064353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:42.064353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:42.064353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:42.064353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:42.064353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:42.064353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:42.064353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:42.064353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:42.064353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:42.065120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:42.065120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:42.065120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:42.065120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:42.065120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:42.065120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:42.065120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:42.065120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:42.065120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:42.065120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:42.065120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:42.065120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:12:42.068937 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 30/66] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:12:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:42.069360 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 37/67] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:12:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:42.069585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dbe4a-e2d5-4229-9588-8be86a1dc42d None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.069585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dbe4a-e2d5-4229-9588-8be86a1dc42d None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.069585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1dbe4a-e2d5-4229-9588-8be86a1dc42d None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.071070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed21d0f-8ade-443e-806e-88b7556359a9 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.071070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed21d0f-8ade-443e-806e-88b7556359a9 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.071070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed21d0f-8ade-443e-806e-88b7556359a9 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.071485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 31/68] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:42.071485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1dbe4a-e2d5-4229-9588-8be86a1dc42d None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:42.072667 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 38/69] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:42.072667 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782227ad-b062-4740-a263-32b4f007bf7d None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.072667 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782227ad-b062-4740-a263-32b4f007bf7d None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.072667 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782227ad-b062-4740-a263-32b4f007bf7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.083703 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-782227ad-b062-4740-a263-32b4f007bf7d None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:42.084892 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-782227ad-b062-4740-a263-32b4f007bf7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:42.109733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:42.156452 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 39/70] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:42.157577 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cc7da-8cc5-448a-aa49-5d020189244f None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.157870 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cc7da-8cc5-448a-aa49-5d020189244f None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.158147 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54cc7da-8cc5-448a-aa49-5d020189244f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.180537 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-e54cc7da-8cc5-448a-aa49-5d020189244f None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:42.181751 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-e54cc7da-8cc5-448a-aa49-5d020189244f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:42.184044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1dbe4a-e2d5-4229-9588-8be86a1dc42d None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:42.213353 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:42.220826 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222c72a-d629-4acc-aab6-6f360a00ddac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:42.221537 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222c72a-d629-4acc-aab6-6f360a00ddac None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.222383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222c72a-d629-4acc-aab6-6f360a00ddac None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.222663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222c72a-d629-4acc-aab6-6f360a00ddac None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.223423 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222c72a-d629-4acc-aab6-6f360a00ddac None admin] RBAC: Adding query filter params (name=member) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:42.223783 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222c72a-d629-4acc-aab6-6f360a00ddac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:42.225195 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222c72a-d629-4acc-aab6-6f360a00ddac None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:42.235032 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 32/71] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:12:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:42.235683 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222c72a-d629-4acc-aab6-6f360a00ddac None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:42.257913 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 40/72] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:42.258672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cc7da-8cc5-448a-aa49-5d020189244f None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:42.351873 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222c72a-d629-4acc-aab6-6f360a00ddac None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:42.371377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:42.383896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54cc7da-8cc5-448a-aa49-5d020189244f None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:42.385273 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22d787-571e-486a-83b8-ae23d293058f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:42.385936 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22d787-571e-486a-83b8-ae23d293058f None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.386219 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22d787-571e-486a-83b8-ae23d293058f None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.386492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab22d787-571e-486a-83b8-ae23d293058f None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.387237 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22d787-571e-486a-83b8-ae23d293058f None admin] RBAC: Adding query filter params (name=admin) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:42.387549 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22d787-571e-486a-83b8-ae23d293058f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:42.388968 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab22d787-571e-486a-83b8-ae23d293058f None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:42.397640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 33/73] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:12:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:42.398576 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22d787-571e-486a-83b8-ae23d293058f None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:42.418858 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea017f-39c2-48a4-9487-d8d94abc8f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:42.419684 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea017f-39c2-48a4-9487-d8d94abc8f56 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.419978 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea017f-39c2-48a4-9487-d8d94abc8f56 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.420262 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea017f-39c2-48a4-9487-d8d94abc8f56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.430296 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea017f-39c2-48a4-9487-d8d94abc8f56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:42.438509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-b4ea017f-39c2-48a4-9487-d8d94abc8f56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:12:42.438509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:42.438509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:42.438509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:42.438509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:42.438509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:42.438509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:42.438509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:42.438509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:42.438509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:42.438509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:42.438509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:42.438509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:42.438509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:42.438509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:42.438509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:42.439326 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:42.439326 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:42.439326 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:42.439326 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:42.439326 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:42.439326 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:42.439326 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:42.439326 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:42.439326 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:42.439326 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:42.439326 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:42.439326 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:42.439326 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:42.439326 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:42.439326 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:42.439326 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:42.440129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:42.440129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:42.440129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:42.440129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:42.440129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:42.440129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:42.440129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:42.440129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:42.440129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:42.440129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:42.440129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:12:42.440129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:12:42.440129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 41/74] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:12:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:42.440788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea017f-39c2-48a4-9487-d8d94abc8f56 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:42.453897 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:42.500120 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab22d787-571e-486a-83b8-ae23d293058f None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:42.535148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecc6011-a4e2-4dd4-91f2-129ce423bda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:42.536059 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc6011-a4e2-4dd4-91f2-129ce423bda0 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.536345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc6011-a4e2-4dd4-91f2-129ce423bda0 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.536698 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecc6011-a4e2-4dd4-91f2-129ce423bda0 None admin] PATH_INFO: `/v3/users/f6600340cdd1454682f1b24e37dbb6fe` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.545466 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea017f-39c2-48a4-9487-d8d94abc8f56 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:42.554032 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc6011-a4e2-4dd4-91f2-129ce423bda0 None admin] RBAC: Authorizing `identity:get_user(user_id=f6600340cdd1454682f1b24e37dbb6fe)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:42.555503 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecc6011-a4e2-4dd4-91f2-129ce423bda0 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:42.561833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 34/75] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:12:42 2022] GET /identity/v3/users/f6600340cdd1454682f1b24e37dbb6fe => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:42.563169 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5f379-b608-4012-b019-65ddf5f38785 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.563425 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5f379-b608-4012-b019-65ddf5f38785 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.563736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5f379-b608-4012-b019-65ddf5f38785 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.565245 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 35/76] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:42.565884 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5f379-b608-4012-b019-65ddf5f38785 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:42.597470 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8dff6-7720-4f2f-80df-7ee486e7bc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:42.598292 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8dff6-7720-4f2f-80df-7ee486e7bc9a None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.598582 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8dff6-7720-4f2f-80df-7ee486e7bc9a None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.598859 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa8dff6-7720-4f2f-80df-7ee486e7bc9a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.619976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa8dff6-7720-4f2f-80df-7ee486e7bc9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:42.628664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-caa8dff6-7720-4f2f-80df-7ee486e7bc9a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:12:42.628664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:42.628664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:42.628664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:42.628664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:42.628664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:42.628664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:42.628664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:42.628664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:42.628664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:42.628664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:42.628664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:42.628664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:42.628664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:42.628664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:42.628664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:42.629495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:42.629495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:42.629495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:42.629495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:42.629495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:42.629495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:42.629495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:42.629495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:42.629495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:42.629495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:42.629495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:42.629495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:42.629495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:42.629495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:42.629495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:42.629495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:42.630238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:42.630238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:42.630238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:42.630238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:42.630238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:42.630238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:42.630238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:42.630238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:42.630238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:42.630238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:42.630238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:12:42.630238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:12:42.632706 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 42/77] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 00:12:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:42.633785 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8dff6-7720-4f2f-80df-7ee486e7bc9a None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:42.646544 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:42.695043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5f379-b608-4012-b019-65ddf5f38785 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:42.708763 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:42.729700 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aacbe5-b514-42ce-9b50-21090dd2e2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:42.730581 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aacbe5-b514-42ce-9b50-21090dd2e2c0 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.730866 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aacbe5-b514-42ce-9b50-21090dd2e2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.731138 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09aacbe5-b514-42ce-9b50-21090dd2e2c0 None admin] PATH_INFO: `/v3/users/5827dca4e6e6440096187e88acac47af` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.732352 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aacbe5-b514-42ce-9b50-21090dd2e2c0 None admin] RBAC: Authorizing `identity:get_user(user_id=5827dca4e6e6440096187e88acac47af)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:42.733826 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09aacbe5-b514-42ce-9b50-21090dd2e2c0 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:42.735810 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 36/78] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:12:42 2022] GET /identity/v3/users/5827dca4e6e6440096187e88acac47af => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:42.736585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aacbe5-b514-42ce-9b50-21090dd2e2c0 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:42.751944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa8dff6-7720-4f2f-80df-7ee486e7bc9a None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:42.790917 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b30ba7b-7a0c-4d8f-8daa-87156e5cd945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:42.791730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30ba7b-7a0c-4d8f-8daa-87156e5cd945 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.792093 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30ba7b-7a0c-4d8f-8daa-87156e5cd945 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.792380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b30ba7b-7a0c-4d8f-8daa-87156e5cd945 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.793146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30ba7b-7a0c-4d8f-8daa-87156e5cd945 None admin] RBAC: Adding query filter params (name=member) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:42.793458 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30ba7b-7a0c-4d8f-8daa-87156e5cd945 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:42.795651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b30ba7b-7a0c-4d8f-8daa-87156e5cd945 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:42.804134 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 43/79] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:12:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:42.806187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d825213-0886-4555-ad92-93c043acd5bd None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.806759 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d825213-0886-4555-ad92-93c043acd5bd None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.807059 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d825213-0886-4555-ad92-93c043acd5bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.827373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-8d825213-0886-4555-ad92-93c043acd5bd None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:42.828601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-8d825213-0886-4555-ad92-93c043acd5bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:42.852752 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09aacbe5-b514-42ce-9b50-21090dd2e2c0 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:42.886221 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cbaa0-3ace-49cc-8909-d4fe8af03cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:42.886868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cbaa0-3ace-49cc-8909-d4fe8af03cae None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:42.887157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cbaa0-3ace-49cc-8909-d4fe8af03cae None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:42.887437 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cbaa0-3ace-49cc-8909-d4fe8af03cae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:42.890090 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:42.895853 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 44/80] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:42.897404 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d825213-0886-4555-ad92-93c043acd5bd None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:42.940157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:42.960378 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26cbaa0-3ace-49cc-8909-d4fe8af03cae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:42.961868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26cbaa0-3ace-49cc-8909-d4fe8af03cae None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:42.997130 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d825213-0886-4555-ad92-93c043acd5bd None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:43.030174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb562b2-e939-464c-8c5a-fc87383d0fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:43.030789 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb562b2-e939-464c-8c5a-fc87383d0fc5 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:43.031075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb562b2-e939-464c-8c5a-fc87383d0fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:43.031351 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb562b2-e939-464c-8c5a-fc87383d0fc5 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:43.032159 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb562b2-e939-464c-8c5a-fc87383d0fc5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:43.032471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb562b2-e939-464c-8c5a-fc87383d0fc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:43.033839 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb562b2-e939-464c-8c5a-fc87383d0fc5 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:43.042197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 45/81] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:43.043379 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb562b2-e939-464c-8c5a-fc87383d0fc5 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:43.062726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 37/82] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:12:43.063553 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cbaa0-3ace-49cc-8909-d4fe8af03cae None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:43.108150 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:43.143336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:43.152915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb562b2-e939-464c-8c5a-fc87383d0fc5 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:43.163754 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cbaa0-3ace-49cc-8909-d4fe8af03cae None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:43.185714 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894150e-dd85-40f6-822f-0d85a8d7fca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:43.186457 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894150e-dd85-40f6-822f-0d85a8d7fca5 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:43.186744 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894150e-dd85-40f6-822f-0d85a8d7fca5 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:43.187023 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9894150e-dd85-40f6-822f-0d85a8d7fca5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:43.197234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c6a62-e511-4663-80d0-40821bc4e030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:43.198132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c6a62-e511-4663-80d0-40821bc4e030 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:43.198422 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c6a62-e511-4663-80d0-40821bc4e030 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:43.198701 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1c6a62-e511-4663-80d0-40821bc4e030 None admin] PATH_INFO: `/v3/users/f6600340cdd1454682f1b24e37dbb6fe` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:43.199967 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c6a62-e511-4663-80d0-40821bc4e030 None admin] RBAC: Authorizing `identity:get_user(user_id=f6600340cdd1454682f1b24e37dbb6fe)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:43.201472 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1c6a62-e511-4663-80d0-40821bc4e030 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:43.203109 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 38/83] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:12:43 2022] GET /identity/v3/users/f6600340cdd1454682f1b24e37dbb6fe => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:43.203896 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c6a62-e511-4663-80d0-40821bc4e030 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:43.257639 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894150e-dd85-40f6-822f-0d85a8d7fca5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:43.259106 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9894150e-dd85-40f6-822f-0d85a8d7fca5 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:43.301880 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1c6a62-e511-4663-80d0-40821bc4e030 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:43.317510 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:43.335077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c4999-2dc9-47ac-9295-dffaae3d9344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:43.335889 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c4999-2dc9-47ac-9295-dffaae3d9344 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:43.336186 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c4999-2dc9-47ac-9295-dffaae3d9344 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:43.336465 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8c4999-2dc9-47ac-9295-dffaae3d9344 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:43.337633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c4999-2dc9-47ac-9295-dffaae3d9344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:43.339083 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8c4999-2dc9-47ac-9295-dffaae3d9344 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:43.340722 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 39/84] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:43.341562 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c4999-2dc9-47ac-9295-dffaae3d9344 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:43.360172 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:43.361924 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 46/85] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:12:43.362768 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894150e-dd85-40f6-822f-0d85a8d7fca5 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:43.442910 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8c4999-2dc9-47ac-9295-dffaae3d9344 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:43.462230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9894150e-dd85-40f6-822f-0d85a8d7fca5 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:43.476437 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b3ebb-ca7c-4725-808e-9c617facbf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:43.477316 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b3ebb-ca7c-4725-808e-9c617facbf26 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:43.477606 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b3ebb-ca7c-4725-808e-9c617facbf26 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:43.477889 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491b3ebb-ca7c-4725-808e-9c617facbf26 None admin] PATH_INFO: `/v3/users/f6600340cdd1454682f1b24e37dbb6fe` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:43.479104 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b3ebb-ca7c-4725-808e-9c617facbf26 None admin] RBAC: Authorizing `identity:get_user(user_id=f6600340cdd1454682f1b24e37dbb6fe)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:43.480604 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491b3ebb-ca7c-4725-808e-9c617facbf26 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:43.482237 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 40/86] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:12:43 2022] GET /identity/v3/users/f6600340cdd1454682f1b24e37dbb6fe => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:43.482237 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b3ebb-ca7c-4725-808e-9c617facbf26 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:43.499697 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a033f05-122c-4527-83a9-e5dafa29d0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:43.500568 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a033f05-122c-4527-83a9-e5dafa29d0c2 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:43.500859 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a033f05-122c-4527-83a9-e5dafa29d0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:43.501139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a033f05-122c-4527-83a9-e5dafa29d0c2 None admin] PATH_INFO: `/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:43.502591 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a033f05-122c-4527-83a9-e5dafa29d0c2 None admin] RBAC: Authorizing `identity:get_project(project_id=b5d7f8028eb1486d8dbc58cd5d98a225)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:43.504598 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a033f05-122c-4527-83a9-e5dafa29d0c2 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:43.506281 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 47/87] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:12:43 2022] GET /identity/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:43.507086 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a033f05-122c-4527-83a9-e5dafa29d0c2 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:43.536219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:43.568621 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:43.585127 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491b3ebb-ca7c-4725-808e-9c617facbf26 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:43.605077 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a033f05-122c-4527-83a9-e5dafa29d0c2 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:43.617911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc2b10-7d58-4d66-af0e-059be83ed66b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:43.618558 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc2b10-7d58-4d66-af0e-059be83ed66b None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:43.618841 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc2b10-7d58-4d66-af0e-059be83ed66b None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:43.619116 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bc2b10-7d58-4d66-af0e-059be83ed66b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:43.639600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecd514-0a44-425c-acb7-6b8fb8f096fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:43.640305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecd514-0a44-425c-acb7-6b8fb8f096fb None admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:43.640603 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecd514-0a44-425c-acb7-6b8fb8f096fb None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:43.640884 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ecd514-0a44-425c-acb7-6b8fb8f096fb None admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:43.641610 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecd514-0a44-425c-acb7-6b8fb8f096fb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:43.643059 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ecd514-0a44-425c-acb7-6b8fb8f096fb None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:43.667696 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 48/88] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 00:12:43 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:12:43.667696 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecd514-0a44-425c-acb7-6b8fb8f096fb None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:43.700264 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc2b10-7d58-4d66-af0e-059be83ed66b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:43.701947 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bc2b10-7d58-4d66-af0e-059be83ed66b None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:43.766193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:43.785227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ecd514-0a44-425c-acb7-6b8fb8f096fb None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:43.803063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:43.822868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 41/89] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:12:43.823481 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d6e93-7723-4e2a-b7c6-e823a032b1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:43.824061 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc2b10-7d58-4d66-af0e-059be83ed66b None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:43.824468 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d6e93-7723-4e2a-b7c6-e823a032b1a9 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:43.824763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d6e93-7723-4e2a-b7c6-e823a032b1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:43.825042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380d6e93-7723-4e2a-b7c6-e823a032b1a9 None admin] PATH_INFO: `/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:43.826364 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d6e93-7723-4e2a-b7c6-e823a032b1a9 None admin] RBAC: Authorizing `identity:get_project(project_id=b5d7f8028eb1486d8dbc58cd5d98a225)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:43.827808 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380d6e93-7723-4e2a-b7c6-e823a032b1a9 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:43.829798 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 49/90] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:12:43 2022] GET /identity/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:43.830568 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d6e93-7723-4e2a-b7c6-e823a032b1a9 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:43.947595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bc2b10-7d58-4d66-af0e-059be83ed66b None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:43.953512 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380d6e93-7723-4e2a-b7c6-e823a032b1a9 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:43.991315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96caf7-6bed-48d6-bc3c-d6c0c7f96b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:43.992152 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96caf7-6bed-48d6-bc3c-d6c0c7f96b38 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:43.992434 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96caf7-6bed-48d6-bc3c-d6c0c7f96b38 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:43.992861 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d96caf7-6bed-48d6-bc3c-d6c0c7f96b38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:44.001387 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e668c-8c09-49eb-96ec-890a48e2f5b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:44.001387 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e668c-8c09-49eb-96ec-890a48e2f5b9 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:44.001387 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e668c-8c09-49eb-96ec-890a48e2f5b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:44.001387 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e668c-8c09-49eb-96ec-890a48e2f5b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:44.001948 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e668c-8c09-49eb-96ec-890a48e2f5b9 None admin] RBAC: Adding query filter params (role.id=d6fedf23abb64cd494e8b49acefff423, scope.project.id=b5d7f8028eb1486d8dbc58cd5d98a225, user.id=f6600340cdd1454682f1b24e37dbb6fe) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:44.002276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e668c-8c09-49eb-96ec-890a48e2f5b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:44.004576 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e668c-8c09-49eb-96ec-890a48e2f5b9 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:44.014701 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 50/91] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:43 2022] GET /identity/v3/role_assignments?user.id=f6600340cdd1454682f1b24e37dbb6fe&scope.project.id=b5d7f8028eb1486d8dbc58cd5d98a225&role.id=d6fedf23abb64cd494e8b49acefff423 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:44.015362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e668c-8c09-49eb-96ec-890a48e2f5b9 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:44.047742 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:44.064013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:44.080925 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96caf7-6bed-48d6-bc3c-d6c0c7f96b38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:44.082924 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d96caf7-6bed-48d6-bc3c-d6c0c7f96b38 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:44.149375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e668c-8c09-49eb-96ec-890a48e2f5b9 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:44.190785 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd247367-513f-468e-93a9-ce2ebee8dfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:44.191778 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd247367-513f-468e-93a9-ce2ebee8dfc7 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:44.192074 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd247367-513f-468e-93a9-ce2ebee8dfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:44.192435 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd247367-513f-468e-93a9-ce2ebee8dfc7 None admin] PATH_INFO: `/v3/projects/abf32515d23d467da80599bd06e99e29` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:44.194264 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd247367-513f-468e-93a9-ce2ebee8dfc7 None admin] RBAC: Authorizing `identity:get_project(project_id=abf32515d23d467da80599bd06e99e29)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:44.195821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd247367-513f-468e-93a9-ce2ebee8dfc7 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:44.198013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 51/92] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:12:44 2022] GET /identity/v3/projects/abf32515d23d467da80599bd06e99e29 => generated 312 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:44.198833 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd247367-513f-468e-93a9-ce2ebee8dfc7 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:44.226713 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 42/93] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:12:44.227820 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96caf7-6bed-48d6-bc3c-d6c0c7f96b38 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:44.311246 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:44.346940 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd247367-513f-468e-93a9-ce2ebee8dfc7 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:44.348200 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:44.366833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d96caf7-6bed-48d6-bc3c-d6c0c7f96b38 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:44.413904 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe74a48-9fe0-495a-8612-d260d1007244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:44.414582 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe74a48-9fe0-495a-8612-d260d1007244 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:44.414873 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe74a48-9fe0-495a-8612-d260d1007244 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:44.415156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe74a48-9fe0-495a-8612-d260d1007244 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:44.416025 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe74a48-9fe0-495a-8612-d260d1007244 None admin] RBAC: Adding query filter params (role.id=d6fedf23abb64cd494e8b49acefff423, scope.project.id=abf32515d23d467da80599bd06e99e29, user.id=f6600340cdd1454682f1b24e37dbb6fe) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:44.416357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe74a48-9fe0-495a-8612-d260d1007244 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:44.417804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe74a48-9fe0-495a-8612-d260d1007244 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:44.420895 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da670d-0d67-4e82-bc89-10a956aaf3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:44.421565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da670d-0d67-4e82-bc89-10a956aaf3bc None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:44.421854 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da670d-0d67-4e82-bc89-10a956aaf3bc None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:44.422135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da670d-0d67-4e82-bc89-10a956aaf3bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:44.422983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da670d-0d67-4e82-bc89-10a956aaf3bc None admin] RBAC: Adding query filter params (role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab, scope.project.id=b5d7f8028eb1486d8dbc58cd5d98a225, user.id=5827dca4e6e6440096187e88acac47af) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:44.423305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da670d-0d67-4e82-bc89-10a956aaf3bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:44.424965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da670d-0d67-4e82-bc89-10a956aaf3bc None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:44.433260 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 43/94] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:44 2022] GET /identity/v3/role_assignments?user.id=f6600340cdd1454682f1b24e37dbb6fe&scope.project.id=abf32515d23d467da80599bd06e99e29&role.id=d6fedf23abb64cd494e8b49acefff423 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:44.435410 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 52/95] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:44 2022] GET /identity/v3/role_assignments?user.id=5827dca4e6e6440096187e88acac47af&scope.project.id=b5d7f8028eb1486d8dbc58cd5d98a225&role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:44.436252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe74a48-9fe0-495a-8612-d260d1007244 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:44.587673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe74a48-9fe0-495a-8612-d260d1007244 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:44.631755 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a6295-d121-4c45-983d-5b8a76600237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:44.632594 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a6295-d121-4c45-983d-5b8a76600237 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:44.632881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a6295-d121-4c45-983d-5b8a76600237 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:44.633161 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a6295-d121-4c45-983d-5b8a76600237 None admin] PATH_INFO: `/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:44.640688 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a6295-d121-4c45-983d-5b8a76600237 None admin] RBAC: Authorizing `identity:get_project(project_id=b5d7f8028eb1486d8dbc58cd5d98a225)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:44.642240 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a6295-d121-4c45-983d-5b8a76600237 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:44.644689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 44/96] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:12:44 2022] GET /identity/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:44.650869 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da670d-0d67-4e82-bc89-10a956aaf3bc None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:44.807645 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da670d-0d67-4e82-bc89-10a956aaf3bc None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:44.839400 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b65e6-addb-4525-8773-5e0ca51bb760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:44.840105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b65e6-addb-4525-8773-5e0ca51bb760 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:44.840399 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b65e6-addb-4525-8773-5e0ca51bb760 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:44.840683 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b65e6-addb-4525-8773-5e0ca51bb760 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:44.841528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b65e6-addb-4525-8773-5e0ca51bb760 None admin] RBAC: Adding query filter params (role.id=e6bcb832ed6d4843825263e23d8fb208, scope.project.id=b5d7f8028eb1486d8dbc58cd5d98a225, user.id=f6600340cdd1454682f1b24e37dbb6fe) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:44.841848 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b65e6-addb-4525-8773-5e0ca51bb760 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:44.843325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b65e6-addb-4525-8773-5e0ca51bb760 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:44.849679 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 53/97] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:44 2022] GET /identity/v3/role_assignments?user.id=f6600340cdd1454682f1b24e37dbb6fe&scope.project.id=b5d7f8028eb1486d8dbc58cd5d98a225&role.id=e6bcb832ed6d4843825263e23d8fb208 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:46.697785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6f8a3-6f36-4aa7-9e29-be0a9698129b None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:46.698326 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6f8a3-6f36-4aa7-9e29-be0a9698129b None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:46.698326 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b6f8a3-6f36-4aa7-9e29-be0a9698129b None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:46.700061 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 45/98] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:46.705503 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa61ce-b819-41c1-8af3-d22e98905ef7 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:46.705978 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa61ce-b819-41c1-8af3-d22e98905ef7 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:46.706079 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa61ce-b819-41c1-8af3-d22e98905ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:46.732884 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-cfaa61ce-b819-41c1-8af3-d22e98905ef7 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:46.734143 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-cfaa61ce-b819-41c1-8af3-d22e98905ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:46.744689 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:46.772848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb4d48-da7b-446b-8bb4-323c04660e3c None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:46.773174 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb4d48-da7b-446b-8bb4-323c04660e3c None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:46.773412 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb4d48-da7b-446b-8bb4-323c04660e3c None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:46.774794 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 46/99] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:46.780584 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caf21e-843f-4924-b4e9-1868157cc6e0 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:46.780885 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caf21e-843f-4924-b4e9-1868157cc6e0 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:46.781172 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8caf21e-843f-4924-b4e9-1868157cc6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:46.810348 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-a8caf21e-843f-4924-b4e9-1868157cc6e0 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:46.811582 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a8caf21e-843f-4924-b4e9-1868157cc6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:46.828096 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:46.853493 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 54/100] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:12:46.915220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa61ce-b819-41c1-8af3-d22e98905ef7 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:46.921002 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 47/101] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:12:46.985619 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caf21e-843f-4924-b4e9-1868157cc6e0 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:47.087936 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa61ce-b819-41c1-8af3-d22e98905ef7 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:47.124924 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8caf21e-843f-4924-b4e9-1868157cc6e0 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:47.167282 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e1b0e-4551-4718-a3e2-acf98947d0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:47.168480 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e1b0e-4551-4718-a3e2-acf98947d0be None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:47.168966 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e1b0e-4551-4718-a3e2-acf98947d0be None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:47.169540 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566e1b0e-4551-4718-a3e2-acf98947d0be None admin] PATH_INFO: `/v3/domains/default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:47.176512 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e1b0e-4551-4718-a3e2-acf98947d0be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:47.178223 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566e1b0e-4551-4718-a3e2-acf98947d0be None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:47.180495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 55/102] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:47.185967 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e1b0e-4551-4718-a3e2-acf98947d0be None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:47.198752 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544aea03-a8b3-46a4-acab-a0c75d8b8366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:47.199998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544aea03-a8b3-46a4-acab-a0c75d8b8366 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:47.200523 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544aea03-a8b3-46a4-acab-a0c75d8b8366 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:47.201006 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544aea03-a8b3-46a4-acab-a0c75d8b8366 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:47.213895 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:47.224557 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544aea03-a8b3-46a4-acab-a0c75d8b8366 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:47.239708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-544aea03-a8b3-46a4-acab-a0c75d8b8366 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:12:47.239708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:47.239708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:47.239708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:47.239708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:47.239708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:47.239708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:47.239708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:47.239708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:47.239708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:47.239708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:47.239708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:47.239708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:47.239708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:47.239708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:47.239708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:47.240572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:47.240572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:47.240572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:47.240572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:47.240572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:47.240572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:47.240572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:47.240572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:47.240572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:47.240572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:47.240572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:47.240572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:47.240572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:47.240572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:47.240572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:47.240572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:47.241349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:47.241349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:47.241349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:47.241349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:47.241349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:47.241349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:47.241349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:47.241349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:47.241349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:47.241349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:47.241349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:12:47.241349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:12:47.243787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 48/103] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:12:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:12:47.249619 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544aea03-a8b3-46a4-acab-a0c75d8b8366 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:47.267678 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:47.414296 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566e1b0e-4551-4718-a3e2-acf98947d0be None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:47.434887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544aea03-a8b3-46a4-acab-a0c75d8b8366 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:47.493828 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f25af0-44b1-4d2e-abb5-1f46d258c6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:47.494429 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f25af0-44b1-4d2e-abb5-1f46d258c6a9 None admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:47.494718 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f25af0-44b1-4d2e-abb5-1f46d258c6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:47.494997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f25af0-44b1-4d2e-abb5-1f46d258c6a9 None admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:47.495754 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f25af0-44b1-4d2e-abb5-1f46d258c6a9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:47.497229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f25af0-44b1-4d2e-abb5-1f46d258c6a9 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:47.500795 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5ac44-4c6e-4818-8a70-cfb912cf89d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:47.502167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5ac44-4c6e-4818-8a70-cfb912cf89d6 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:47.502946 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5ac44-4c6e-4818-8a70-cfb912cf89d6 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:47.504019 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5ac44-4c6e-4818-8a70-cfb912cf89d6 None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:47.505012 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5ac44-4c6e-4818-8a70-cfb912cf89d6 None admin] RBAC: Adding query filter params (name=member) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:47.505529 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5ac44-4c6e-4818-8a70-cfb912cf89d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:47.507719 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5ac44-4c6e-4818-8a70-cfb912cf89d6 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:47.520442 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 49/104] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:12:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:47.522099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c0035-86bd-4ee8-9a7a-2b0c6ad02864 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:47.522597 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c0035-86bd-4ee8-9a7a-2b0c6ad02864 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:47.523097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207c0035-86bd-4ee8-9a7a-2b0c6ad02864 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:47.524582 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 50/105] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:47.530421 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766d168-7afa-4aed-b6f0-d441c0b75c93 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:47.530967 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766d168-7afa-4aed-b6f0-d441c0b75c93 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:47.531451 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e766d168-7afa-4aed-b6f0-d441c0b75c93 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:47.533194 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 51/106] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:47.538081 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766d168-7afa-4aed-b6f0-d441c0b75c93 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:47.541615 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 56/107] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 00:12:47 2022] POST /identity/v3/projects => generated 302 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:12:47.548467 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be236c-5d79-4fce-b51a-870867299f5d None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:47.549095 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be236c-5d79-4fce-b51a-870867299f5d None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:47.549624 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be236c-5d79-4fce-b51a-870867299f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:47.569658 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-f9be236c-5d79-4fce-b51a-870867299f5d None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:47.571246 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-f9be236c-5d79-4fce-b51a-870867299f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:47.638608 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:47.640056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:47.649655 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 57/108] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:47.655649 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e54d1-7701-48a4-8983-7e5c0f9b0960 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:47.656427 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e54d1-7701-48a4-8983-7e5c0f9b0960 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:47.656919 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e54d1-7701-48a4-8983-7e5c0f9b0960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:47.683316 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e766d168-7afa-4aed-b6f0-d441c0b75c93 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:47.683951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-846e54d1-7701-48a4-8983-7e5c0f9b0960 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:47.685469 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-846e54d1-7701-48a4-8983-7e5c0f9b0960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:47.726142 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da55db-0753-4985-8203-2eeb0f4df5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:47.727031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da55db-0753-4985-8203-2eeb0f4df5c2 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:47.727519 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da55db-0753-4985-8203-2eeb0f4df5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:47.727967 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3da55db-0753-4985-8203-2eeb0f4df5c2 None admin] PATH_INFO: `/v3/users/f6600340cdd1454682f1b24e37dbb6fe` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:47.729573 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da55db-0753-4985-8203-2eeb0f4df5c2 None admin] RBAC: Authorizing `identity:get_user(user_id=f6600340cdd1454682f1b24e37dbb6fe)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:47.731335 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3da55db-0753-4985-8203-2eeb0f4df5c2 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:47.733518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 52/109] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:12:47 2022] GET /identity/v3/users/f6600340cdd1454682f1b24e37dbb6fe => generated 275 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:47.739804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da55db-0753-4985-8203-2eeb0f4df5c2 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:47.774923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 58/110] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:47.779975 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e54d1-7701-48a4-8983-7e5c0f9b0960 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:47.866196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3da55db-0753-4985-8203-2eeb0f4df5c2 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:47.908401 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5892d-8c53-4def-816a-d33f028460bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:47.909566 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5892d-8c53-4def-816a-d33f028460bb None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:47.909860 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5892d-8c53-4def-816a-d33f028460bb None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:47.910147 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5892d-8c53-4def-816a-d33f028460bb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:47.914766 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:47.919516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e54d1-7701-48a4-8983-7e5c0f9b0960 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:47.928469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e5892d-8c53-4def-816a-d33f028460bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:47.939443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-e3e5892d-8c53-4def-816a-d33f028460bb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:12:47.939443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:47.939443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:47.939443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:47.939443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:47.939443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:47.939443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:47.939443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:47.939443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:47.939443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:47.939443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:47.939443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:47.939443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:47.939443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:47.939443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:47.939443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:47.940373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:47.940373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:47.940373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:47.940373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:47.940373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:47.940373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:47.940373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:47.940373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:47.940373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:47.940373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:47.940373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:47.940373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:47.940373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:47.940373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:47.940373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:47.940373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:47.941201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:47.941201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:47.941201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:47.941201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:47.941201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:47.941201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:47.941201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:47.941201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:47.941201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:47.941201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:47.941201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:12:47.941201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:12:47.941201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 53/111] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:12:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:47.942363 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5892d-8c53-4def-816a-d33f028460bb None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:47.956414 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:47.971501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e13ca-04d1-4395-aac6-65c86490f3be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:47.972972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e13ca-04d1-4395-aac6-65c86490f3be None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:47.973262 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e13ca-04d1-4395-aac6-65c86490f3be None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:47.973544 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47e13ca-04d1-4395-aac6-65c86490f3be None admin] PATH_INFO: `/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:47.975941 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e13ca-04d1-4395-aac6-65c86490f3be None admin] RBAC: Authorizing `identity:get_project(project_id=b5d7f8028eb1486d8dbc58cd5d98a225)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:47.977011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47e13ca-04d1-4395-aac6-65c86490f3be None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:47.978875 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 59/112] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:12:47 2022] GET /identity/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:47.979483 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e13ca-04d1-4395-aac6-65c86490f3be None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:48.067882 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e5892d-8c53-4def-816a-d33f028460bb None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:48.089395 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47e13ca-04d1-4395-aac6-65c86490f3be None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:48.101367 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c662a3b-2185-470b-be3c-43f2f66aebcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:48.102175 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c662a3b-2185-470b-be3c-43f2f66aebcd None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:48.102474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c662a3b-2185-470b-be3c-43f2f66aebcd None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:48.102760 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c662a3b-2185-470b-be3c-43f2f66aebcd None admin] PATH_INFO: `/v3/roles/member` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:48.113201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c662a3b-2185-470b-be3c-43f2f66aebcd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:48.121071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-2c662a3b-2185-470b-be3c-43f2f66aebcd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:12:48.121071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:48.121071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:48.121071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:48.121071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:48.121071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:48.121071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:48.121071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:48.121071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:48.121071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:48.121071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:48.121071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:48.121071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:48.121071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:48.121071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:48.121071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:48.121908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:48.121908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:48.121908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:48.121908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:48.121908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:48.121908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:48.121908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:48.121908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:48.121908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:48.121908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:48.121908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:48.121908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:48.121908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:48.121908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:48.121908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:48.121908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:48.122668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:48.122668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:48.122668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:48.122668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:48.122668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:48.122668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:48.122668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:48.122668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:48.122668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:48.122668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:48.122668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:12:48.122668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:12:48.122668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 54/113] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:12:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:48.123468 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953348a-1148-4e6d-a9d8-ad9547492700 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:48.123793 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953348a-1148-4e6d-a9d8-ad9547492700 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:48.124080 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a953348a-1148-4e6d-a9d8-ad9547492700 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:48.125488 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 55/114] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:48.126037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953348a-1148-4e6d-a9d8-ad9547492700 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:48.130859 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3360c4-e45c-43b3-9acd-a014de11dff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:48.131896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3360c4-e45c-43b3-9acd-a014de11dff3 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:48.132430 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3360c4-e45c-43b3-9acd-a014de11dff3 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:48.132715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3360c4-e45c-43b3-9acd-a014de11dff3 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:48.133485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3360c4-e45c-43b3-9acd-a014de11dff3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:48.133798 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3360c4-e45c-43b3-9acd-a014de11dff3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:48.135186 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3360c4-e45c-43b3-9acd-a014de11dff3 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:48.144569 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 60/115] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:12:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:48.145730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b003b-bc85-4da6-a045-416822c4cd53 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:48.146027 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b003b-bc85-4da6-a045-416822c4cd53 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:48.146308 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54b003b-bc85-4da6-a045-416822c4cd53 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:48.147962 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 61/116] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:48.148540 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b003b-bc85-4da6-a045-416822c4cd53 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:48.189131 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:48.209886 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:48.238722 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a953348a-1148-4e6d-a9d8-ad9547492700 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:48.264192 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54b003b-bc85-4da6-a045-416822c4cd53 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:48.277208 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed654698-d3ed-4619-86eb-b0641bc6bd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:48.278106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed654698-d3ed-4619-86eb-b0641bc6bd26 None admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:48.278400 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed654698-d3ed-4619-86eb-b0641bc6bd26 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:48.278683 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed654698-d3ed-4619-86eb-b0641bc6bd26 None admin] PATH_INFO: `/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225/users/f6600340cdd1454682f1b24e37dbb6fe/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:48.280700 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed654698-d3ed-4619-86eb-b0641bc6bd26 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5d7f8028eb1486d8dbc58cd5d98a225, user_id=f6600340cdd1454682f1b24e37dbb6fe, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:48.282163 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed654698-d3ed-4619-86eb-b0641bc6bd26 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:48.302739 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 56/117] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 00:12:48 2022] PUT /identity/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225/users/f6600340cdd1454682f1b24e37dbb6fe/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:12:48.302739 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16259eff-c7bd-48a1-912f-e82afe33e16c None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:48.302739 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16259eff-c7bd-48a1-912f-e82afe33e16c None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:48.302739 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16259eff-c7bd-48a1-912f-e82afe33e16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:48.312132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6d4a7-bf55-4d4c-abf9-cd9753f83855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:48.312934 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6d4a7-bf55-4d4c-abf9-cd9753f83855 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:48.313294 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6d4a7-bf55-4d4c-abf9-cd9753f83855 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:48.313643 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea6d4a7-bf55-4d4c-abf9-cd9753f83855 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:48.314848 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6d4a7-bf55-4d4c-abf9-cd9753f83855 None admin] RBAC: Adding query filter params (name=member) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:48.314848 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6d4a7-bf55-4d4c-abf9-cd9753f83855 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:48.316404 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea6d4a7-bf55-4d4c-abf9-cd9753f83855 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:48.316623 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-16259eff-c7bd-48a1-912f-e82afe33e16c None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:48.317831 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-16259eff-c7bd-48a1-912f-e82afe33e16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:48.328246 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 62/118] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:12:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:48.334557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6d4a7-bf55-4d4c-abf9-cd9753f83855 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:48.401737 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 57/119] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:48.411305 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962b364-2799-4293-b5d2-3d052ad206ff None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:48.412213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962b364-2799-4293-b5d2-3d052ad206ff None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:48.412926 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8962b364-2799-4293-b5d2-3d052ad206ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:48.444248 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-8962b364-2799-4293-b5d2-3d052ad206ff None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:48.450050 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-8962b364-2799-4293-b5d2-3d052ad206ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:48.451120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea6d4a7-bf55-4d4c-abf9-cd9753f83855 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:48.481705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:48.503584 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2f4a9-92e8-4196-89be-efd2dcd1b29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:48.504504 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:48.505734 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2f4a9-92e8-4196-89be-efd2dcd1b29a None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:48.506291 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2f4a9-92e8-4196-89be-efd2dcd1b29a None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:48.506534 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2f4a9-92e8-4196-89be-efd2dcd1b29a None admin] PATH_INFO: `/v3/users/2433e81c767e41c5ab341643cfd5a181` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:48.529376 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2f4a9-92e8-4196-89be-efd2dcd1b29a None admin] RBAC: Authorizing `identity:get_user(user_id=2433e81c767e41c5ab341643cfd5a181)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:48.530854 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c2f4a9-92e8-4196-89be-efd2dcd1b29a None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:48.532811 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 63/120] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:12:48 2022] GET /identity/v3/users/2433e81c767e41c5ab341643cfd5a181 => generated 289 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:48.533431 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2f4a9-92e8-4196-89be-efd2dcd1b29a None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:48.536135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 58/121] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:48.537174 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962b364-2799-4293-b5d2-3d052ad206ff None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:48.644634 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c2f4a9-92e8-4196-89be-efd2dcd1b29a None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:48.658692 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8962b364-2799-4293-b5d2-3d052ad206ff None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:48.681170 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2449c-d972-4f78-92b2-670e302f1c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:48.682423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2449c-d972-4f78-92b2-670e302f1c13 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:48.682910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2449c-d972-4f78-92b2-670e302f1c13 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:48.683385 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef2449c-d972-4f78-92b2-670e302f1c13 None admin] PATH_INFO: `/v3/users/f6600340cdd1454682f1b24e37dbb6fe` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:48.684933 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2449c-d972-4f78-92b2-670e302f1c13 None admin] RBAC: Authorizing `identity:get_user(user_id=f6600340cdd1454682f1b24e37dbb6fe)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:48.686626 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef2449c-d972-4f78-92b2-670e302f1c13 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:48.688494 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 64/122] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:12:48 2022] GET /identity/v3/users/f6600340cdd1454682f1b24e37dbb6fe => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:48.693751 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2449c-d972-4f78-92b2-670e302f1c13 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:48.697978 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ae3ae-79ce-4f27-857a-c323179c79b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:48.698803 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ae3ae-79ce-4f27-857a-c323179c79b9 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:48.699099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ae3ae-79ce-4f27-857a-c323179c79b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:48.699373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88ae3ae-79ce-4f27-857a-c323179c79b9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:48.712142 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88ae3ae-79ce-4f27-857a-c323179c79b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:48.722798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-a88ae3ae-79ce-4f27-857a-c323179c79b9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:12:48.722798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:48.722798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:48.722798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:48.722798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:48.722798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:48.722798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:48.722798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:48.722798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:48.722798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:48.722798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:48.722798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:48.722798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:48.722798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:48.722798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:48.722798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:48.723687 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:48.723687 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:48.723687 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:48.723687 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:48.723687 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:48.723687 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:48.723687 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:48.723687 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:48.723687 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:48.723687 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:48.723687 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:48.723687 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:48.723687 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:48.723687 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:48.723687 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:48.723687 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:48.724551 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:48.724551 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:48.724551 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:48.724551 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:48.724551 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:48.724551 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:48.724551 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:48.724551 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:48.724551 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:48.724551 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:48.724551 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:12:48.724551 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:12:48.724551 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 59/123] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 00:12:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:48.725174 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ae3ae-79ce-4f27-857a-c323179c79b9 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:48.752287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:48.772009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:48.819229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef2449c-d972-4f78-92b2-670e302f1c13 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:48.852894 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88ae3ae-79ce-4f27-857a-c323179c79b9 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:48.855343 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe67af3-8cd1-4626-a50f-182688eb334f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:48.856364 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe67af3-8cd1-4626-a50f-182688eb334f None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:48.856797 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe67af3-8cd1-4626-a50f-182688eb334f None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:48.857248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe67af3-8cd1-4626-a50f-182688eb334f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:48.895140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca286fa-4b79-49ec-96c4-416f54b7a28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:48.896181 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca286fa-4b79-49ec-96c4-416f54b7a28e None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:48.896576 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca286fa-4b79-49ec-96c4-416f54b7a28e None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:48.896969 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca286fa-4b79-49ec-96c4-416f54b7a28e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:48.910339 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca286fa-4b79-49ec-96c4-416f54b7a28e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:48.920000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-2ca286fa-4b79-49ec-96c4-416f54b7a28e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:48.920000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:48.920000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:48.920000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:48.920000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:48.920000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:48.920000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:48.920000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:48.920000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:48.920000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:48.920000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:48.920000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:48.920000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:48.920000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:48.920000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:48.920000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:48.920850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:48.920850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:48.920850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:48.920850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:48.920850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:48.920850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:48.920850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:48.920850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:48.920850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:48.920850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:48.920850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:48.920850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:48.920850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:48.920850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:48.920850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:48.920850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:48.921633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:48.921633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:48.921633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:48.921633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:48.921633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:48.921633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:48.921633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:48.921633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:48.921633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:48.921633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:48.921633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:48.921633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:12:48.921633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 60/124] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:12:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:48.922276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca286fa-4b79-49ec-96c4-416f54b7a28e None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:48.942160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe67af3-8cd1-4626-a50f-182688eb334f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:48.944113 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe67af3-8cd1-4626-a50f-182688eb334f None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:48.991856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:49.041415 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:49.046871 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca286fa-4b79-49ec-96c4-416f54b7a28e None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:49.076548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 65/125] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:12:49.077953 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe67af3-8cd1-4626-a50f-182688eb334f None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:49.084086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79aee8-e3bd-4e7c-a5ab-6301c6026e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:49.084963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79aee8-e3bd-4e7c-a5ab-6301c6026e1a None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:49.085252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79aee8-e3bd-4e7c-a5ab-6301c6026e1a None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:49.085532 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee79aee8-e3bd-4e7c-a5ab-6301c6026e1a None admin] PATH_INFO: `/v3/projects/abf32515d23d467da80599bd06e99e29` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:49.086742 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79aee8-e3bd-4e7c-a5ab-6301c6026e1a None admin] RBAC: Authorizing `identity:get_project(project_id=abf32515d23d467da80599bd06e99e29)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:49.088267 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee79aee8-e3bd-4e7c-a5ab-6301c6026e1a None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:49.089962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 61/126] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:12:48 2022] GET /identity/v3/projects/abf32515d23d467da80599bd06e99e29 => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:49.090894 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79aee8-e3bd-4e7c-a5ab-6301c6026e1a None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:49.203775 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee79aee8-e3bd-4e7c-a5ab-6301c6026e1a None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:49.204894 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe67af3-8cd1-4626-a50f-182688eb334f None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:49.241881 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e2bc1-b69f-4309-8c6a-c9d8162a985f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:49.242573 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e2bc1-b69f-4309-8c6a-c9d8162a985f None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:49.242864 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e2bc1-b69f-4309-8c6a-c9d8162a985f None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:49.243148 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e2bc1-b69f-4309-8c6a-c9d8162a985f None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:49.243953 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e2bc1-b69f-4309-8c6a-c9d8162a985f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:49.244270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e2bc1-b69f-4309-8c6a-c9d8162a985f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:49.245657 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3e2bc1-b69f-4309-8c6a-c9d8162a985f None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:49.245886 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0422d-53fb-490a-999b-82e855495fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:49.246705 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0422d-53fb-490a-999b-82e855495fb7 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:49.247266 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0422d-53fb-490a-999b-82e855495fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:49.247740 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c0422d-53fb-490a-999b-82e855495fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:49.248920 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c0422d-53fb-490a-999b-82e855495fb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:49.249384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c0422d-53fb-490a-999b-82e855495fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:49.251332 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c0422d-53fb-490a-999b-82e855495fb7 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:49.256117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 66/127] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:49.257086 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e2bc1-b69f-4309-8c6a-c9d8162a985f None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:49.261768 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:49.261991 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 62/128] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:12:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:49.262913 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0422d-53fb-490a-999b-82e855495fb7 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:49.296539 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:49.374013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e2bc1-b69f-4309-8c6a-c9d8162a985f None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:49.387121 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c0422d-53fb-490a-999b-82e855495fb7 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:49.420272 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d08c87-58ab-40c1-8559-0033c29dc491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:49.421382 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d08c87-58ab-40c1-8559-0033c29dc491 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:49.421818 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d08c87-58ab-40c1-8559-0033c29dc491 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:49.422244 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d08c87-58ab-40c1-8559-0033c29dc491 None admin] PATH_INFO: `/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:49.422755 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5c37a-e26d-4f72-b2db-5c33588dbcdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:49.423814 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5c37a-e26d-4f72-b2db-5c33588dbcdf None admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:49.423960 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d08c87-58ab-40c1-8559-0033c29dc491 None admin] RBAC: Authorizing `identity:get_project(project_id=b5d7f8028eb1486d8dbc58cd5d98a225)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:49.424283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5c37a-e26d-4f72-b2db-5c33588dbcdf None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:49.424793 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5c37a-e26d-4f72-b2db-5c33588dbcdf None admin] PATH_INFO: `/v3/projects/abf32515d23d467da80599bd06e99e29/users/f6600340cdd1454682f1b24e37dbb6fe/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:49.426471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d08c87-58ab-40c1-8559-0033c29dc491 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:49.427579 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5c37a-e26d-4f72-b2db-5c33588dbcdf None admin] RBAC: Authorizing `identity:create_grant(project_id=abf32515d23d467da80599bd06e99e29, user_id=f6600340cdd1454682f1b24e37dbb6fe, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:49.428871 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 67/129] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:12:49 2022] GET /identity/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:49.429333 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5c37a-e26d-4f72-b2db-5c33588dbcdf None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:49.429968 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d08c87-58ab-40c1-8559-0033c29dc491 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:49.445318 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 63/130] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 00:12:49 2022] PUT /identity/v3/projects/abf32515d23d467da80599bd06e99e29/users/f6600340cdd1454682f1b24e37dbb6fe/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:12:49.446839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5c37a-e26d-4f72-b2db-5c33588dbcdf None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:49.604067 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:49.622062 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:49.639714 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5c37a-e26d-4f72-b2db-5c33588dbcdf None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:49.652174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d08c87-58ab-40c1-8559-0033c29dc491 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:49.689405 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3a9e1-0764-445e-8048-04e96bd419fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:49.689970 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd06f9-fe3c-4381-8830-18967a44d492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:49.690558 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3a9e1-0764-445e-8048-04e96bd419fa None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:49.691478 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3a9e1-0764-445e-8048-04e96bd419fa None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:49.691881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a3a9e1-0764-445e-8048-04e96bd419fa None admin] PATH_INFO: `/v3/users/5827dca4e6e6440096187e88acac47af` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:49.692071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd06f9-fe3c-4381-8830-18967a44d492 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:49.692495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd06f9-fe3c-4381-8830-18967a44d492 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:49.692915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd06f9-fe3c-4381-8830-18967a44d492 None admin] PATH_INFO: `/v3/users/f6600340cdd1454682f1b24e37dbb6fe` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:49.693395 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3a9e1-0764-445e-8048-04e96bd419fa None admin] RBAC: Authorizing `identity:get_user(user_id=5827dca4e6e6440096187e88acac47af)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:49.694462 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd06f9-fe3c-4381-8830-18967a44d492 None admin] RBAC: Authorizing `identity:get_user(user_id=f6600340cdd1454682f1b24e37dbb6fe)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:49.695066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a3a9e1-0764-445e-8048-04e96bd419fa None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:49.696244 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd06f9-fe3c-4381-8830-18967a44d492 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:49.697978 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 64/131] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:12:49 2022] GET /identity/v3/users/5827dca4e6e6440096187e88acac47af => generated 247 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:49.700165 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 68/132] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:12:49 2022] GET /identity/v3/users/f6600340cdd1454682f1b24e37dbb6fe => generated 275 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:49.701306 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3a9e1-0764-445e-8048-04e96bd419fa None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:49.705004 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd06f9-fe3c-4381-8830-18967a44d492 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:49.838738 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a3a9e1-0764-445e-8048-04e96bd419fa None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:49.847836 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd06f9-fe3c-4381-8830-18967a44d492 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:49.872642 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cf703-6ed3-4304-89ac-26f4c83cec33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:49.873236 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cf703-6ed3-4304-89ac-26f4c83cec33 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:49.873521 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cf703-6ed3-4304-89ac-26f4c83cec33 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:49.873801 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9cf703-6ed3-4304-89ac-26f4c83cec33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:49.874630 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9cf703-6ed3-4304-89ac-26f4c83cec33 None admin] RBAC: Adding query filter params (role.id=d80b3a9c2e6e45739aa3056330bc9ad8, scope.project.id=b5d7f8028eb1486d8dbc58cd5d98a225, user.id=2433e81c767e41c5ab341643cfd5a181) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:49.875114 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9cf703-6ed3-4304-89ac-26f4c83cec33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:49.876411 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9cf703-6ed3-4304-89ac-26f4c83cec33 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:49.882725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 65/133] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:49 2022] GET /identity/v3/role_assignments?user.id=2433e81c767e41c5ab341643cfd5a181&scope.project.id=b5d7f8028eb1486d8dbc58cd5d98a225&role.id=d80b3a9c2e6e45739aa3056330bc9ad8 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:49.883519 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cf703-6ed3-4304-89ac-26f4c83cec33 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:49.909787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:49.937116 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9a53b-1b28-49c2-bbd4-9272f2c3e2ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:49.938471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9a53b-1b28-49c2-bbd4-9272f2c3e2ca None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:49.938966 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9a53b-1b28-49c2-bbd4-9272f2c3e2ca None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:49.939453 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab9a53b-1b28-49c2-bbd4-9272f2c3e2ca None admin] PATH_INFO: `/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:49.944471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9a53b-1b28-49c2-bbd4-9272f2c3e2ca None admin] RBAC: Authorizing `identity:get_project(project_id=b5d7f8028eb1486d8dbc58cd5d98a225)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:49.946216 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab9a53b-1b28-49c2-bbd4-9272f2c3e2ca None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:49.948258 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 69/134] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:12:49 2022] GET /identity/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:49.954263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9a53b-1b28-49c2-bbd4-9272f2c3e2ca None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:49.979991 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:49.998028 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9cf703-6ed3-4304-89ac-26f4c83cec33 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:50.040223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957d85d-f2f4-49f4-bbcd-32b974c253e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:50.041108 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957d85d-f2f4-49f4-bbcd-32b974c253e0 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:50.041423 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957d85d-f2f4-49f4-bbcd-32b974c253e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:50.041703 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957d85d-f2f4-49f4-bbcd-32b974c253e0 None admin] PATH_INFO: `/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:50.043928 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957d85d-f2f4-49f4-bbcd-32b974c253e0 None admin] RBAC: Authorizing `identity:get_project(project_id=b5d7f8028eb1486d8dbc58cd5d98a225)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:50.045410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957d85d-f2f4-49f4-bbcd-32b974c253e0 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:50.047249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 66/135] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:12:49 2022] GET /identity/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:50.054020 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957d85d-f2f4-49f4-bbcd-32b974c253e0 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:50.154518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:50.167926 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957d85d-f2f4-49f4-bbcd-32b974c253e0 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:50.199449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab9a53b-1b28-49c2-bbd4-9272f2c3e2ca None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:50.212794 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e797972-51ea-4509-a298-49762c22e624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:50.213709 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e797972-51ea-4509-a298-49762c22e624 None admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:50.214613 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e797972-51ea-4509-a298-49762c22e624 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:50.214912 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e797972-51ea-4509-a298-49762c22e624 None admin] PATH_INFO: `/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225/users/f6600340cdd1454682f1b24e37dbb6fe/roles/e6bcb832ed6d4843825263e23d8fb208` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:50.217347 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e797972-51ea-4509-a298-49762c22e624 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5d7f8028eb1486d8dbc58cd5d98a225, user_id=f6600340cdd1454682f1b24e37dbb6fe, role_id=e6bcb832ed6d4843825263e23d8fb208)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:50.218878 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e797972-51ea-4509-a298-49762c22e624 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:50.239559 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 67/136] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 00:12:50 2022] PUT /identity/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225/users/f6600340cdd1454682f1b24e37dbb6fe/roles/e6bcb832ed6d4843825263e23d8fb208 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:12:50.272734 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189f72f-2ee4-48a3-a21f-81612f8df45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:50.273687 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189f72f-2ee4-48a3-a21f-81612f8df45b None admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:50.274045 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189f72f-2ee4-48a3-a21f-81612f8df45b None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:50.274333 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189f72f-2ee4-48a3-a21f-81612f8df45b None admin] PATH_INFO: `/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225/users/5827dca4e6e6440096187e88acac47af/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:50.278165 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189f72f-2ee4-48a3-a21f-81612f8df45b None admin] RBAC: Authorizing `identity:create_grant(project_id=b5d7f8028eb1486d8dbc58cd5d98a225, user_id=5827dca4e6e6440096187e88acac47af, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:50.279769 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b189f72f-2ee4-48a3-a21f-81612f8df45b None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:50.303654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4a7f5-efd7-49e8-9c32-974322fa488e None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:50.303980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4a7f5-efd7-49e8-9c32-974322fa488e None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:50.304336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de4a7f5-efd7-49e8-9c32-974322fa488e None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:50.305787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 68/137] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:12:50.307639 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 70/138] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 00:12:49 2022] PUT /identity/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225/users/5827dca4e6e6440096187e88acac47af/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:12:50.311171 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc7317-086b-458a-9d1e-a120a2e7b363 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:50.311461 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc7317-086b-458a-9d1e-a120a2e7b363 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:50.311772 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cc7317-086b-458a-9d1e-a120a2e7b363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:50.338404 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-02cc7317-086b-458a-9d1e-a120a2e7b363 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:50.339715 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-02cc7317-086b-458a-9d1e-a120a2e7b363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:50.435388 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 69/139] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:50.472784 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189f72f-2ee4-48a3-a21f-81612f8df45b None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:50.564423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:50.603885 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189f72f-2ee4-48a3-a21f-81612f8df45b None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:50.643521 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bf4cf4-778e-4033-80ec-18d8c27ee619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:50.644918 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf4cf4-778e-4033-80ec-18d8c27ee619 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:50.645217 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf4cf4-778e-4033-80ec-18d8c27ee619 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:50.645502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bf4cf4-778e-4033-80ec-18d8c27ee619 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:50.648245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf4cf4-778e-4033-80ec-18d8c27ee619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:50.649800 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bf4cf4-778e-4033-80ec-18d8c27ee619 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:50.651856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 71/140] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:50.657049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc7317-086b-458a-9d1e-a120a2e7b363 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:50.742981 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:50.768153 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cc7317-086b-458a-9d1e-a120a2e7b363 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:50.802861 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cb69a-af1b-49ed-9d91-5324635f4ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:50.803543 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cb69a-af1b-49ed-9d91-5324635f4ef8 None admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:50.804155 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cb69a-af1b-49ed-9d91-5324635f4ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:50.804435 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cb69a-af1b-49ed-9d91-5324635f4ef8 None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:50.805157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cb69a-af1b-49ed-9d91-5324635f4ef8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:50.806621 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cb69a-af1b-49ed-9d91-5324635f4ef8 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:50.836215 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 70/141] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 00:12:50 2022] POST /identity/v3/users => generated 283 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:12:50.980063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85cba0-e012-47ee-a01a-dddcbefba87a None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:50.980596 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85cba0-e012-47ee-a01a-dddcbefba87a None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:50.980683 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f85cba0-e012-47ee-a01a-dddcbefba87a None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:50.982150 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 72/142] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:50.987394 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02dbaf-7cff-4b8a-935c-b085e9859768 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:50.987920 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02dbaf-7cff-4b8a-935c-b085e9859768 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:50.988120 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e02dbaf-7cff-4b8a-935c-b085e9859768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:51.006278 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-7e02dbaf-7cff-4b8a-935c-b085e9859768 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:51.007418 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-7e02dbaf-7cff-4b8a-935c-b085e9859768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:51.094783 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 71/143] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:51.117750 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85cba0-e012-47ee-a01a-dddcbefba87a None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:51.271420 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f85cba0-e012-47ee-a01a-dddcbefba87a None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:51.311285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86dcd2c-0671-4791-ba0f-a69c40320344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:51.312126 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dcd2c-0671-4791-ba0f-a69c40320344 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:51.312416 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dcd2c-0671-4791-ba0f-a69c40320344 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:51.312705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86dcd2c-0671-4791-ba0f-a69c40320344 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:51.315997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:51.324754 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86dcd2c-0671-4791-ba0f-a69c40320344 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:51.333336 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-b86dcd2c-0671-4791-ba0f-a69c40320344 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:12:51.333336 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:51.333336 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:51.333336 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:51.333336 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:51.333336 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:51.333336 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:51.333336 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:51.333336 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:51.333336 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:51.333336 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:51.333336 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:51.333336 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:51.333336 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:51.333336 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:51.333336 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:51.334432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:51.334432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:51.334432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:51.334432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:51.334432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:51.334432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:51.334432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:51.334432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:51.334432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:51.334432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:51.334432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:51.334432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:51.334432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:51.334432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:51.334432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:51.334432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:51.335252 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:51.335252 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:51.335252 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:51.335252 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:51.335252 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:51.335252 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:51.335252 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:51.335252 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:51.335252 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:51.335252 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:51.335252 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:12:51.335252 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:12:51.340980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 73/144] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:12:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:51.346823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02dbaf-7cff-4b8a-935c-b085e9859768 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:51.432775 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:51.489465 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e02dbaf-7cff-4b8a-935c-b085e9859768 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:51.531681 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd605f09-8090-41a7-bd4e-a98553ba4b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:51.532332 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd605f09-8090-41a7-bd4e-a98553ba4b4a None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:51.532893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd605f09-8090-41a7-bd4e-a98553ba4b4a None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:51.532893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd605f09-8090-41a7-bd4e-a98553ba4b4a None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:51.533654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd605f09-8090-41a7-bd4e-a98553ba4b4a None admin] RBAC: Adding query filter params (name=member) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:51.533964 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd605f09-8090-41a7-bd4e-a98553ba4b4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:51.535942 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd605f09-8090-41a7-bd4e-a98553ba4b4a None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:51.548979 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 72/145] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:12:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:51.554615 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86dcd2c-0671-4791-ba0f-a69c40320344 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:51.711833 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86dcd2c-0671-4791-ba0f-a69c40320344 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:51.753762 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea847064-2acb-452d-9215-c4c423513e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:51.754646 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea847064-2acb-452d-9215-c4c423513e43 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:51.754947 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea847064-2acb-452d-9215-c4c423513e43 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:51.755232 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea847064-2acb-452d-9215-c4c423513e43 None admin] PATH_INFO: `/v3/users/f6600340cdd1454682f1b24e37dbb6fe` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:51.760364 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea847064-2acb-452d-9215-c4c423513e43 None admin] RBAC: Authorizing `identity:get_user(user_id=f6600340cdd1454682f1b24e37dbb6fe)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:51.761851 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea847064-2acb-452d-9215-c4c423513e43 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:51.763833 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 74/146] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:12:51 2022] GET /identity/v3/users/f6600340cdd1454682f1b24e37dbb6fe => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:51.768985 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd605f09-8090-41a7-bd4e-a98553ba4b4a None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:51.898344 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd605f09-8090-41a7-bd4e-a98553ba4b4a None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:51.927009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:51.942819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2645a-0222-46cd-9ec0-18100b293f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:51.943984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2645a-0222-46cd-9ec0-18100b293f41 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:51.944554 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2645a-0222-46cd-9ec0-18100b293f41 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:51.945246 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2645a-0222-46cd-9ec0-18100b293f41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:52.023876 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2645a-0222-46cd-9ec0-18100b293f41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:52.025428 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2645a-0222-46cd-9ec0-18100b293f41 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:52.140469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 73/147] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:12:52.146618 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea847064-2acb-452d-9215-c4c423513e43 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:52.233275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:52.284564 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea847064-2acb-452d-9215-c4c423513e43 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:52.320470 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e75ec3-a835-44cb-aeee-4c138012868e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:52.321407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e75ec3-a835-44cb-aeee-4c138012868e None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:52.321696 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e75ec3-a835-44cb-aeee-4c138012868e None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:52.321975 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e75ec3-a835-44cb-aeee-4c138012868e None admin] PATH_INFO: `/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:52.328336 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e75ec3-a835-44cb-aeee-4c138012868e None admin] RBAC: Authorizing `identity:get_project(project_id=b5d7f8028eb1486d8dbc58cd5d98a225)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:52.329817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e75ec3-a835-44cb-aeee-4c138012868e None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:52.331920 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 75/148] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:12:52 2022] GET /identity/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:52.337533 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2645a-0222-46cd-9ec0-18100b293f41 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:52.372311 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:52.461000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2645a-0222-46cd-9ec0-18100b293f41 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:52.498945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5ffcda-be0f-4b39-923d-7d9d4a9a039b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:52.499628 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ffcda-be0f-4b39-923d-7d9d4a9a039b None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:52.499924 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ffcda-be0f-4b39-923d-7d9d4a9a039b None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:52.500203 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5ffcda-be0f-4b39-923d-7d9d4a9a039b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:52.501145 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ffcda-be0f-4b39-923d-7d9d4a9a039b None admin] RBAC: Adding query filter params (role.id=d6fedf23abb64cd494e8b49acefff423, scope.project.id=b5d7f8028eb1486d8dbc58cd5d98a225, user.id=f6600340cdd1454682f1b24e37dbb6fe) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:52.501412 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ffcda-be0f-4b39-923d-7d9d4a9a039b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:52.502878 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5ffcda-be0f-4b39-923d-7d9d4a9a039b None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:52.509582 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 74/149] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:52 2022] GET /identity/v3/role_assignments?user.id=f6600340cdd1454682f1b24e37dbb6fe&scope.project.id=b5d7f8028eb1486d8dbc58cd5d98a225&role.id=d6fedf23abb64cd494e8b49acefff423 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:52.665910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aed2a-f3fd-4fa7-8e54-ce439cd49321 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:52.666613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aed2a-f3fd-4fa7-8e54-ce439cd49321 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:52.667102 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01aed2a-f3fd-4fa7-8e54-ce439cd49321 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:52.668760 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 76/150] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:52.674507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8b1f4-dab1-43bb-856b-95443edb770b None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:52.675107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8b1f4-dab1-43bb-856b-95443edb770b None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:52.675669 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d8b1f4-dab1-43bb-856b-95443edb770b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:52.694256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-55d8b1f4-dab1-43bb-856b-95443edb770b None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:52.695835 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-55d8b1f4-dab1-43bb-856b-95443edb770b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:52.783766 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 75/151] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:52.830946 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01aed2a-f3fd-4fa7-8e54-ce439cd49321 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:52.968469 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01aed2a-f3fd-4fa7-8e54-ce439cd49321 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:52.999711 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:53.006683 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7633357-ee96-471b-9cc7-addadede22c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:53.007496 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7633357-ee96-471b-9cc7-addadede22c5 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:53.007814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7633357-ee96-471b-9cc7-addadede22c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:53.008096 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7633357-ee96-471b-9cc7-addadede22c5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:53.025051 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7633357-ee96-471b-9cc7-addadede22c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:53.032849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-b7633357-ee96-471b-9cc7-addadede22c5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:12:53.032849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:53.032849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:53.032849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:53.032849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:53.032849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:53.032849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:53.032849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:53.032849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:53.032849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:53.032849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:53.032849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:53.032849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:53.032849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:53.032849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:53.032849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:53.033817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:53.033817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:53.033817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:53.033817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:53.033817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:53.033817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:53.033817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:53.033817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:53.033817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:53.033817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:53.033817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:53.033817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:53.033817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:53.033817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:53.033817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:53.033817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:53.034655 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:53.034655 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:53.034655 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:53.034655 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:53.034655 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:53.034655 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:53.034655 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:53.034655 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:53.034655 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:53.034655 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:53.034655 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:12:53.034655 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:12:53.034655 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 77/152] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:12:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:53.040525 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8b1f4-dab1-43bb-856b-95443edb770b None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:53.076705 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:53.196414 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d8b1f4-dab1-43bb-856b-95443edb770b None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:53.242422 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d40449-ee15-49d4-8fb5-ec4ca784dd37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:53.243101 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d40449-ee15-49d4-8fb5-ec4ca784dd37 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:53.243385 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d40449-ee15-49d4-8fb5-ec4ca784dd37 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:53.243690 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d40449-ee15-49d4-8fb5-ec4ca784dd37 None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:53.244442 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d40449-ee15-49d4-8fb5-ec4ca784dd37 None admin] RBAC: Adding query filter params (name=member) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:53.244750 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d40449-ee15-49d4-8fb5-ec4ca784dd37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:53.246139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d40449-ee15-49d4-8fb5-ec4ca784dd37 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:53.260026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 76/153] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:12:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:53.265511 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7633357-ee96-471b-9cc7-addadede22c5 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:53.403207 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7633357-ee96-471b-9cc7-addadede22c5 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:53.440075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45368855-5440-43de-ad38-5811ca73879a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:53.440997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45368855-5440-43de-ad38-5811ca73879a None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:53.441289 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45368855-5440-43de-ad38-5811ca73879a None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:53.441573 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45368855-5440-43de-ad38-5811ca73879a None admin] PATH_INFO: `/v3/users/f6600340cdd1454682f1b24e37dbb6fe` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:53.442884 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45368855-5440-43de-ad38-5811ca73879a None admin] RBAC: Authorizing `identity:get_user(user_id=f6600340cdd1454682f1b24e37dbb6fe)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:53.444469 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45368855-5440-43de-ad38-5811ca73879a None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:53.446413 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 78/154] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:12:53 2022] GET /identity/v3/users/f6600340cdd1454682f1b24e37dbb6fe => generated 275 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:53.451456 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d40449-ee15-49d4-8fb5-ec4ca784dd37 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:53.575779 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:53.602921 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d40449-ee15-49d4-8fb5-ec4ca784dd37 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:53.648314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fb6e7-67de-435d-a928-8ef3373beb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:53.649213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fb6e7-67de-435d-a928-8ef3373beb1e None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:53.649637 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fb6e7-67de-435d-a928-8ef3373beb1e None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:53.650076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3fb6e7-67de-435d-a928-8ef3373beb1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:53.658477 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc53ed-04fd-4e54-8574-40f46716a7b2 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:53.658832 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc53ed-04fd-4e54-8574-40f46716a7b2 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:53.659219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc53ed-04fd-4e54-8574-40f46716a7b2 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:53.661148 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 79/155] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:53.665783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9e6df-6f09-4583-8191-ac4cb11c4dde None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:53.666181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9e6df-6f09-4583-8191-ac4cb11c4dde None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:53.666570 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9e6df-6f09-4583-8191-ac4cb11c4dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:53.696633 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-bdf9e6df-6f09-4583-8191-ac4cb11c4dde None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:53.698163 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-bdf9e6df-6f09-4583-8191-ac4cb11c4dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:53.752122 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fb6e7-67de-435d-a928-8ef3373beb1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:53.753959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3fb6e7-67de-435d-a928-8ef3373beb1e None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:53.827969 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:53.831583 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 80/156] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:53.862643 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9e6df-6f09-4583-8191-ac4cb11c4dde None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:53.907054 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:53.937352 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 77/157] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:12:53.943361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fb6e7-67de-435d-a928-8ef3373beb1e None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:54.099859 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3fb6e7-67de-435d-a928-8ef3373beb1e None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:54.104508 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9e6df-6f09-4583-8191-ac4cb11c4dde None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:54.154271 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31c52a-774b-4323-babb-5a91ef9c1f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:54.155887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31c52a-774b-4323-babb-5a91ef9c1f88 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:54.156322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31c52a-774b-4323-babb-5a91ef9c1f88 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:54.156759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f31c52a-774b-4323-babb-5a91ef9c1f88 None admin] PATH_INFO: `/v3/projects/abf32515d23d467da80599bd06e99e29` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:54.158125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31c52a-774b-4323-babb-5a91ef9c1f88 None admin] RBAC: Authorizing `identity:get_project(project_id=abf32515d23d467da80599bd06e99e29)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:54.160893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f31c52a-774b-4323-babb-5a91ef9c1f88 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:54.163409 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 78/158] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:12:53 2022] GET /identity/v3/projects/abf32515d23d467da80599bd06e99e29 => generated 312 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:54.168911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31c52a-774b-4323-babb-5a91ef9c1f88 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:54.194824 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7dfba6-8f9c-4dc9-b5e7-54d60ee3430a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:54.195561 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dfba6-8f9c-4dc9-b5e7-54d60ee3430a None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:54.195869 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dfba6-8f9c-4dc9-b5e7-54d60ee3430a None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:54.196146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7dfba6-8f9c-4dc9-b5e7-54d60ee3430a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:54.232512 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7dfba6-8f9c-4dc9-b5e7-54d60ee3430a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:54.248373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-7d7dfba6-8f9c-4dc9-b5e7-54d60ee3430a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:12:54.248373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:54.248373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:54.248373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:54.248373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:54.248373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:54.248373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:54.248373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:54.248373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:54.248373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:54.248373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:54.248373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:54.248373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:54.248373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:54.248373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:54.248373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:54.249505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:54.249505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:54.249505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:54.249505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:54.249505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:54.249505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:54.249505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:54.249505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:54.249505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:54.249505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:54.249505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:54.249505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:54.249505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:54.249505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:54.249505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:54.249505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:54.250538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:54.250538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:54.250538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:54.250538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:54.250538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:54.250538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:54.250538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:54.250538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:54.250538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:54.250538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:54.250538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:12:54.250538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:12:54.250538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 81/159] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:12:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:54.252522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76008b86-5712-477c-9ccb-439627c509bd None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:54.252522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76008b86-5712-477c-9ccb-439627c509bd None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:54.252522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76008b86-5712-477c-9ccb-439627c509bd None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:54.259872 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 82/160] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:54 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:54.260651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76008b86-5712-477c-9ccb-439627c509bd None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:54.286095 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:54.372798 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:54.448101 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76008b86-5712-477c-9ccb-439627c509bd None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:54.468104 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f31c52a-774b-4323-babb-5a91ef9c1f88 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:54.493616 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798ed47b-9210-4d64-94c4-1abe886c29dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:54.494291 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ed47b-9210-4d64-94c4-1abe886c29dc None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:54.494575 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ed47b-9210-4d64-94c4-1abe886c29dc None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:54.494853 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798ed47b-9210-4d64-94c4-1abe886c29dc None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:54.495607 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ed47b-9210-4d64-94c4-1abe886c29dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:54.495936 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ed47b-9210-4d64-94c4-1abe886c29dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:54.497310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798ed47b-9210-4d64-94c4-1abe886c29dc None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:54.517353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 83/161] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:12:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:54.521553 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2e563-3a3a-46dd-8c27-7ef11d8a2789 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:54.521838 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2e563-3a3a-46dd-8c27-7ef11d8a2789 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:54.522118 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff2e563-3a3a-46dd-8c27-7ef11d8a2789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:54.537435 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b23ec0a-83df-418e-ad88-d865c5629cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:54.538093 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23ec0a-83df-418e-ad88-d865c5629cbf None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:54.540666 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23ec0a-83df-418e-ad88-d865c5629cbf None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:54.540954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b23ec0a-83df-418e-ad88-d865c5629cbf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:54.541812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23ec0a-83df-418e-ad88-d865c5629cbf None admin] RBAC: Adding query filter params (role.id=d6fedf23abb64cd494e8b49acefff423, scope.project.id=abf32515d23d467da80599bd06e99e29, user.id=f6600340cdd1454682f1b24e37dbb6fe) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:54.542095 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23ec0a-83df-418e-ad88-d865c5629cbf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:54.543547 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b23ec0a-83df-418e-ad88-d865c5629cbf None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:54.553944 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 79/162] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:54 2022] GET /identity/v3/role_assignments?user.id=f6600340cdd1454682f1b24e37dbb6fe&scope.project.id=abf32515d23d467da80599bd06e99e29&role.id=d6fedf23abb64cd494e8b49acefff423 => generated 608 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:54.554070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-7ff2e563-3a3a-46dd-8c27-7ef11d8a2789 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:54.555316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-7ff2e563-3a3a-46dd-8c27-7ef11d8a2789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:54.555816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e0292-1077-4ce4-aab3-d4f39488da78 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:54.556355 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e0292-1077-4ce4-aab3-d4f39488da78 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:54.556834 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057e0292-1077-4ce4-aab3-d4f39488da78 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:54.558349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 80/163] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:54.559321 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e0292-1077-4ce4-aab3-d4f39488da78 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:54.664334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 84/164] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:54.665766 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89b96c-6a61-40f7-beb7-16bfe36e33ea None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:54.666044 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89b96c-6a61-40f7-beb7-16bfe36e33ea None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:54.666321 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe89b96c-6a61-40f7-beb7-16bfe36e33ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:54.693512 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-fe89b96c-6a61-40f7-beb7-16bfe36e33ea None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:54.694693 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-fe89b96c-6a61-40f7-beb7-16bfe36e33ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:54.736490 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:54.777286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 85/165] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:54.778931 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89b96c-6a61-40f7-beb7-16bfe36e33ea None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:54.837302 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057e0292-1077-4ce4-aab3-d4f39488da78 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:54.866955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:54.899240 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe89b96c-6a61-40f7-beb7-16bfe36e33ea None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:54.929305 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac3c8e-639e-49c1-9418-7ce8ae2db013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:54.930206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac3c8e-639e-49c1-9418-7ce8ae2db013 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:54.930488 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac3c8e-639e-49c1-9418-7ce8ae2db013 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:54.930761 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ac3c8e-639e-49c1-9418-7ce8ae2db013 None admin] PATH_INFO: `/v3/users/2433e81c767e41c5ab341643cfd5a181` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:54.931999 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac3c8e-639e-49c1-9418-7ce8ae2db013 None admin] RBAC: Authorizing `identity:get_user(user_id=2433e81c767e41c5ab341643cfd5a181)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:54.933455 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ac3c8e-639e-49c1-9418-7ce8ae2db013 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:54.935193 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 81/166] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:12:54 2022] GET /identity/v3/users/2433e81c767e41c5ab341643cfd5a181 => generated 289 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:54.935972 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac3c8e-639e-49c1-9418-7ce8ae2db013 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:54.943959 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610a1ad-68f5-47be-b046-019ab38602e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:54.945054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610a1ad-68f5-47be-b046-019ab38602e6 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:54.945506 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610a1ad-68f5-47be-b046-019ab38602e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:54.946134 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f610a1ad-68f5-47be-b046-019ab38602e6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:54.967335 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f610a1ad-68f5-47be-b046-019ab38602e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:54.984388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-f610a1ad-68f5-47be-b046-019ab38602e6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:54.984388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:54.984388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:54.984388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:54.984388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:54.984388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:54.984388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:54.984388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:54.984388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:54.984388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:54.984388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:54.984388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:54.984388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:54.984388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:54.984388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:54.984388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:54.985276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:54.985276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:54.985276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:54.985276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:54.985276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:54.985276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:54.985276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:54.985276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:54.985276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:54.985276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:54.985276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:54.985276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:54.985276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:54.985276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:54.985276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:54.985276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:54.986266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:54.986266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:54.986266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:54.986266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:54.986266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:54.986266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:54.986266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:54.986266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:54.986266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:54.986266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:54.986266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:54.986266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:12:54.989725 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 86/167] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:12:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:54.992118 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610a1ad-68f5-47be-b046-019ab38602e6 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:55.060016 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:55.136143 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ac3c8e-639e-49c1-9418-7ce8ae2db013 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:55.199680 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f610a1ad-68f5-47be-b046-019ab38602e6 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:55.209212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cf443-8993-46fb-9fce-124c3ad24ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:55.210053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cf443-8993-46fb-9fce-124c3ad24ab0 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:55.210337 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cf443-8993-46fb-9fce-124c3ad24ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:55.210616 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42cf443-8993-46fb-9fce-124c3ad24ab0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:55.221328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42cf443-8993-46fb-9fce-124c3ad24ab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:55.238617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-c42cf443-8993-46fb-9fce-124c3ad24ab0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:12:55.238617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:55.238617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:55.238617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:55.238617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:55.238617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:55.238617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:55.238617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:55.238617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:55.238617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:55.238617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:55.238617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:55.238617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:55.238617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:55.238617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:55.238617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:55.239585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:55.239585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:55.239585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:55.239585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:55.239585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:55.239585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:55.239585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:55.239585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:55.239585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:55.239585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:55.239585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:55.239585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:55.239585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:55.239585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:55.239585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:55.239585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:55.240453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:55.240453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:55.240453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:55.240453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:55.240453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:55.240453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:55.240453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:55.240453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:55.240453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:55.240453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:55.240453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:12:55.240453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:12:55.240453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 82/168] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 00:12:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:55.241108 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cf443-8993-46fb-9fce-124c3ad24ab0 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:55.246993 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f312f-dcfd-41af-ac20-df1763bac0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:55.247902 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f312f-dcfd-41af-ac20-df1763bac0cf None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:55.248173 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f312f-dcfd-41af-ac20-df1763bac0cf None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:55.248445 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789f312f-dcfd-41af-ac20-df1763bac0cf None admin] PATH_INFO: `/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:55.249690 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f312f-dcfd-41af-ac20-df1763bac0cf None admin] RBAC: Authorizing `identity:get_project(project_id=b5d7f8028eb1486d8dbc58cd5d98a225)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:55.251156 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789f312f-dcfd-41af-ac20-df1763bac0cf None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:55.252881 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 87/169] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:12:54 2022] GET /identity/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:55.255590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f312f-dcfd-41af-ac20-df1763bac0cf None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:55.309124 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:55.377910 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42cf443-8993-46fb-9fce-124c3ad24ab0 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:55.444048 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:55.448260 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789f312f-dcfd-41af-ac20-df1763bac0cf None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:55.489262 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56ad66-84bb-42de-a2f4-cc641720f3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:55.490074 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56ad66-84bb-42de-a2f4-cc641720f3ae None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:55.490367 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56ad66-84bb-42de-a2f4-cc641720f3ae None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:55.490697 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56ad66-84bb-42de-a2f4-cc641720f3ae None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:55.491472 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac137cc-13f6-4b79-88eb-b6d1c897309e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:55.491695 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56ad66-84bb-42de-a2f4-cc641720f3ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:55.491852 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56ad66-84bb-42de-a2f4-cc641720f3ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:55.492186 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac137cc-13f6-4b79-88eb-b6d1c897309e None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:55.492470 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac137cc-13f6-4b79-88eb-b6d1c897309e None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:55.492747 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac137cc-13f6-4b79-88eb-b6d1c897309e None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:55.493275 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56ad66-84bb-42de-a2f4-cc641720f3ae None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:55.493512 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac137cc-13f6-4b79-88eb-b6d1c897309e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:55.493829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac137cc-13f6-4b79-88eb-b6d1c897309e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:55.495375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac137cc-13f6-4b79-88eb-b6d1c897309e None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:55.505663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 88/170] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:55.506644 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac137cc-13f6-4b79-88eb-b6d1c897309e None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:55.514275 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 83/171] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:12:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:55.515232 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56ad66-84bb-42de-a2f4-cc641720f3ae None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:55.620345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac137cc-13f6-4b79-88eb-b6d1c897309e None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:55.637243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56ad66-84bb-42de-a2f4-cc641720f3ae None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:55.638761 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:55.654706 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc3767-7f67-4e4d-aeb9-861db2c421a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:55.655589 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc3767-7f67-4e4d-aeb9-861db2c421a8 None admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:55.655907 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc3767-7f67-4e4d-aeb9-861db2c421a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:55.656180 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc3767-7f67-4e4d-aeb9-861db2c421a8 None admin] PATH_INFO: `/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225/users/2433e81c767e41c5ab341643cfd5a181/roles/d80b3a9c2e6e45739aa3056330bc9ad8` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:55.658135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc3767-7f67-4e4d-aeb9-861db2c421a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5d7f8028eb1486d8dbc58cd5d98a225, user_id=2433e81c767e41c5ab341643cfd5a181, role_id=d80b3a9c2e6e45739aa3056330bc9ad8)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:55.659580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc3767-7f67-4e4d-aeb9-861db2c421a8 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:55.671926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 89/172] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 00:12:55 2022] PUT /identity/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225/users/2433e81c767e41c5ab341643cfd5a181/roles/d80b3a9c2e6e45739aa3056330bc9ad8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:12:55.672891 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc3767-7f67-4e4d-aeb9-861db2c421a8 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:55.678830 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fb6cf8-fc9f-4bfd-b7fa-e66e4c570e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:55.679773 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb6cf8-fc9f-4bfd-b7fa-e66e4c570e7e None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:55.680058 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb6cf8-fc9f-4bfd-b7fa-e66e4c570e7e None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:55.680333 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fb6cf8-fc9f-4bfd-b7fa-e66e4c570e7e None admin] PATH_INFO: `/v3/users/f6600340cdd1454682f1b24e37dbb6fe` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:55.681689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb6cf8-fc9f-4bfd-b7fa-e66e4c570e7e None admin] RBAC: Authorizing `identity:get_user(user_id=f6600340cdd1454682f1b24e37dbb6fe)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:55.683230 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fb6cf8-fc9f-4bfd-b7fa-e66e4c570e7e None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:55.687668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 84/173] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:12:55 2022] GET /identity/v3/users/f6600340cdd1454682f1b24e37dbb6fe => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:55.687668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee37ae-4c53-418c-9758-6b5912972d99 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:55.687668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee37ae-4c53-418c-9758-6b5912972d99 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:55.687668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ee37ae-4c53-418c-9758-6b5912972d99 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:55.688828 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 85/174] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:55.690177 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95614d3-45fc-43d6-a949-d90e49b848c2 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:55.690464 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95614d3-45fc-43d6-a949-d90e49b848c2 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:55.690744 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95614d3-45fc-43d6-a949-d90e49b848c2 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:55.692190 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 86/175] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:55.696368 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac3974-0870-4b47-bd9d-f1ac98a4852f None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:55.696368 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac3974-0870-4b47-bd9d-f1ac98a4852f None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:55.696368 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ac3974-0870-4b47-bd9d-f1ac98a4852f None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:55.696368 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 87/176] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:55.696876 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9f3ca-9d7e-4b4e-9c61-e809a5b36fa6 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:55.697165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9f3ca-9d7e-4b4e-9c61-e809a5b36fa6 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:55.697616 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c9f3ca-9d7e-4b4e-9c61-e809a5b36fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:55.711331 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:55.716137 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-14c9f3ca-9d7e-4b4e-9c61-e809a5b36fa6 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:55.717348 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-14c9f3ca-9d7e-4b4e-9c61-e809a5b36fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:55.794875 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 88/177] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:55.798092 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9f3ca-9d7e-4b4e-9c61-e809a5b36fa6 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:55.822996 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc3767-7f67-4e4d-aeb9-861db2c421a8 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:55.865717 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b6fb83-5aec-4965-9e2d-710b76a830be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:55.866868 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6fb83-5aec-4965-9e2d-710b76a830be None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:55.867152 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6fb83-5aec-4965-9e2d-710b76a830be None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:55.867425 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b6fb83-5aec-4965-9e2d-710b76a830be None admin] PATH_INFO: `/v3/users/5827dca4e6e6440096187e88acac47af` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:55.868653 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6fb83-5aec-4965-9e2d-710b76a830be None admin] RBAC: Authorizing `identity:get_user(user_id=5827dca4e6e6440096187e88acac47af)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:55.870105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b6fb83-5aec-4965-9e2d-710b76a830be None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:55.871922 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 90/178] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:12:55 2022] GET /identity/v3/users/5827dca4e6e6440096187e88acac47af => generated 247 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:55.873018 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ae106-cf78-4a81-b0a8-5fdb7e3063b1 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:55.873308 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ae106-cf78-4a81-b0a8-5fdb7e3063b1 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:55.873587 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ae106-cf78-4a81-b0a8-5fdb7e3063b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:55.890016 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-ff6ae106-cf78-4a81-b0a8-5fdb7e3063b1 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:55.891596 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-ff6ae106-cf78-4a81-b0a8-5fdb7e3063b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:55.915209 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:55.918797 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c9f3ca-9d7e-4b4e-9c61-e809a5b36fa6 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:55.956101 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55bdf3-49f1-452a-8873-f46fa341865d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:55.957344 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55bdf3-49f1-452a-8873-f46fa341865d None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:55.957728 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55bdf3-49f1-452a-8873-f46fa341865d None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:55.958114 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de55bdf3-49f1-452a-8873-f46fa341865d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:55.966041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 91/179] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:55.966041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd55334-0478-4f6f-8e64-75266a7134e9 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:55.966041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd55334-0478-4f6f-8e64-75266a7134e9 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:55.966041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd55334-0478-4f6f-8e64-75266a7134e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:55.978690 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-ebd55334-0478-4f6f-8e64-75266a7134e9 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:55.979974 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-ebd55334-0478-4f6f-8e64-75266a7134e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:55.995583 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:56.042406 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55bdf3-49f1-452a-8873-f46fa341865d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:56.044039 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de55bdf3-49f1-452a-8873-f46fa341865d None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:56.052692 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 92/180] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:56.060474 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd55334-0478-4f6f-8e64-75266a7134e9 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:56.147975 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:56.156417 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 89/181] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:12:56.157286 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55bdf3-49f1-452a-8873-f46fa341865d None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:56.173778 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd55334-0478-4f6f-8e64-75266a7134e9 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:56.210742 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263fb0d-4a70-44b4-85da-1d0a37961369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:56.211835 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263fb0d-4a70-44b4-85da-1d0a37961369 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:56.212295 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263fb0d-4a70-44b4-85da-1d0a37961369 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:56.212716 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6263fb0d-4a70-44b4-85da-1d0a37961369 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:56.228097 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6263fb0d-4a70-44b4-85da-1d0a37961369 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:56.237331 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-6263fb0d-4a70-44b4-85da-1d0a37961369 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:56.237331 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:56.237331 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:56.237331 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:56.237331 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:56.237331 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:56.237331 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:56.237331 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:56.237331 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:56.237331 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:56.237331 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:56.237331 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:56.237331 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:56.237331 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:56.237331 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:56.237331 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:56.238310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:56.238310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:56.238310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:56.238310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:56.238310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:56.238310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:56.238310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:56.238310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:56.238310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:56.238310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:56.238310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:56.238310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:56.238310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:56.238310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:56.238310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:56.238310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:56.239087 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:56.239087 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:56.239087 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:56.239087 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:56.239087 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:56.239087 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:56.239087 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:56.239087 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:56.239087 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:56.239087 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:56.239087 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:12:56.239087 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:12:56.239087 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 93/182] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:12:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:56.239757 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263fb0d-4a70-44b4-85da-1d0a37961369 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:56.252245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:56.268203 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de55bdf3-49f1-452a-8873-f46fa341865d None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:56.305011 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176d96a-94fe-419e-83d3-f0585ea6c5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:56.305582 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176d96a-94fe-419e-83d3-f0585ea6c5cc None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:56.305864 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176d96a-94fe-419e-83d3-f0585ea6c5cc None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:56.306136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2176d96a-94fe-419e-83d3-f0585ea6c5cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:56.342540 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6263fb0d-4a70-44b4-85da-1d0a37961369 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:56.377176 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:56.377380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfadb6-2c9d-41f6-aa33-6b0fdbba198a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:56.378201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfadb6-2c9d-41f6-aa33-6b0fdbba198a None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:56.379273 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfadb6-2c9d-41f6-aa33-6b0fdbba198a None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:56.379552 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfadb6-2c9d-41f6-aa33-6b0fdbba198a None admin] PATH_INFO: `/v3/domains/default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:56.380797 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176d96a-94fe-419e-83d3-f0585ea6c5cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:56.381278 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfadb6-2c9d-41f6-aa33-6b0fdbba198a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:56.382502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2176d96a-94fe-419e-83d3-f0585ea6c5cc None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:56.382740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11bfadb6-2c9d-41f6-aa33-6b0fdbba198a None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:56.384395 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 94/183] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:12:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:56.385150 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfadb6-2c9d-41f6-aa33-6b0fdbba198a None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:56.470148 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:56.492680 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 90/184] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:12:56.493528 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176d96a-94fe-419e-83d3-f0585ea6c5cc None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:56.494262 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfadb6-2c9d-41f6-aa33-6b0fdbba198a None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:56.533652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd70fd-100e-4807-9eca-73b1497a3128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:56.534489 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd70fd-100e-4807-9eca-73b1497a3128 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:56.535328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd70fd-100e-4807-9eca-73b1497a3128 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:56.535632 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdd70fd-100e-4807-9eca-73b1497a3128 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:56.546225 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdd70fd-100e-4807-9eca-73b1497a3128 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:56.554301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-7cdd70fd-100e-4807-9eca-73b1497a3128 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:12:56.554301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:56.554301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:56.554301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:56.554301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:56.554301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:56.554301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:56.554301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:56.554301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:56.554301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:56.554301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:56.554301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:56.554301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:56.554301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:56.554301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:56.554301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:56.555193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:56.555193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:56.555193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:56.555193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:56.555193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:56.555193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:56.555193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:56.555193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:56.555193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:56.555193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:56.555193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:56.555193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:56.555193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:56.555193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:56.555193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:56.555193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:56.556056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:56.556056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:56.556056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:56.556056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:56.556056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:56.556056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:56.556056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:56.556056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:56.556056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:56.556056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:56.556056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:12:56.556056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:12:56.556056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 95/185] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 00:12:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:56.556699 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd70fd-100e-4807-9eca-73b1497a3128 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:56.599456 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:56.602558 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2176d96a-94fe-419e-83d3-f0585ea6c5cc None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:56.638170 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d793ee9-7c6f-45b8-8d94-eb3cbaab8b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:56.639059 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d793ee9-7c6f-45b8-8d94-eb3cbaab8b9b None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:56.639483 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d793ee9-7c6f-45b8-8d94-eb3cbaab8b9b None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:56.639701 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d793ee9-7c6f-45b8-8d94-eb3cbaab8b9b None admin] PATH_INFO: `/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:56.640933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d793ee9-7c6f-45b8-8d94-eb3cbaab8b9b None admin] RBAC: Authorizing `identity:get_project(project_id=b5d7f8028eb1486d8dbc58cd5d98a225)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:56.642392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d793ee9-7c6f-45b8-8d94-eb3cbaab8b9b None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:56.644821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 91/186] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:12:56 2022] GET /identity/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225 => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:56.650185 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d793ee9-7c6f-45b8-8d94-eb3cbaab8b9b None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:56.663271 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdd70fd-100e-4807-9eca-73b1497a3128 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:56.698301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579745b-dc52-452a-980d-6abd925acce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:56.698981 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579745b-dc52-452a-980d-6abd925acce8 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:56.699275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579745b-dc52-452a-980d-6abd925acce8 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:56.699561 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f579745b-dc52-452a-980d-6abd925acce8 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:56.700354 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579745b-dc52-452a-980d-6abd925acce8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:56.700670 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579745b-dc52-452a-980d-6abd925acce8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:56.702070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f579745b-dc52-452a-980d-6abd925acce8 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:56.707774 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:56.716313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 96/187] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:12:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:56.717338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579745b-dc52-452a-980d-6abd925acce8 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:56.766337 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d793ee9-7c6f-45b8-8d94-eb3cbaab8b9b None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:56.806758 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbb5a3-638a-402c-900d-162e918d5c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:56.807607 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbb5a3-638a-402c-900d-162e918d5c00 None admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:56.808053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbb5a3-638a-402c-900d-162e918d5c00 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:56.808465 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bbb5a3-638a-402c-900d-162e918d5c00 None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:56.809315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bbb5a3-638a-402c-900d-162e918d5c00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:56.810911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bbb5a3-638a-402c-900d-162e918d5c00 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:56.828818 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f579745b-dc52-452a-980d-6abd925acce8 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:56.833169 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 92/188] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 00:12:56 2022] POST /identity/v3/users => generated 297 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:12:56.841774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbb5a3-638a-402c-900d-162e918d5c00 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:56.874052 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcc1c7-63e2-4456-ad4b-cec394a11a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:56.875006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcc1c7-63e2-4456-ad4b-cec394a11a79 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:56.875348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcc1c7-63e2-4456-ad4b-cec394a11a79 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:56.875655 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadcc1c7-63e2-4456-ad4b-cec394a11a79 None admin] PATH_INFO: `/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:56.877597 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadcc1c7-63e2-4456-ad4b-cec394a11a79 None admin] RBAC: Authorizing `identity:get_project(project_id=b5d7f8028eb1486d8dbc58cd5d98a225)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:56.879761 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadcc1c7-63e2-4456-ad4b-cec394a11a79 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:56.881851 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 97/189] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:12:56 2022] GET /identity/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:56.882949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:56.883908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcc1c7-63e2-4456-ad4b-cec394a11a79 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:56.986138 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:56.999082 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bbb5a3-638a-402c-900d-162e918d5c00 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:57.033018 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadcc1c7-63e2-4456-ad4b-cec394a11a79 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:57.045287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ffeb7-0ab2-4322-bdd1-96a00c59d862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:57.045978 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ffeb7-0ab2-4322-bdd1-96a00c59d862 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:57.046269 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ffeb7-0ab2-4322-bdd1-96a00c59d862 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:57.046548 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ffeb7-0ab2-4322-bdd1-96a00c59d862 None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:57.048432 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ffeb7-0ab2-4322-bdd1-96a00c59d862 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:57.048432 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ffeb7-0ab2-4322-bdd1-96a00c59d862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:57.050255 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492ffeb7-0ab2-4322-bdd1-96a00c59d862 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:57.065050 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 93/190] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:12:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:57.066586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ffeb7-0ab2-4322-bdd1-96a00c59d862 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:57.076158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8bdb5-57c6-4a1a-87c2-1bffe49288a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:57.077139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8bdb5-57c6-4a1a-87c2-1bffe49288a6 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:57.077619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8bdb5-57c6-4a1a-87c2-1bffe49288a6 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:57.078135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be8bdb5-57c6-4a1a-87c2-1bffe49288a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:57.079212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8bdb5-57c6-4a1a-87c2-1bffe49288a6 None admin] RBAC: Adding query filter params (role.id=e6bcb832ed6d4843825263e23d8fb208, scope.project.id=b5d7f8028eb1486d8dbc58cd5d98a225, user.id=f6600340cdd1454682f1b24e37dbb6fe) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:57.079832 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8bdb5-57c6-4a1a-87c2-1bffe49288a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:57.081516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be8bdb5-57c6-4a1a-87c2-1bffe49288a6 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:57.088570 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 98/191] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:56 2022] GET /identity/v3/role_assignments?user.id=f6600340cdd1454682f1b24e37dbb6fe&scope.project.id=b5d7f8028eb1486d8dbc58cd5d98a225&role.id=e6bcb832ed6d4843825263e23d8fb208 => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:57.089651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8bdb5-57c6-4a1a-87c2-1bffe49288a6 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:57.200008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:57.226932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ffeb7-0ab2-4322-bdd1-96a00c59d862 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:57.235902 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be8bdb5-57c6-4a1a-87c2-1bffe49288a6 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:57.270186 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:57.274048 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b55d13-aca2-40d3-8f2e-ddc9e3f9df97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:57.275290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b55d13-aca2-40d3-8f2e-ddc9e3f9df97 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:57.275893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b55d13-aca2-40d3-8f2e-ddc9e3f9df97 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:57.276752 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b55d13-aca2-40d3-8f2e-ddc9e3f9df97 None admin] PATH_INFO: `/v3/users/18620b4519634d9385ad68899125c2c2` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:57.277518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cfc08-f51c-4dc6-bebb-a2c8c5077470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:57.278552 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cfc08-f51c-4dc6-bebb-a2c8c5077470 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:57.278944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cfc08-f51c-4dc6-bebb-a2c8c5077470 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:57.279328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cfc08-f51c-4dc6-bebb-a2c8c5077470 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:57.280357 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cfc08-f51c-4dc6-bebb-a2c8c5077470 None admin] RBAC: Adding query filter params (role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab, scope.project.id=b5d7f8028eb1486d8dbc58cd5d98a225, user.id=5827dca4e6e6440096187e88acac47af) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:57.280781 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cfc08-f51c-4dc6-bebb-a2c8c5077470 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:57.282503 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0cfc08-f51c-4dc6-bebb-a2c8c5077470 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:57.290107 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 99/192] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:57 2022] GET /identity/v3/role_assignments?user.id=5827dca4e6e6440096187e88acac47af&scope.project.id=b5d7f8028eb1486d8dbc58cd5d98a225&role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:57.291078 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cfc08-f51c-4dc6-bebb-a2c8c5077470 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:57.296831 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b55d13-aca2-40d3-8f2e-ddc9e3f9df97 None admin] RBAC: Authorizing `identity:get_user(user_id=18620b4519634d9385ad68899125c2c2)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:57.299546 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b55d13-aca2-40d3-8f2e-ddc9e3f9df97 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:57.304871 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 94/193] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:12:57 2022] GET /identity/v3/users/18620b4519634d9385ad68899125c2c2 => generated 283 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:57.308819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b55d13-aca2-40d3-8f2e-ddc9e3f9df97 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:57.412610 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0cfc08-f51c-4dc6-bebb-a2c8c5077470 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:57.426770 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b55d13-aca2-40d3-8f2e-ddc9e3f9df97 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:57.453207 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e46f3-e13c-4423-96d7-434ae17a8e00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:57.454212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e46f3-e13c-4423-96d7-434ae17a8e00 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:57.454575 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e46f3-e13c-4423-96d7-434ae17a8e00 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:57.454948 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467e46f3-e13c-4423-96d7-434ae17a8e00 None admin] PATH_INFO: `/v3/users/18620b4519634d9385ad68899125c2c2` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:57.456441 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e46f3-e13c-4423-96d7-434ae17a8e00 None admin] RBAC: Authorizing `identity:get_user(user_id=18620b4519634d9385ad68899125c2c2)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:57.458596 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467e46f3-e13c-4423-96d7-434ae17a8e00 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:57.460530 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 100/194] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:12:57 2022] GET /identity/v3/users/18620b4519634d9385ad68899125c2c2 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:57.466001 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e46f3-e13c-4423-96d7-434ae17a8e00 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:57.469009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4ad7a-b6c4-471f-ae02-3534083300bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:57.470009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4ad7a-b6c4-471f-ae02-3534083300bc None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:57.470466 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4ad7a-b6c4-471f-ae02-3534083300bc None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:57.471033 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e4ad7a-b6c4-471f-ae02-3534083300bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:57.488572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:57.546596 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:57.556229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4ad7a-b6c4-471f-ae02-3534083300bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:57.558071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e4ad7a-b6c4-471f-ae02-3534083300bc None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:57.591389 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467e46f3-e13c-4423-96d7-434ae17a8e00 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:57.630058 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1442f-c118-4f27-8816-794f0f32bef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:57.630812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1442f-c118-4f27-8816-794f0f32bef9 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:57.631035 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1442f-c118-4f27-8816-794f0f32bef9 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:57.631315 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c1442f-c118-4f27-8816-794f0f32bef9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:57.688306 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 95/195] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:12:57.694933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4ad7a-b6c4-471f-ae02-3534083300bc None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:57.705381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1442f-c118-4f27-8816-794f0f32bef9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:57.706918 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c1442f-c118-4f27-8816-794f0f32bef9 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:57.746282 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:57.773168 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:57.813685 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e4ad7a-b6c4-471f-ae02-3534083300bc None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:57.817134 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 101/196] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:12:57.822541 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1442f-c118-4f27-8816-794f0f32bef9 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:57.853880 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456142a4-d64c-46f7-add3-69aae3e102c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:57.855161 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456142a4-d64c-46f7-add3-69aae3e102c5 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:57.855673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456142a4-d64c-46f7-add3-69aae3e102c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:57.856139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456142a4-d64c-46f7-add3-69aae3e102c5 None admin] PATH_INFO: `/v3/projects/27e0d304f3c644b2b8db92d18a19d41a` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:57.857652 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456142a4-d64c-46f7-add3-69aae3e102c5 None admin] RBAC: Authorizing `identity:get_project(project_id=27e0d304f3c644b2b8db92d18a19d41a)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:57.859426 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456142a4-d64c-46f7-add3-69aae3e102c5 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:57.861363 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 96/197] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:12:57 2022] GET /identity/v3/projects/27e0d304f3c644b2b8db92d18a19d41a => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:57.869307 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456142a4-d64c-46f7-add3-69aae3e102c5 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:57.928623 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c1442f-c118-4f27-8816-794f0f32bef9 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:57.964418 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7ce9b-431c-4da4-ae3d-667216218b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:57.965240 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7ce9b-431c-4da4-ae3d-667216218b67 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:57.965598 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7ce9b-431c-4da4-ae3d-667216218b67 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:57.965869 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7ce9b-431c-4da4-ae3d-667216218b67 None admin] PATH_INFO: `/v3/projects/27e0d304f3c644b2b8db92d18a19d41a` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:57.967132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7ce9b-431c-4da4-ae3d-667216218b67 None admin] RBAC: Authorizing `identity:get_project(project_id=27e0d304f3c644b2b8db92d18a19d41a)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:57.968689 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7ce9b-431c-4da4-ae3d-667216218b67 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:57.970697 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 102/198] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:12:57 2022] GET /identity/v3/projects/27e0d304f3c644b2b8db92d18a19d41a => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:57.976811 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7ce9b-431c-4da4-ae3d-667216218b67 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:57.984031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456142a4-d64c-46f7-add3-69aae3e102c5 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:58.000310 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:58.011852 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:58.027342 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da06b2c-1970-4efd-8e35-b5476b3c9bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:58.028379 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da06b2c-1970-4efd-8e35-b5476b3c9bc3 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:58.028949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da06b2c-1970-4efd-8e35-b5476b3c9bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:58.029419 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da06b2c-1970-4efd-8e35-b5476b3c9bc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:58.030545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da06b2c-1970-4efd-8e35-b5476b3c9bc3 None admin] RBAC: Adding query filter params (role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab, scope.project.id=27e0d304f3c644b2b8db92d18a19d41a, user.id=18620b4519634d9385ad68899125c2c2) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:58.031099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da06b2c-1970-4efd-8e35-b5476b3c9bc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:58.032917 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da06b2c-1970-4efd-8e35-b5476b3c9bc3 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:58.040285 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 97/199] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:57 2022] GET /identity/v3/role_assignments?user.id=18620b4519634d9385ad68899125c2c2&scope.project.id=27e0d304f3c644b2b8db92d18a19d41a&role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:58.094599 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7ce9b-431c-4da4-ae3d-667216218b67 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:58.135438 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aeaa02-e329-4aff-859e-ab3b63da72ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:58.136157 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aeaa02-e329-4aff-859e-ab3b63da72ea None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:58.136541 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aeaa02-e329-4aff-859e-ab3b63da72ea None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:58.136828 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aeaa02-e329-4aff-859e-ab3b63da72ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:58.137695 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aeaa02-e329-4aff-859e-ab3b63da72ea None admin] RBAC: Adding query filter params (role.id=e6bcb832ed6d4843825263e23d8fb208, scope.project.id=27e0d304f3c644b2b8db92d18a19d41a, user.id=18620b4519634d9385ad68899125c2c2) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:58.138015 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aeaa02-e329-4aff-859e-ab3b63da72ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:58.139524 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aeaa02-e329-4aff-859e-ab3b63da72ea None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:58.147067 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 103/200] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:57 2022] GET /identity/v3/role_assignments?user.id=18620b4519634d9385ad68899125c2c2&scope.project.id=27e0d304f3c644b2b8db92d18a19d41a&role.id=e6bcb832ed6d4843825263e23d8fb208 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:12:58.197820 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0476a-7180-4634-98f9-3e2898dba65b None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:58.198654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0476a-7180-4634-98f9-3e2898dba65b None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:58.199242 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b0476a-7180-4634-98f9-3e2898dba65b None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:58.201392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 98/201] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:58.213528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca507b9c-a2f0-4d8e-a286-4db06744d053 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:58.213829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca507b9c-a2f0-4d8e-a286-4db06744d053 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:58.214143 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca507b9c-a2f0-4d8e-a286-4db06744d053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:58.236207 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-ca507b9c-a2f0-4d8e-a286-4db06744d053 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:58.237487 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-ca507b9c-a2f0-4d8e-a286-4db06744d053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:58.317971 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 104/202] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:12:58.348224 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0476a-7180-4634-98f9-3e2898dba65b None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:58.458815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b0476a-7180-4634-98f9-3e2898dba65b None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:58.494939 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a326857-1a6a-4cde-87fd-498d121e0b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:58.496107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a326857-1a6a-4cde-87fd-498d121e0b5a None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:58.496586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a326857-1a6a-4cde-87fd-498d121e0b5a None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:58.497061 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a326857-1a6a-4cde-87fd-498d121e0b5a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:58.509070 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a326857-1a6a-4cde-87fd-498d121e0b5a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:12:58.517031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-7a326857-1a6a-4cde-87fd-498d121e0b5a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:12:58.517031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:12:58.517031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:12:58.517031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:12:58.517031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:12:58.517031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:12:58.517031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:12:58.517031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:12:58.517031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:12:58.517031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:12:58.517031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:12:58.517031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:12:58.517031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:12:58.517031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:12:58.517031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:12:58.517031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:12:58.517879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:12:58.517879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:12:58.517879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:12:58.517879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:12:58.517879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:12:58.517879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:12:58.517879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:12:58.517879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:12:58.517879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:12:58.517879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:12:58.517879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:12:58.517879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:12:58.517879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:12:58.517879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:12:58.517879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:12:58.517879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:12:58.518658 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:12:58.518658 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:12:58.518658 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:12:58.518658 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:12:58.518658 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:12:58.518658 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:12:58.518658 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:12:58.518658 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:12:58.518658 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:12:58.518658 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:12:58.518658 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:12:58.518658 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:12:58.521930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 99/203] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:12:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:12:58.527646 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca507b9c-a2f0-4d8e-a286-4db06744d053 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:58.577301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:58.688404 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca507b9c-a2f0-4d8e-a286-4db06744d053 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:58.737663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c9398-ea5b-4f48-af67-bb20d2271cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:58.738418 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c9398-ea5b-4f48-af67-bb20d2271cad None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:58.738701 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c9398-ea5b-4f48-af67-bb20d2271cad None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:58.738975 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0c9398-ea5b-4f48-af67-bb20d2271cad None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:58.739757 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c9398-ea5b-4f48-af67-bb20d2271cad None admin] RBAC: Adding query filter params (name=reader) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:58.740069 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c9398-ea5b-4f48-af67-bb20d2271cad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:58.741443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0c9398-ea5b-4f48-af67-bb20d2271cad None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:58.756291 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 105/204] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:12:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:58.761698 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a326857-1a6a-4cde-87fd-498d121e0b5a None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:58.820136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:58.906901 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a326857-1a6a-4cde-87fd-498d121e0b5a None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:58.943749 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a7c9c-b2e9-4285-8480-6c286601ca4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:58.944698 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a7c9c-b2e9-4285-8480-6c286601ca4f None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:58.944993 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a7c9c-b2e9-4285-8480-6c286601ca4f None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:58.945280 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66a7c9c-b2e9-4285-8480-6c286601ca4f None admin] PATH_INFO: `/v3/users/2433e81c767e41c5ab341643cfd5a181` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:58.946491 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a7c9c-b2e9-4285-8480-6c286601ca4f None admin] RBAC: Authorizing `identity:get_user(user_id=2433e81c767e41c5ab341643cfd5a181)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:58.947999 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66a7c9c-b2e9-4285-8480-6c286601ca4f None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:58.949635 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 100/205] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:12:58 2022] GET /identity/v3/users/2433e81c767e41c5ab341643cfd5a181 => generated 289 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:58.955137 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c9398-ea5b-4f48-af67-bb20d2271cad None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:59.093052 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:59.108820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0c9398-ea5b-4f48-af67-bb20d2271cad None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:59.156023 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf7dc6-8cf8-4bd1-afc6-d14be4f8548c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:59.157085 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf7dc6-8cf8-4bd1-afc6-d14be4f8548c None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:59.157579 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf7dc6-8cf8-4bd1-afc6-d14be4f8548c None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:59.158079 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf7dc6-8cf8-4bd1-afc6-d14be4f8548c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:59.251226 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf7dc6-8cf8-4bd1-afc6-d14be4f8548c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:59.253092 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf7dc6-8cf8-4bd1-afc6-d14be4f8548c None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:59.356614 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:59.374670 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 106/206] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:12:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:12:59.380180 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a7c9c-b2e9-4285-8480-6c286601ca4f None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:59.488157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66a7c9c-b2e9-4285-8480-6c286601ca4f None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:59.490542 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:59.525523 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20f010-c03b-45fa-a9a7-adadaafe033a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:59.526443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20f010-c03b-45fa-a9a7-adadaafe033a None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:59.526733 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20f010-c03b-45fa-a9a7-adadaafe033a None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:59.527021 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20f010-c03b-45fa-a9a7-adadaafe033a None admin] PATH_INFO: `/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:59.528337 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c20f010-c03b-45fa-a9a7-adadaafe033a None admin] RBAC: Authorizing `identity:get_project(project_id=b5d7f8028eb1486d8dbc58cd5d98a225)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:59.529873 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c20f010-c03b-45fa-a9a7-adadaafe033a None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:59.531968 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 101/207] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:12:59 2022] GET /identity/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:59.540703 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf7dc6-8cf8-4bd1-afc6-d14be4f8548c None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:12:59.677403 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf7dc6-8cf8-4bd1-afc6-d14be4f8548c None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:12:59.731135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffb7df6-4e57-4fff-a7fb-6817931017f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:12:59.731838 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb7df6-4e57-4fff-a7fb-6817931017f1 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:59.732130 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb7df6-4e57-4fff-a7fb-6817931017f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:59.732414 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffb7df6-4e57-4fff-a7fb-6817931017f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:59.733261 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb7df6-4e57-4fff-a7fb-6817931017f1 None admin] RBAC: Adding query filter params (role.id=d80b3a9c2e6e45739aa3056330bc9ad8, scope.project.id=b5d7f8028eb1486d8dbc58cd5d98a225, user.id=2433e81c767e41c5ab341643cfd5a181) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:12:59.733582 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb7df6-4e57-4fff-a7fb-6817931017f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:12:59.735033 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffb7df6-4e57-4fff-a7fb-6817931017f1 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:12:59.744459 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 107/208] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:12:59 2022] GET /identity/v3/role_assignments?user.id=2433e81c767e41c5ab341643cfd5a181&scope.project.id=b5d7f8028eb1486d8dbc58cd5d98a225&role.id=d80b3a9c2e6e45739aa3056330bc9ad8 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:12:59.877167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5949b2-ceee-4c7d-871f-a9dbdebb532d None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:59.877822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5949b2-ceee-4c7d-871f-a9dbdebb532d None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:59.878379 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5949b2-ceee-4c7d-871f-a9dbdebb532d None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:59.880526 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 102/209] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:12:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:12:59.886104 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df98e7-84cf-40b7-914d-6158fb80dc07 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:12:59.886701 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df98e7-84cf-40b7-914d-6158fb80dc07 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:12:59.887210 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11df98e7-84cf-40b7-914d-6158fb80dc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:12:59.905782 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-11df98e7-84cf-40b7-914d-6158fb80dc07 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:12:59.907334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-11df98e7-84cf-40b7-914d-6158fb80dc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:12:59.967643 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:12:59.999840 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 108/210] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:12:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:00.031501 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5949b2-ceee-4c7d-871f-a9dbdebb532d None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:00.145157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5949b2-ceee-4c7d-871f-a9dbdebb532d None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:00.181100 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954615c6-f2fb-40c9-a57f-ac8be316907d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:00.182235 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954615c6-f2fb-40c9-a57f-ac8be316907d None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:00.182723 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954615c6-f2fb-40c9-a57f-ac8be316907d None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:00.183218 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954615c6-f2fb-40c9-a57f-ac8be316907d None admin] PATH_INFO: `/v3/roles/member` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:00.194686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954615c6-f2fb-40c9-a57f-ac8be316907d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:00.203001 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-954615c6-f2fb-40c9-a57f-ac8be316907d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:00.203001 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:00.203001 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:00.203001 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:00.203001 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:00.203001 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:00.203001 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:00.203001 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:00.203001 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:00.203001 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:00.203001 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:00.203001 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:00.203001 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:00.203001 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:00.203001 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:00.203001 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:00.203948 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:00.203948 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:00.203948 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:00.203948 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:00.203948 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:00.203948 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:00.203948 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:00.203948 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:00.203948 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:00.203948 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:00.203948 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:00.203948 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:00.203948 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:00.203948 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:00.203948 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:00.203948 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:00.204736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:00.204736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:00.204736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:00.204736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:00.204736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:00.204736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:00.204736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:00.204736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:00.204736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:00.204736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:00.204736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:00.204736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:00.207721 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 103/211] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:00.213563 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df98e7-84cf-40b7-914d-6158fb80dc07 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:00.330383 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11df98e7-84cf-40b7-914d-6158fb80dc07 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:00.372269 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647972e-e6e2-4d7b-8152-a50d38f25f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:00.373306 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647972e-e6e2-4d7b-8152-a50d38f25f3a None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:00.373794 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647972e-e6e2-4d7b-8152-a50d38f25f3a None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:00.374295 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647972e-e6e2-4d7b-8152-a50d38f25f3a None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:00.375247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647972e-e6e2-4d7b-8152-a50d38f25f3a None admin] RBAC: Adding query filter params (name=member) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:00.375847 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647972e-e6e2-4d7b-8152-a50d38f25f3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:00.377430 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647972e-e6e2-4d7b-8152-a50d38f25f3a None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:00.388528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 109/212] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:13:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:00.396444 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954615c6-f2fb-40c9-a57f-ac8be316907d None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:00.435215 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:00.516021 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784719c-85a0-4114-ab0c-d992205083ac None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:00.516665 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784719c-85a0-4114-ab0c-d992205083ac None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:00.517179 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0784719c-85a0-4114-ab0c-d992205083ac None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:00.517815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954615c6-f2fb-40c9-a57f-ac8be316907d None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:00.520030 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 110/213] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:00.525311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0828f6e-64e0-4bf9-b259-3990d3f41772 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:00.525863 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0828f6e-64e0-4bf9-b259-3990d3f41772 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:00.526345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0828f6e-64e0-4bf9-b259-3990d3f41772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:00.545322 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-b0828f6e-64e0-4bf9-b259-3990d3f41772 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:00.547018 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-b0828f6e-64e0-4bf9-b259-3990d3f41772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:00.554873 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284305b-b481-4217-9ad8-e13ca249d9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:00.555785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284305b-b481-4217-9ad8-e13ca249d9b8 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:00.556079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284305b-b481-4217-9ad8-e13ca249d9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:00.556362 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9284305b-b481-4217-9ad8-e13ca249d9b8 None admin] PATH_INFO: `/v3/users/251bd18d5e344c25a32b6745a48797d7` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:00.570703 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284305b-b481-4217-9ad8-e13ca249d9b8 None admin] RBAC: Authorizing `identity:get_user(user_id=251bd18d5e344c25a32b6745a48797d7)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:00.572251 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9284305b-b481-4217-9ad8-e13ca249d9b8 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:00.578317 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 104/214] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:00 2022] GET /identity/v3/users/251bd18d5e344c25a32b6745a48797d7 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:00.579579 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284305b-b481-4217-9ad8-e13ca249d9b8 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:00.603760 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:00.643936 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 111/215] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:00.662763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0828f6e-64e0-4bf9-b259-3990d3f41772 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:00.696740 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:00.712244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9284305b-b481-4217-9ad8-e13ca249d9b8 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:00.756026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c7627d-8645-4341-b9e3-6ea2ca89b1cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:00.757048 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7627d-8645-4341-b9e3-6ea2ca89b1cc None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:00.757334 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7627d-8645-4341-b9e3-6ea2ca89b1cc None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:00.757933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c7627d-8645-4341-b9e3-6ea2ca89b1cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:00.779810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0828f6e-64e0-4bf9-b259-3990d3f41772 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:00.813456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057a88f7-ce6a-4b86-8936-ed00f2a1b6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:00.814249 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a88f7-ce6a-4b86-8936-ed00f2a1b6df None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:00.814532 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a88f7-ce6a-4b86-8936-ed00f2a1b6df None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:00.814805 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057a88f7-ce6a-4b86-8936-ed00f2a1b6df None admin] PATH_INFO: `/v3/domains/default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:00.815983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a88f7-ce6a-4b86-8936-ed00f2a1b6df None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:00.817981 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057a88f7-ce6a-4b86-8936-ed00f2a1b6df None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:00.819583 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 112/216] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:00.820758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a32128-c8b2-4492-be81-1a881e08ca63 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:00.821039 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a32128-c8b2-4492-be81-1a881e08ca63 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:00.821313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a32128-c8b2-4492-be81-1a881e08ca63 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:00.823664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 113/217] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:00.823664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b082f-1b75-427c-855e-a41a4a8d0304 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:00.824078 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b082f-1b75-427c-855e-a41a4a8d0304 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:00.824244 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43b082f-1b75-427c-855e-a41a4a8d0304 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:00.825311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 114/218] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:00.828415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b082f-1b75-427c-855e-a41a4a8d0304 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:00.833296 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7627d-8645-4341-b9e3-6ea2ca89b1cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:00.834775 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c7627d-8645-4341-b9e3-6ea2ca89b1cc None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:00.872048 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:00.921864 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:00.929361 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43b082f-1b75-427c-855e-a41a4a8d0304 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:00.932452 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 105/219] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:13:00.937491 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930c26a-d304-4702-9f5f-639dbe9f160d None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:00.937782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930c26a-d304-4702-9f5f-639dbe9f160d None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:00.938061 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b930c26a-d304-4702-9f5f-639dbe9f160d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:00.954297 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-b930c26a-d304-4702-9f5f-639dbe9f160d None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:00.955499 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-b930c26a-d304-4702-9f5f-639dbe9f160d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:00.963257 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06c9fdd-486f-4a50-b2d0-75751ccd1957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:00.963983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c9fdd-486f-4a50-b2d0-75751ccd1957 None admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:00.964265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c9fdd-486f-4a50-b2d0-75751ccd1957 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:00.964542 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06c9fdd-486f-4a50-b2d0-75751ccd1957 None admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:00.965257 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c9fdd-486f-4a50-b2d0-75751ccd1957 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:00.966691 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06c9fdd-486f-4a50-b2d0-75751ccd1957 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:00.988184 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 115/220] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 00:13:00 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:13:00.989418 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b31c6-6339-4f70-93e5-a554bf8c0549 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:00.989712 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b31c6-6339-4f70-93e5-a554bf8c0549 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:00.990770 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b31c6-6339-4f70-93e5-a554bf8c0549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:01.013902 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-8e6b31c6-6339-4f70-93e5-a554bf8c0549 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:01.015513 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-8e6b31c6-6339-4f70-93e5-a554bf8c0549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:01.027377 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 106/221] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:01.028398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930c26a-d304-4702-9f5f-639dbe9f160d None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:01.118338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 116/222] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:01.118338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b31c6-6339-4f70-93e5-a554bf8c0549 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:01.145014 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b930c26a-d304-4702-9f5f-639dbe9f160d None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:01.155126 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:01.167116 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:01.186001 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe211d-9ec2-4193-8771-e2fceadccff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:01.187469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe211d-9ec2-4193-8771-e2fceadccff3 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:01.187772 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe211d-9ec2-4193-8771-e2fceadccff3 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:01.188055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe211d-9ec2-4193-8771-e2fceadccff3 None admin] PATH_INFO: `/v3/projects/27e0d304f3c644b2b8db92d18a19d41a` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:01.190652 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe211d-9ec2-4193-8771-e2fceadccff3 None admin] RBAC: Authorizing `identity:get_project(project_id=27e0d304f3c644b2b8db92d18a19d41a)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:01.191202 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe211d-9ec2-4193-8771-e2fceadccff3 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:01.193493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 107/223] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:01 2022] GET /identity/v3/projects/27e0d304f3c644b2b8db92d18a19d41a => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:01.194224 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe211d-9ec2-4193-8771-e2fceadccff3 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:01.259260 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b31c6-6339-4f70-93e5-a554bf8c0549 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:01.304983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfac21-44f3-4486-9bdb-f510b70afa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:01.306737 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfac21-44f3-4486-9bdb-f510b70afa09 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:01.307175 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfac21-44f3-4486-9bdb-f510b70afa09 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:01.307605 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfac21-44f3-4486-9bdb-f510b70afa09 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:01.324013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe211d-9ec2-4193-8771-e2fceadccff3 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:01.325046 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11cfac21-44f3-4486-9bdb-f510b70afa09 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:01.335825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-11cfac21-44f3-4486-9bdb-f510b70afa09 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:01.335825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:01.335825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:01.335825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:01.335825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:01.335825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:01.335825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:01.335825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:01.335825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:01.335825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:01.335825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:01.335825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:01.335825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:01.335825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:01.335825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:01.335825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:01.336914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:01.336914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:01.336914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:01.336914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:01.336914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:01.336914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:01.336914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:01.336914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:01.336914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:01.336914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:01.336914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:01.336914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:01.336914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:01.336914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:01.336914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:01.336914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:01.337893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:01.337893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:01.337893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:01.337893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:01.337893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:01.337893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:01.337893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:01.337893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:01.337893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:01.337893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:01.337893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:01.337893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:01.343872 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 117/224] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:13:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:01.344576 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfac21-44f3-4486-9bdb-f510b70afa09 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:01.372123 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d968edd-6f87-4d93-8b01-a807a74254e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:01.373883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d968edd-6f87-4d93-8b01-a807a74254e2 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:01.374364 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d968edd-6f87-4d93-8b01-a807a74254e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:01.375043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d968edd-6f87-4d93-8b01-a807a74254e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:01.389767 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d968edd-6f87-4d93-8b01-a807a74254e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:01.400320 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-2d968edd-6f87-4d93-8b01-a807a74254e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:13:01.400320 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:01.400320 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:01.400320 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:01.400320 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:01.400320 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:01.400320 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:01.400320 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:01.400320 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:01.400320 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:01.400320 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:01.400320 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:01.400320 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:01.400320 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:01.400320 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:01.400320 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:01.401622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:01.401622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:01.401622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:01.401622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:01.401622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:01.401622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:01.401622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:01.401622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:01.401622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:01.401622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:01.401622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:01.401622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:01.401622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:01.401622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:01.401622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:01.401622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:01.402399 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:01.402399 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:01.402399 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:01.402399 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:01.402399 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:01.402399 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:01.402399 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:01.402399 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:01.402399 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:01.402399 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:01.402399 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:13:01.402399 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:01.402399 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 108/225] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 00:13:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:01.402399 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d968edd-6f87-4d93-8b01-a807a74254e2 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:01.450490 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:01.461544 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:01.466240 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfac21-44f3-4486-9bdb-f510b70afa09 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:01.504748 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0ad7d-8e48-49c1-9043-e274ed8057b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:01.505414 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0ad7d-8e48-49c1-9043-e274ed8057b6 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:01.505705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0ad7d-8e48-49c1-9043-e274ed8057b6 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:01.505981 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0ad7d-8e48-49c1-9043-e274ed8057b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:01.506927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0ad7d-8e48-49c1-9043-e274ed8057b6 None admin] RBAC: Adding query filter params (role.id=d6fedf23abb64cd494e8b49acefff423, scope.project.id=27e0d304f3c644b2b8db92d18a19d41a, user.id=251bd18d5e344c25a32b6745a48797d7) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:01.507245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0ad7d-8e48-49c1-9043-e274ed8057b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:01.509106 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0ad7d-8e48-49c1-9043-e274ed8057b6 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:01.520432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 118/226] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:01 2022] GET /identity/v3/role_assignments?user.id=251bd18d5e344c25a32b6745a48797d7&scope.project.id=27e0d304f3c644b2b8db92d18a19d41a&role.id=d6fedf23abb64cd494e8b49acefff423 => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:01.520432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0ad7d-8e48-49c1-9043-e274ed8057b6 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:01.529743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d968edd-6f87-4d93-8b01-a807a74254e2 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:01.637379 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0ad7d-8e48-49c1-9043-e274ed8057b6 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:01.664515 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb5992-27d2-4b29-a1b6-24d0a3812678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:01.665132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb5992-27d2-4b29-a1b6-24d0a3812678 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:01.665415 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb5992-27d2-4b29-a1b6-24d0a3812678 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:01.665696 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fb5992-27d2-4b29-a1b6-24d0a3812678 None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:01.666455 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb5992-27d2-4b29-a1b6-24d0a3812678 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:01.666765 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb5992-27d2-4b29-a1b6-24d0a3812678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:01.668201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fb5992-27d2-4b29-a1b6-24d0a3812678 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:01.675346 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6d478-3f16-4f6c-bdc5-c5cce4c53af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:01.676097 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6d478-3f16-4f6c-bdc5-c5cce4c53af2 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:01.676647 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6d478-3f16-4f6c-bdc5-c5cce4c53af2 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:01.677033 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6d478-3f16-4f6c-bdc5-c5cce4c53af2 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:01.677911 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6d478-3f16-4f6c-bdc5-c5cce4c53af2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:01.678287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6d478-3f16-4f6c-bdc5-c5cce4c53af2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:01.679856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6d478-3f16-4f6c-bdc5-c5cce4c53af2 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:01.689859 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 119/227] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:01.696739 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6d478-3f16-4f6c-bdc5-c5cce4c53af2 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:01.704326 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 109/228] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:01.717226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb5992-27d2-4b29-a1b6-24d0a3812678 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:01.743965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:01.834027 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fb5992-27d2-4b29-a1b6-24d0a3812678 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:01.845737 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:01.878051 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c4e74-64a5-40df-98d5-8293145aedf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:01.879268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c4e74-64a5-40df-98d5-8293145aedf8 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:01.879551 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c4e74-64a5-40df-98d5-8293145aedf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:01.879849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5c4e74-64a5-40df-98d5-8293145aedf8 None admin] PATH_INFO: `/v3/users/18620b4519634d9385ad68899125c2c2` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:01.882505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c4e74-64a5-40df-98d5-8293145aedf8 None admin] RBAC: Authorizing `identity:get_user(user_id=18620b4519634d9385ad68899125c2c2)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:01.886316 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5c4e74-64a5-40df-98d5-8293145aedf8 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:01.888230 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 110/229] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:01 2022] GET /identity/v3/users/18620b4519634d9385ad68899125c2c2 => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:01.894940 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c4e74-64a5-40df-98d5-8293145aedf8 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:01.977828 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6d478-3f16-4f6c-bdc5-c5cce4c53af2 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:02.044622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5c4e74-64a5-40df-98d5-8293145aedf8 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:02.079231 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1027b0-7265-40bd-bdcf-86d926050171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:02.081126 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1027b0-7265-40bd-bdcf-86d926050171 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:02.082763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1027b0-7265-40bd-bdcf-86d926050171 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:02.083405 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1027b0-7265-40bd-bdcf-86d926050171 None admin] PATH_INFO: `/v3/users/18620b4519634d9385ad68899125c2c2` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:02.086543 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1027b0-7265-40bd-bdcf-86d926050171 None admin] RBAC: Authorizing `identity:get_user(user_id=18620b4519634d9385ad68899125c2c2)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:02.088816 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1027b0-7265-40bd-bdcf-86d926050171 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:02.097998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 120/230] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:01 2022] GET /identity/v3/users/18620b4519634d9385ad68899125c2c2 => generated 283 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:02.099412 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db360f3a-b74f-45c7-8157-9359b2a2960a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:02.100467 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1027b0-7265-40bd-bdcf-86d926050171 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:02.101556 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db360f3a-b74f-45c7-8157-9359b2a2960a None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:02.102746 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db360f3a-b74f-45c7-8157-9359b2a2960a None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:02.105186 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db360f3a-b74f-45c7-8157-9359b2a2960a None admin] PATH_INFO: `/v3/projects/27e0d304f3c644b2b8db92d18a19d41a` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:02.106615 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db360f3a-b74f-45c7-8157-9359b2a2960a None admin] RBAC: Authorizing `identity:get_project(project_id=27e0d304f3c644b2b8db92d18a19d41a)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:02.108315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db360f3a-b74f-45c7-8157-9359b2a2960a None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:02.117752 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 111/231] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:01 2022] GET /identity/v3/projects/27e0d304f3c644b2b8db92d18a19d41a => generated 302 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:02.137883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db360f3a-b74f-45c7-8157-9359b2a2960a None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:02.216037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:02.249292 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db360f3a-b74f-45c7-8157-9359b2a2960a None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:02.289734 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c8560-40e7-43d0-b990-37cbd1eb4252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:02.290985 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c8560-40e7-43d0-b990-37cbd1eb4252 None admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:02.291997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c8560-40e7-43d0-b990-37cbd1eb4252 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:02.292485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12c8560-40e7-43d0-b990-37cbd1eb4252 None admin] PATH_INFO: `/v3/projects/27e0d304f3c644b2b8db92d18a19d41a/users/18620b4519634d9385ad68899125c2c2/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:02.294789 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c8560-40e7-43d0-b990-37cbd1eb4252 None admin] RBAC: Authorizing `identity:create_grant(project_id=27e0d304f3c644b2b8db92d18a19d41a, user_id=18620b4519634d9385ad68899125c2c2, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:02.296598 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12c8560-40e7-43d0-b990-37cbd1eb4252 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:02.314166 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 112/232] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 00:13:02 2022] PUT /identity/v3/projects/27e0d304f3c644b2b8db92d18a19d41a/users/18620b4519634d9385ad68899125c2c2/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:13:02.325701 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:02.376136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1027b0-7265-40bd-bdcf-86d926050171 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:02.429356 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44e852a-1dcf-49ba-a25b-77acfd8a0894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:02.430247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e852a-1dcf-49ba-a25b-77acfd8a0894 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:02.430533 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e852a-1dcf-49ba-a25b-77acfd8a0894 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:02.430811 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44e852a-1dcf-49ba-a25b-77acfd8a0894 None admin] PATH_INFO: `/v3/projects/27e0d304f3c644b2b8db92d18a19d41a` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:02.432055 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e852a-1dcf-49ba-a25b-77acfd8a0894 None admin] RBAC: Authorizing `identity:get_project(project_id=27e0d304f3c644b2b8db92d18a19d41a)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:02.433572 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44e852a-1dcf-49ba-a25b-77acfd8a0894 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:02.435632 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 121/233] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:02 2022] GET /identity/v3/projects/27e0d304f3c644b2b8db92d18a19d41a => generated 302 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:02.442082 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c8560-40e7-43d0-b990-37cbd1eb4252 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:02.579377 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12c8560-40e7-43d0-b990-37cbd1eb4252 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:02.595975 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:02.617456 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e125e4b-fe57-4ced-b983-e0311d1785c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:02.618647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e125e4b-fe57-4ced-b983-e0311d1785c2 None admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:02.619133 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e125e4b-fe57-4ced-b983-e0311d1785c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:02.619680 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e125e4b-fe57-4ced-b983-e0311d1785c2 None admin] PATH_INFO: `/v3/projects/27e0d304f3c644b2b8db92d18a19d41a/users/18620b4519634d9385ad68899125c2c2/roles/e6bcb832ed6d4843825263e23d8fb208` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:02.623166 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e125e4b-fe57-4ced-b983-e0311d1785c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=27e0d304f3c644b2b8db92d18a19d41a, user_id=18620b4519634d9385ad68899125c2c2, role_id=e6bcb832ed6d4843825263e23d8fb208)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:02.624876 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e125e4b-fe57-4ced-b983-e0311d1785c2 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:02.641355 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 113/234] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 00:13:02 2022] PUT /identity/v3/projects/27e0d304f3c644b2b8db92d18a19d41a/users/18620b4519634d9385ad68899125c2c2/roles/e6bcb832ed6d4843825263e23d8fb208 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:13:03.481910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6847e66-ba0d-4bf6-9dd4-4d1f18dab865 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:03.482423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6847e66-ba0d-4bf6-9dd4-4d1f18dab865 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:03.482499 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6847e66-ba0d-4bf6-9dd4-4d1f18dab865 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:03.484172 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 122/235] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:03.493693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4108706-82d8-4fbd-a03a-615903531af8 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:03.494223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4108706-82d8-4fbd-a03a-615903531af8 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:03.494223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4108706-82d8-4fbd-a03a-615903531af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:03.519887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-e4108706-82d8-4fbd-a03a-615903531af8 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:03.521082 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e4108706-82d8-4fbd-a03a-615903531af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:03.596814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cb531-ef88-49e0-90ed-8827f5203d61 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:03.597159 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cb531-ef88-49e0-90ed-8827f5203d61 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:03.597446 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cb531-ef88-49e0-90ed-8827f5203d61 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:03.599429 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 123/236] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:13:03.604441 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbebfd-f13c-45ce-baf4-0adcbf2a7898 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:03.604951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbebfd-f13c-45ce-baf4-0adcbf2a7898 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:03.605442 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bbebfd-f13c-45ce-baf4-0adcbf2a7898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:03.627718 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 114/237] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:13:03.633142 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-e1bbebfd-f13c-45ce-baf4-0adcbf2a7898 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:03.634351 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-e1bbebfd-f13c-45ce-baf4-0adcbf2a7898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:03.681654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4108706-82d8-4fbd-a03a-615903531af8 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:03.764349 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 124/238] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:13:03.792782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4108706-82d8-4fbd-a03a-615903531af8 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:03.804638 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbebfd-f13c-45ce-baf4-0adcbf2a7898 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:03.808053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:03.833193 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceca7c-b53a-4ad2-bbfe-a4201db78aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:03.833996 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceca7c-b53a-4ad2-bbfe-a4201db78aae None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:03.834276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceca7c-b53a-4ad2-bbfe-a4201db78aae None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:03.834546 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bceca7c-b53a-4ad2-bbfe-a4201db78aae None admin] PATH_INFO: `/v3/domains/default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:03.835778 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceca7c-b53a-4ad2-bbfe-a4201db78aae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:03.841086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bceca7c-b53a-4ad2-bbfe-a4201db78aae None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:03.842982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 115/239] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:03.850256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceca7c-b53a-4ad2-bbfe-a4201db78aae None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:03.964437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:03.993144 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bbebfd-f13c-45ce-baf4-0adcbf2a7898 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:04.011403 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bceca7c-b53a-4ad2-bbfe-a4201db78aae None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:04.038614 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673fa263-3316-4727-beb0-70fb1a365ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:04.039987 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fa263-3316-4727-beb0-70fb1a365ef6 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:04.040275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fa263-3316-4727-beb0-70fb1a365ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:04.040555 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673fa263-3316-4727-beb0-70fb1a365ef6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:04.046641 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f78b01-170b-4cba-b6e4-197b765c242f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:04.047387 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f78b01-170b-4cba-b6e4-197b765c242f None admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:04.047806 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f78b01-170b-4cba-b6e4-197b765c242f None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:04.048149 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f78b01-170b-4cba-b6e4-197b765c242f None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:04.048930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f78b01-170b-4cba-b6e4-197b765c242f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:04.050395 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f78b01-170b-4cba-b6e4-197b765c242f None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:04.053452 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673fa263-3316-4727-beb0-70fb1a365ef6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:04.062518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-673fa263-3316-4727-beb0-70fb1a365ef6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:13:04.062518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:04.062518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:04.062518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:04.062518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:04.062518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:04.062518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:04.062518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:04.062518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:04.062518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:04.062518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:04.062518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:04.062518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:04.062518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:04.062518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:04.062518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:04.063390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:04.063390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:04.063390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:04.063390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:04.063390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:04.063390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:04.063390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:04.063390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:04.063390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:04.063390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:04.063390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:04.063390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:04.063390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:04.063390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:04.063390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:04.063390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:04.064313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:04.064313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:04.064313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:04.064313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:04.064313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:04.064313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:04.064313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:04.064313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:04.064313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:04.064313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:04.064313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:13:04.064313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:04.064313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 125/240] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:04.065068 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9de2a-e7e0-4249-9c45-40d1419c761f None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:04.066124 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9de2a-e7e0-4249-9c45-40d1419c761f None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:04.066124 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9de2a-e7e0-4249-9c45-40d1419c761f None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:04.070107 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 126/241] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:04.070821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9de2a-e7e0-4249-9c45-40d1419c761f None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:04.082384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 116/242] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 00:13:03 2022] POST /identity/v3/users => generated 293 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:13:04.083670 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cd15b-a744-411d-b610-db4806390972 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:04.083945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cd15b-a744-411d-b610-db4806390972 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:04.084232 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33cd15b-a744-411d-b610-db4806390972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:04.122602 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-d33cd15b-a744-411d-b610-db4806390972 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:04.123908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d33cd15b-a744-411d-b610-db4806390972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:04.164968 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:04.271007 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 117/243] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:04.295881 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9de2a-e7e0-4249-9c45-40d1419c761f None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:04.316833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cd15b-a744-411d-b610-db4806390972 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:04.337811 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5fcde-7d2f-4b17-adff-92c3115dfdfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:04.338506 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5fcde-7d2f-4b17-adff-92c3115dfdfd None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:04.338790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5fcde-7d2f-4b17-adff-92c3115dfdfd None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:04.339069 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d5fcde-7d2f-4b17-adff-92c3115dfdfd None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:04.339863 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5fcde-7d2f-4b17-adff-92c3115dfdfd None admin] RBAC: Adding query filter params (name=reader) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:04.340176 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5fcde-7d2f-4b17-adff-92c3115dfdfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:04.341573 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d5fcde-7d2f-4b17-adff-92c3115dfdfd None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:04.351154 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 127/244] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:13:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:04.356460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5fcde-7d2f-4b17-adff-92c3115dfdfd None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:04.362745 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:04.447423 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33cd15b-a744-411d-b610-db4806390972 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:04.503437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d5fcde-7d2f-4b17-adff-92c3115dfdfd None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:04.504383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc8f59-ca5e-4fb6-91c9-e772b99d4549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:04.504844 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc8f59-ca5e-4fb6-91c9-e772b99d4549 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:04.507647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc8f59-ca5e-4fb6-91c9-e772b99d4549 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:04.507647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc8f59-ca5e-4fb6-91c9-e772b99d4549 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:04.518443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc8f59-ca5e-4fb6-91c9-e772b99d4549 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:04.528537 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-25fc8f59-ca5e-4fb6-91c9-e772b99d4549 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:04.528537 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:04.528537 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:04.528537 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:04.528537 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:04.528537 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:04.528537 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:04.528537 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:04.528537 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:04.528537 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:04.528537 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:04.528537 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:04.528537 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:04.528537 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:04.528537 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:04.528537 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:04.529636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:04.529636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:04.529636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:04.529636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:04.529636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:04.529636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:04.529636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:04.529636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:04.529636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:04.529636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:04.529636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:04.529636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:04.529636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:04.529636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:04.529636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:04.529636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:04.530514 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:04.530514 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:04.530514 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:04.530514 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:04.530514 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:04.530514 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:04.530514 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:04.530514 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:04.530514 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:04.530514 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:04.530514 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:04.530514 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:04.533410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 118/245] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:13:04.540036 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc8f59-ca5e-4fb6-91c9-e772b99d4549 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:04.549906 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7376c9-130c-46e7-8623-7b2a567cff6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:04.550775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7376c9-130c-46e7-8623-7b2a567cff6e None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:04.551057 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7376c9-130c-46e7-8623-7b2a567cff6e None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:04.552454 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7376c9-130c-46e7-8623-7b2a567cff6e None admin] PATH_INFO: `/v3/users/206645d8ea504898a8aaed9c9ac7096f` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:04.558676 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:04.577838 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7376c9-130c-46e7-8623-7b2a567cff6e None admin] RBAC: Authorizing `identity:get_user(user_id=206645d8ea504898a8aaed9c9ac7096f)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:04.579392 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7376c9-130c-46e7-8623-7b2a567cff6e None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:04.582688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 128/246] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:04 2022] GET /identity/v3/users/206645d8ea504898a8aaed9c9ac7096f => generated 297 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:04.587309 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7376c9-130c-46e7-8623-7b2a567cff6e None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:04.669584 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:04.675244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc8f59-ca5e-4fb6-91c9-e772b99d4549 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:04.716958 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f024c9c-04a5-4310-b775-8b4c1112cee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:04.717729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f024c9c-04a5-4310-b775-8b4c1112cee4 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:04.718017 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f024c9c-04a5-4310-b775-8b4c1112cee4 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:04.718561 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f024c9c-04a5-4310-b775-8b4c1112cee4 None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:04.719312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f024c9c-04a5-4310-b775-8b4c1112cee4 None admin] RBAC: Adding query filter params (name=member) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:04.719635 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f024c9c-04a5-4310-b775-8b4c1112cee4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:04.720146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7376c9-130c-46e7-8623-7b2a567cff6e None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:04.721108 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f024c9c-04a5-4310-b775-8b4c1112cee4 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:04.731268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 119/247] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:13:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:04.736515 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f024c9c-04a5-4310-b775-8b4c1112cee4 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:04.758012 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830dc9b4-85a0-4bc3-b0cf-6058c88e47f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:04.758778 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830dc9b4-85a0-4bc3-b0cf-6058c88e47f7 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:04.759064 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830dc9b4-85a0-4bc3-b0cf-6058c88e47f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:04.759340 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830dc9b4-85a0-4bc3-b0cf-6058c88e47f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:04.816043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:04.837465 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830dc9b4-85a0-4bc3-b0cf-6058c88e47f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:04.838929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830dc9b4-85a0-4bc3-b0cf-6058c88e47f7 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:04.867036 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f024c9c-04a5-4310-b775-8b4c1112cee4 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:04.908023 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065a271-2f80-4470-b7bb-155daaa7873c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:04.908897 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065a271-2f80-4470-b7bb-155daaa7873c None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:04.909175 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065a271-2f80-4470-b7bb-155daaa7873c None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:04.909446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065a271-2f80-4470-b7bb-155daaa7873c None admin] PATH_INFO: `/v3/users/251bd18d5e344c25a32b6745a48797d7` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:04.910695 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065a271-2f80-4470-b7bb-155daaa7873c None admin] RBAC: Authorizing `identity:get_user(user_id=251bd18d5e344c25a32b6745a48797d7)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:04.912216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065a271-2f80-4470-b7bb-155daaa7873c None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:04.914493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 120/248] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:04 2022] GET /identity/v3/users/251bd18d5e344c25a32b6745a48797d7 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:04.919964 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065a271-2f80-4470-b7bb-155daaa7873c None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:04.973286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:05.055297 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 129/249] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:13:05.061280 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830dc9b4-85a0-4bc3-b0cf-6058c88e47f7 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:05.074624 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065a271-2f80-4470-b7bb-155daaa7873c None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:05.109444 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf17af53-0b25-4d0b-925f-50836d75c695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:05.110305 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17af53-0b25-4d0b-925f-50836d75c695 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:05.110588 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17af53-0b25-4d0b-925f-50836d75c695 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:05.110862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf17af53-0b25-4d0b-925f-50836d75c695 None admin] PATH_INFO: `/v3/projects/27e0d304f3c644b2b8db92d18a19d41a` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:05.112093 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17af53-0b25-4d0b-925f-50836d75c695 None admin] RBAC: Authorizing `identity:get_project(project_id=27e0d304f3c644b2b8db92d18a19d41a)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:05.114086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf17af53-0b25-4d0b-925f-50836d75c695 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:05.116160 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 121/250] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:04 2022] GET /identity/v3/projects/27e0d304f3c644b2b8db92d18a19d41a => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:05.117331 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cedaf9-5506-4be6-9e9a-2ce56b633f11 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:05.117616 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cedaf9-5506-4be6-9e9a-2ce56b633f11 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:05.117890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cedaf9-5506-4be6-9e9a-2ce56b633f11 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:05.123877 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 122/251] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:05.124660 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cedaf9-5506-4be6-9e9a-2ce56b633f11 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:05.136276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:05.179489 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830dc9b4-85a0-4bc3-b0cf-6058c88e47f7 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:05.221179 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575431a-f36c-47b8-92d9-ab90f0df6644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:05.222971 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575431a-f36c-47b8-92d9-ab90f0df6644 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:05.223452 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575431a-f36c-47b8-92d9-ab90f0df6644 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:05.223959 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575431a-f36c-47b8-92d9-ab90f0df6644 None admin] PATH_INFO: `/v3/projects/27e0d304f3c644b2b8db92d18a19d41a` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:05.225370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575431a-f36c-47b8-92d9-ab90f0df6644 None admin] RBAC: Authorizing `identity:get_project(project_id=27e0d304f3c644b2b8db92d18a19d41a)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:05.227025 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575431a-f36c-47b8-92d9-ab90f0df6644 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:05.229255 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 130/252] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:05 2022] GET /identity/v3/projects/27e0d304f3c644b2b8db92d18a19d41a => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:05.230590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e1bfc-562a-4a4a-ae90-499cbc7d4054 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:05.235642 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e1bfc-562a-4a4a-ae90-499cbc7d4054 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:05.235776 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cedaf9-5506-4be6-9e9a-2ce56b633f11 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:05.236423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62e1bfc-562a-4a4a-ae90-499cbc7d4054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:05.254380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-b62e1bfc-562a-4a4a-ae90-499cbc7d4054 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:05.255899 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-b62e1bfc-562a-4a4a-ae90-499cbc7d4054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:05.271704 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad13f5-8f68-401b-9ace-2e9dfc262896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:05.272587 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad13f5-8f68-401b-9ace-2e9dfc262896 None admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:05.272868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad13f5-8f68-401b-9ace-2e9dfc262896 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:05.273143 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad13f5-8f68-401b-9ace-2e9dfc262896 None admin] PATH_INFO: `/v3/projects/27e0d304f3c644b2b8db92d18a19d41a/users/251bd18d5e344c25a32b6745a48797d7/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:05.275112 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad13f5-8f68-401b-9ace-2e9dfc262896 None admin] RBAC: Authorizing `identity:create_grant(project_id=27e0d304f3c644b2b8db92d18a19d41a, user_id=251bd18d5e344c25a32b6745a48797d7, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:05.276593 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad13f5-8f68-401b-9ace-2e9dfc262896 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:05.281615 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:05.297433 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 123/253] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 00:13:05 2022] PUT /identity/v3/projects/27e0d304f3c644b2b8db92d18a19d41a/users/251bd18d5e344c25a32b6745a48797d7/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:13:05.297433 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad13f5-8f68-401b-9ace-2e9dfc262896 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:05.358596 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 131/254] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:05.379929 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:05.437979 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad13f5-8f68-401b-9ace-2e9dfc262896 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:05.450293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e1bfc-562a-4a4a-ae90-499cbc7d4054 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:05.479468 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ba5aa-4e52-4563-8649-a368b1dccc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:05.480174 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ba5aa-4e52-4563-8649-a368b1dccc3c None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:05.480453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ba5aa-4e52-4563-8649-a368b1dccc3c None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:05.480721 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ba5aa-4e52-4563-8649-a368b1dccc3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:05.486179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ba5aa-4e52-4563-8649-a368b1dccc3c None admin] RBAC: Adding query filter params (role.id=d80b3a9c2e6e45739aa3056330bc9ad8, scope.project.id=27e0d304f3c644b2b8db92d18a19d41a, user.id=206645d8ea504898a8aaed9c9ac7096f) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:05.486179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ba5aa-4e52-4563-8649-a368b1dccc3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:05.486179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ba5aa-4e52-4563-8649-a368b1dccc3c None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:05.490695 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 124/255] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:05 2022] GET /identity/v3/role_assignments?user.id=206645d8ea504898a8aaed9c9ac7096f&scope.project.id=27e0d304f3c644b2b8db92d18a19d41a&role.id=d80b3a9c2e6e45739aa3056330bc9ad8 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:05.582419 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce436008-a991-46ef-a47c-ae7b37f03869 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:05.583010 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce436008-a991-46ef-a47c-ae7b37f03869 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:05.583010 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce436008-a991-46ef-a47c-ae7b37f03869 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:05.584472 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 125/256] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:13:05.590061 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac4a9f-4062-419f-a589-9972aae34456 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:05.590382 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac4a9f-4062-419f-a589-9972aae34456 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:05.590620 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac4a9f-4062-419f-a589-9972aae34456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:05.603456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62e1bfc-562a-4a4a-ae90-499cbc7d4054 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:05.620831 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-b3ac4a9f-4062-419f-a589-9972aae34456 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:05.621979 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-b3ac4a9f-4062-419f-a589-9972aae34456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:05.643216 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735f3e4-7bcc-4299-b207-b08ce614d4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:05.644152 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735f3e4-7bcc-4299-b207-b08ce614d4a4 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:05.644982 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735f3e4-7bcc-4299-b207-b08ce614d4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:05.645258 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c735f3e4-7bcc-4299-b207-b08ce614d4a4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:05.657442 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c735f3e4-7bcc-4299-b207-b08ce614d4a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:05.665601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-c735f3e4-7bcc-4299-b207-b08ce614d4a4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:05.665601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:05.665601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:05.665601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:05.665601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:05.665601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:05.665601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:05.665601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:05.665601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:05.665601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:05.665601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:05.665601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:05.665601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:05.665601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:05.665601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:05.665601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:05.666479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:05.666479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:05.666479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:05.666479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:05.666479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:05.666479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:05.666479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:05.666479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:05.666479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:05.666479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:05.666479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:05.666479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:05.666479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:05.666479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:05.666479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:05.666479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:05.667268 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:05.667268 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:05.667268 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:05.667268 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:05.667268 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:05.667268 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:05.667268 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:05.667268 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:05.667268 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:05.667268 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:05.667268 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:05.667268 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:05.667268 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 132/257] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:13:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:05.681062 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735f3e4-7bcc-4299-b207-b08ce614d4a4 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:05.713390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:05.719953 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 126/258] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:05.755898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac4a9f-4062-419f-a589-9972aae34456 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:05.844944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c735f3e4-7bcc-4299-b207-b08ce614d4a4 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:05.865516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:05.903264 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac4a9f-4062-419f-a589-9972aae34456 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:05.932972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff88b5-7793-4e1e-b1a3-248e70d0eb75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:05.933642 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff88b5-7793-4e1e-b1a3-248e70d0eb75 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:05.933932 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff88b5-7793-4e1e-b1a3-248e70d0eb75 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:05.936098 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff88b5-7793-4e1e-b1a3-248e70d0eb75 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:05.936885 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff88b5-7793-4e1e-b1a3-248e70d0eb75 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:05.937216 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff88b5-7793-4e1e-b1a3-248e70d0eb75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:05.938618 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff88b5-7793-4e1e-b1a3-248e70d0eb75 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:05.946098 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e323d0f-b3e2-4e3b-a406-e035fc3f2bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:05.946918 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e323d0f-b3e2-4e3b-a406-e035fc3f2bd8 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:05.947198 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e323d0f-b3e2-4e3b-a406-e035fc3f2bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:05.947526 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e323d0f-b3e2-4e3b-a406-e035fc3f2bd8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:05.963093 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 133/259] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:05.968805 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff88b5-7793-4e1e-b1a3-248e70d0eb75 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:05.985721 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e323d0f-b3e2-4e3b-a406-e035fc3f2bd8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:05.999892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-5e323d0f-b3e2-4e3b-a406-e035fc3f2bd8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:13:05.999892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:05.999892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:05.999892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:05.999892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:05.999892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:05.999892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:05.999892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:05.999892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:05.999892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:05.999892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:05.999892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:05.999892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:05.999892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:05.999892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:05.999892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:06.000819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:06.000819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:06.000819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:06.000819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:06.000819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:06.000819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:06.000819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:06.000819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:06.000819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:06.000819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:06.000819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:06.000819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:06.000819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:06.000819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:06.000819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:06.000819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:06.001601 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:06.001601 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:06.001601 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:06.001601 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:06.001601 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:06.001601 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:06.001601 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:06.001601 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:06.001601 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:06.001601 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:06.001601 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:13:06.001601 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:06.002211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 127/260] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 00:13:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:06.008758 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e323d0f-b3e2-4e3b-a406-e035fc3f2bd8 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:06.109792 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:06.143638 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff88b5-7793-4e1e-b1a3-248e70d0eb75 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:06.209207 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce375d8e-3681-4036-af9b-004a73011e16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:06.210098 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce375d8e-3681-4036-af9b-004a73011e16 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:06.210383 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce375d8e-3681-4036-af9b-004a73011e16 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:06.210661 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce375d8e-3681-4036-af9b-004a73011e16 None admin] PATH_INFO: `/v3/users/18620b4519634d9385ad68899125c2c2` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:06.216424 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce375d8e-3681-4036-af9b-004a73011e16 None admin] RBAC: Authorizing `identity:get_user(user_id=18620b4519634d9385ad68899125c2c2)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:06.217775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce375d8e-3681-4036-af9b-004a73011e16 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:06.219410 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 134/261] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:05 2022] GET /identity/v3/users/18620b4519634d9385ad68899125c2c2 => generated 283 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:06.224734 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce375d8e-3681-4036-af9b-004a73011e16 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:06.259155 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e323d0f-b3e2-4e3b-a406-e035fc3f2bd8 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:06.303069 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:06.352895 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a5a2e-adf3-4e71-b74d-df004a30ea24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:06.353586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a5a2e-adf3-4e71-b74d-df004a30ea24 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:06.353880 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a5a2e-adf3-4e71-b74d-df004a30ea24 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:06.354154 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6a5a2e-adf3-4e71-b74d-df004a30ea24 None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:06.354915 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a5a2e-adf3-4e71-b74d-df004a30ea24 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:06.355229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a5a2e-adf3-4e71-b74d-df004a30ea24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:06.356668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6a5a2e-adf3-4e71-b74d-df004a30ea24 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:06.378030 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 128/262] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:06.383707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a5a2e-adf3-4e71-b74d-df004a30ea24 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:06.413910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce375d8e-3681-4036-af9b-004a73011e16 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:06.498371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc55c09-c338-4293-a2e9-e10438653148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:06.498968 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc55c09-c338-4293-a2e9-e10438653148 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:06.499258 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc55c09-c338-4293-a2e9-e10438653148 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:06.499542 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc55c09-c338-4293-a2e9-e10438653148 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:06.545540 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:06.592079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6a5a2e-adf3-4e71-b74d-df004a30ea24 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:06.636055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268e808-3168-4cd2-a78f-b5f5dfe79693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:06.636931 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268e808-3168-4cd2-a78f-b5f5dfe79693 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:06.637211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268e808-3168-4cd2-a78f-b5f5dfe79693 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:06.637484 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a268e808-3168-4cd2-a78f-b5f5dfe79693 None admin] PATH_INFO: `/v3/users/18620b4519634d9385ad68899125c2c2` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:06.638701 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268e808-3168-4cd2-a78f-b5f5dfe79693 None admin] RBAC: Authorizing `identity:get_user(user_id=18620b4519634d9385ad68899125c2c2)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:06.640186 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a268e808-3168-4cd2-a78f-b5f5dfe79693 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:06.642121 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 129/263] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:06 2022] GET /identity/v3/users/18620b4519634d9385ad68899125c2c2 => generated 283 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:06.647073 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268e808-3168-4cd2-a78f-b5f5dfe79693 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:06.673086 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc55c09-c338-4293-a2e9-e10438653148 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:06.674574 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc55c09-c338-4293-a2e9-e10438653148 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:06.745372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:06.835982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a268e808-3168-4cd2-a78f-b5f5dfe79693 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:06.880274 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 135/264] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 651 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:13:06.893593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc55c09-c338-4293-a2e9-e10438653148 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:06.906790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef1cd6-c29d-4d88-a571-14673c9d0466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:06.907441 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef1cd6-c29d-4d88-a571-14673c9d0466 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:06.907750 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef1cd6-c29d-4d88-a571-14673c9d0466 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:06.908024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ef1cd6-c29d-4d88-a571-14673c9d0466 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:06.979994 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:07.025091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef1cd6-c29d-4d88-a571-14673c9d0466 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:07.026769 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ef1cd6-c29d-4d88-a571-14673c9d0466 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:07.075824 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc55c09-c338-4293-a2e9-e10438653148 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:07.079629 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:07.132779 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 130/265] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:13:07.137814 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef1cd6-c29d-4d88-a571-14673c9d0466 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:07.153351 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b7608-f780-40ab-b329-53796ff110b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:07.154222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b7608-f780-40ab-b329-53796ff110b7 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:07.154507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b7608-f780-40ab-b329-53796ff110b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:07.154788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19b7608-f780-40ab-b329-53796ff110b7 None admin] PATH_INFO: `/v3/projects/27e0d304f3c644b2b8db92d18a19d41a` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:07.157446 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19b7608-f780-40ab-b329-53796ff110b7 None admin] RBAC: Authorizing `identity:get_project(project_id=27e0d304f3c644b2b8db92d18a19d41a)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:07.158909 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19b7608-f780-40ab-b329-53796ff110b7 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:07.160716 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 136/266] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:06 2022] GET /identity/v3/projects/27e0d304f3c644b2b8db92d18a19d41a => generated 302 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:07.185452 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b7608-f780-40ab-b329-53796ff110b7 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:07.269364 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ef1cd6-c29d-4d88-a571-14673c9d0466 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:07.323788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19b7608-f780-40ab-b329-53796ff110b7 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:07.333304 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1606a21-6ff2-46ff-953b-7b82a84a4d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:07.334250 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1606a21-6ff2-46ff-953b-7b82a84a4d2f None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:07.334642 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1606a21-6ff2-46ff-953b-7b82a84a4d2f None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:07.335022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1606a21-6ff2-46ff-953b-7b82a84a4d2f None admin] PATH_INFO: `/v3/projects/27e0d304f3c644b2b8db92d18a19d41a` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:07.340329 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1606a21-6ff2-46ff-953b-7b82a84a4d2f None admin] RBAC: Authorizing `identity:get_project(project_id=27e0d304f3c644b2b8db92d18a19d41a)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:07.341924 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1606a21-6ff2-46ff-953b-7b82a84a4d2f None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:07.344078 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 131/267] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:07 2022] GET /identity/v3/projects/27e0d304f3c644b2b8db92d18a19d41a => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:07.348752 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:07.350412 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1606a21-6ff2-46ff-953b-7b82a84a4d2f None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:07.369290 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f8dbfd-50b6-4478-a175-97c9d984ea62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:07.369966 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8dbfd-50b6-4478-a175-97c9d984ea62 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:07.370262 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8dbfd-50b6-4478-a175-97c9d984ea62 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:07.370542 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f8dbfd-50b6-4478-a175-97c9d984ea62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:07.371389 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8dbfd-50b6-4478-a175-97c9d984ea62 None admin] RBAC: Adding query filter params (role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab, scope.project.id=27e0d304f3c644b2b8db92d18a19d41a, user.id=18620b4519634d9385ad68899125c2c2) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:07.371734 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8dbfd-50b6-4478-a175-97c9d984ea62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:07.373193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f8dbfd-50b6-4478-a175-97c9d984ea62 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:07.386910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 137/268] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:07 2022] GET /identity/v3/role_assignments?user.id=18620b4519634d9385ad68899125c2c2&scope.project.id=27e0d304f3c644b2b8db92d18a19d41a&role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:07.397043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:07.505016 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1606a21-6ff2-46ff-953b-7b82a84a4d2f None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:07.542936 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf0ad5-d820-427b-9063-b9ee66bce122 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:07.543229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf0ad5-d820-427b-9063-b9ee66bce122 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:07.543507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf0ad5-d820-427b-9063-b9ee66bce122 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:07.544941 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 138/269] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:13:07.563791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79972f-28bb-4e58-929b-3c57b78aec86 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:07.564073 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79972f-28bb-4e58-929b-3c57b78aec86 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:07.564300 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79771aa8-2611-4819-9c4a-12d601d1ca60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:07.564443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da79972f-28bb-4e58-929b-3c57b78aec86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:07.565041 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79771aa8-2611-4819-9c4a-12d601d1ca60 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:07.565329 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79771aa8-2611-4819-9c4a-12d601d1ca60 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:07.565610 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79771aa8-2611-4819-9c4a-12d601d1ca60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:07.566505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79771aa8-2611-4819-9c4a-12d601d1ca60 None admin] RBAC: Adding query filter params (role.id=e6bcb832ed6d4843825263e23d8fb208, scope.project.id=27e0d304f3c644b2b8db92d18a19d41a, user.id=18620b4519634d9385ad68899125c2c2) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:07.566828 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79771aa8-2611-4819-9c4a-12d601d1ca60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:07.568350 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79771aa8-2611-4819-9c4a-12d601d1ca60 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:07.575603 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 132/270] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:07 2022] GET /identity/v3/role_assignments?user.id=18620b4519634d9385ad68899125c2c2&scope.project.id=27e0d304f3c644b2b8db92d18a19d41a&role.id=e6bcb832ed6d4843825263e23d8fb208 => generated 608 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:07.606472 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-da79972f-28bb-4e58-929b-3c57b78aec86 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:07.607633 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-da79972f-28bb-4e58-929b-3c57b78aec86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:07.713573 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 139/271] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:13:07.750079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79771aa8-2611-4819-9c4a-12d601d1ca60 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:07.884480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:07.897580 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79771aa8-2611-4819-9c4a-12d601d1ca60 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:07.940090 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621ceab-9eab-48c9-a60b-fe2379f2fba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:07.940900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621ceab-9eab-48c9-a60b-fe2379f2fba3 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:07.941187 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621ceab-9eab-48c9-a60b-fe2379f2fba3 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:07.941502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7621ceab-9eab-48c9-a60b-fe2379f2fba3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:07.955720 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7621ceab-9eab-48c9-a60b-fe2379f2fba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:07.964097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-7621ceab-9eab-48c9-a60b-fe2379f2fba3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:07.964097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:07.964097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:07.964097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:07.964097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:07.964097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:07.964097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:07.964097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:07.964097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:07.964097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:07.964097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:07.964097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:07.964097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:07.964097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:07.964097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:07.964097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:07.964955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:07.964955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:07.964955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:07.964955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:07.964955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:07.964955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:07.964955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:07.964955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:07.964955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:07.964955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:07.964955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:07.964955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:07.964955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:07.964955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:07.964955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:07.964955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:07.965755 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:07.965755 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:07.965755 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:07.965755 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:07.965755 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:07.965755 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:07.965755 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:07.965755 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:07.965755 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:07.965755 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:07.965755 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:07.965755 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:07.965755 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 133/272] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:07.971181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79972f-28bb-4e58-929b-3c57b78aec86 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:08.115344 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da79972f-28bb-4e58-929b-3c57b78aec86 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:08.127992 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:08.155357 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c92d86-3f28-424c-98b3-9d323fe510db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:08.156081 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c92d86-3f28-424c-98b3-9d323fe510db None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:08.156288 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c92d86-3f28-424c-98b3-9d323fe510db None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:08.156563 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c92d86-3f28-424c-98b3-9d323fe510db None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:08.157330 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c92d86-3f28-424c-98b3-9d323fe510db None admin] RBAC: Adding query filter params (name=member) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:08.157644 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c92d86-3f28-424c-98b3-9d323fe510db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:08.159034 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c92d86-3f28-424c-98b3-9d323fe510db None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:08.168482 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 140/273] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:13:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:08.174783 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621ceab-9eab-48c9-a60b-fe2379f2fba3 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:08.282755 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b6655-3e53-44e0-b02c-476ba93d45d5 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:08.283103 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b6655-3e53-44e0-b02c-476ba93d45d5 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:08.283331 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b6655-3e53-44e0-b02c-476ba93d45d5 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:08.285587 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 141/274] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:13:08.295301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17586562-fcbb-493a-a6cd-896c4e161158 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:08.295998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17586562-fcbb-493a-a6cd-896c4e161158 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:08.296662 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17586562-fcbb-493a-a6cd-896c4e161158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:08.305132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7621ceab-9eab-48c9-a60b-fe2379f2fba3 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:08.320624 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-17586562-fcbb-493a-a6cd-896c4e161158 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:08.322844 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-17586562-fcbb-493a-a6cd-896c4e161158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:08.346418 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f503da8-2df3-4564-b82e-b849b7c90402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:08.347306 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f503da8-2df3-4564-b82e-b849b7c90402 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:08.348133 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f503da8-2df3-4564-b82e-b849b7c90402 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:08.348423 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f503da8-2df3-4564-b82e-b849b7c90402 None admin] PATH_INFO: `/v3/users/319c1b74816e47d892ed1b5b2c3d3fcf` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:08.361975 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f503da8-2df3-4564-b82e-b849b7c90402 None admin] RBAC: Authorizing `identity:get_user(user_id=319c1b74816e47d892ed1b5b2c3d3fcf)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:08.363527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f503da8-2df3-4564-b82e-b849b7c90402 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:08.365641 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 134/275] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:08 2022] GET /identity/v3/users/319c1b74816e47d892ed1b5b2c3d3fcf => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:08.366563 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82d101-79d2-4846-b1d9-3796b7bac8c6 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:08.366855 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82d101-79d2-4846-b1d9-3796b7bac8c6 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:08.367136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f82d101-79d2-4846-b1d9-3796b7bac8c6 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:08.369892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 135/276] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:08.369892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02beb6b6-ce61-4370-b7b0-40d582b46250 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:08.369892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02beb6b6-ce61-4370-b7b0-40d582b46250 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:08.370153 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02beb6b6-ce61-4370-b7b0-40d582b46250 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:08.371447 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 136/277] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:08.372181 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02beb6b6-ce61-4370-b7b0-40d582b46250 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:08.375221 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:08.400068 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 142/278] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:08.401346 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3743e05-4248-4ee2-8764-81a13420a12e None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:08.401639 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3743e05-4248-4ee2-8764-81a13420a12e None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:08.402085 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3743e05-4248-4ee2-8764-81a13420a12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:08.419856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-c3743e05-4248-4ee2-8764-81a13420a12e None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:08.420984 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-c3743e05-4248-4ee2-8764-81a13420a12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:08.474670 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02beb6b6-ce61-4370-b7b0-40d582b46250 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:08.486589 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 143/279] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:08.487879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e57cc-a54e-4efa-83f2-2637ec57567e None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:08.488242 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e57cc-a54e-4efa-83f2-2637ec57567e None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:08.488529 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e57cc-a54e-4efa-83f2-2637ec57567e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:08.505302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-815e57cc-a54e-4efa-83f2-2637ec57567e None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:08.506481 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-815e57cc-a54e-4efa-83f2-2637ec57567e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:08.510017 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197b78a-2c59-4dc9-8b0e-795241d0706e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:08.510686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197b78a-2c59-4dc9-8b0e-795241d0706e None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:08.510949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197b78a-2c59-4dc9-8b0e-795241d0706e None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:08.511222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197b78a-2c59-4dc9-8b0e-795241d0706e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:08.512079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197b78a-2c59-4dc9-8b0e-795241d0706e None admin] RBAC: Adding query filter params (role.id=d6fedf23abb64cd494e8b49acefff423, user.id=319c1b74816e47d892ed1b5b2c3d3fcf, scope.system=all) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:08.512392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197b78a-2c59-4dc9-8b0e-795241d0706e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:08.513826 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197b78a-2c59-4dc9-8b0e-795241d0706e None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:08.518869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 137/280] 10.222.0.44 () {56 vars in 1308 bytes} [Thu Jun 16 00:13:08 2022] GET /identity/v3/role_assignments?user.id=319c1b74816e47d892ed1b5b2c3d3fcf&scope.system=all&role.id=d6fedf23abb64cd494e8b49acefff423 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:08.520276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197b78a-2c59-4dc9-8b0e-795241d0706e None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:08.539255 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:08.589407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 144/281] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:08.590182 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e57cc-a54e-4efa-83f2-2637ec57567e None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:08.609090 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:08.656788 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197b78a-2c59-4dc9-8b0e-795241d0706e None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:08.696581 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d449475-00e2-4dd5-a6a2-b911f93a9f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:08.697230 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d449475-00e2-4dd5-a6a2-b911f93a9f5f None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:08.697507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d449475-00e2-4dd5-a6a2-b911f93a9f5f None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:08.697831 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d449475-00e2-4dd5-a6a2-b911f93a9f5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:08.698950 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d449475-00e2-4dd5-a6a2-b911f93a9f5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:08.700411 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d449475-00e2-4dd5-a6a2-b911f93a9f5f None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:08.702112 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 138/282] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:08.702765 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d449475-00e2-4dd5-a6a2-b911f93a9f5f None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:08.712112 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e57cc-a54e-4efa-83f2-2637ec57567e None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:08.747945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e2fa6-040f-4878-8e66-552c11a1b53b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:08.748750 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e2fa6-040f-4878-8e66-552c11a1b53b None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:08.749037 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e2fa6-040f-4878-8e66-552c11a1b53b None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:08.749319 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2e2fa6-040f-4878-8e66-552c11a1b53b None admin] PATH_INFO: `/v3/roles/member` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:08.760475 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2e2fa6-040f-4878-8e66-552c11a1b53b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:08.768289 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-2d2e2fa6-040f-4878-8e66-552c11a1b53b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:08.768289 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:08.768289 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:08.768289 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:08.768289 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:08.768289 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:08.768289 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:08.768289 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:08.768289 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:08.768289 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:08.768289 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:08.768289 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:08.768289 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:08.768289 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:08.768289 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:08.768289 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:08.769158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:08.769158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:08.769158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:08.769158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:08.769158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:08.769158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:08.769158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:08.769158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:08.769158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:08.769158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:08.769158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:08.769158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:08.769158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:08.769158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:08.769158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:08.769158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:08.769999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:08.769999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:08.769999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:08.769999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:08.769999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:08.769999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:08.769999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:08.769999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:08.769999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:08.769999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:08.769999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:08.769999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:08.769999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 145/283] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:08.770644 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e2fa6-040f-4878-8e66-552c11a1b53b None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:08.801879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:08.819691 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d449475-00e2-4dd5-a6a2-b911f93a9f5f None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:08.855316 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55532b1e-55b0-4ca0-8e66-f202f1d3cf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:08.856148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55532b1e-55b0-4ca0-8e66-f202f1d3cf61 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:08.856434 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55532b1e-55b0-4ca0-8e66-f202f1d3cf61 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:08.856710 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55532b1e-55b0-4ca0-8e66-f202f1d3cf61 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:08.858580 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:08.869183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55532b1e-55b0-4ca0-8e66-f202f1d3cf61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:08.877857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-55532b1e-55b0-4ca0-8e66-f202f1d3cf61 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:13:08.877857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:08.877857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:08.877857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:08.877857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:08.877857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:08.877857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:08.877857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:08.877857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:08.877857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:08.877857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:08.877857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:08.877857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:08.877857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:08.877857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:08.877857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:08.878790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:08.878790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:08.878790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:08.878790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:08.878790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:08.878790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:08.878790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:08.878790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:08.878790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:08.878790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:08.878790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:08.878790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:08.878790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:08.878790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:08.878790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:08.878790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:08.880536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:08.880536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:08.880536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:08.880536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:08.880536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:08.880536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:08.880536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:08.880536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:08.880536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:08.880536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:08.880536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:13:08.880536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:08.880536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 139/284] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:08.880536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55532b1e-55b0-4ca0-8e66-f202f1d3cf61 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:08.891434 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2e2fa6-040f-4878-8e66-552c11a1b53b None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:08.930221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468968a-d36e-4d5c-bc17-a0b7c90cdd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:08.930905 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468968a-d36e-4d5c-bc17-a0b7c90cdd10 None admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:08.931201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468968a-d36e-4d5c-bc17-a0b7c90cdd10 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:08.931481 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e468968a-d36e-4d5c-bc17-a0b7c90cdd10 None admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:08.932253 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468968a-d36e-4d5c-bc17-a0b7c90cdd10 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:08.933721 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e468968a-d36e-4d5c-bc17-a0b7c90cdd10 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:08.956426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 146/285] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 00:13:08 2022] POST /identity/v3/users => generated 293 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:13:08.968672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468968a-d36e-4d5c-bc17-a0b7c90cdd10 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:09.002608 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55532b1e-55b0-4ca0-8e66-f202f1d3cf61 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:09.057514 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33871bf2-9ec7-45cf-8668-41cf8e204e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:09.058744 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33871bf2-9ec7-45cf-8668-41cf8e204e2a None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:09.059181 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33871bf2-9ec7-45cf-8668-41cf8e204e2a None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:09.059665 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33871bf2-9ec7-45cf-8668-41cf8e204e2a None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:09.060588 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33871bf2-9ec7-45cf-8668-41cf8e204e2a None admin] RBAC: Adding query filter params (name=member) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:09.061084 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33871bf2-9ec7-45cf-8668-41cf8e204e2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:09.063700 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33871bf2-9ec7-45cf-8668-41cf8e204e2a None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:09.076260 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 140/286] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:13:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:09.079081 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:09.081664 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33871bf2-9ec7-45cf-8668-41cf8e204e2a None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:09.114642 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e468968a-d36e-4d5c-bc17-a0b7c90cdd10 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:09.154631 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c7534-bd17-4064-a5b4-7c46aeb2ea00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:09.155318 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c7534-bd17-4064-a5b4-7c46aeb2ea00 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:09.155645 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c7534-bd17-4064-a5b4-7c46aeb2ea00 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:09.156001 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c7534-bd17-4064-a5b4-7c46aeb2ea00 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:09.156774 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c7534-bd17-4064-a5b4-7c46aeb2ea00 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:09.157094 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c7534-bd17-4064-a5b4-7c46aeb2ea00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:09.157358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:09.158734 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c7534-bd17-4064-a5b4-7c46aeb2ea00 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:09.168740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 147/287] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:13:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:09.174243 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c7534-bd17-4064-a5b4-7c46aeb2ea00 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:09.220281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33871bf2-9ec7-45cf-8668-41cf8e204e2a None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:09.265702 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b951c04-ff4d-4734-a3b2-ebc3a684e983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:09.266910 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b951c04-ff4d-4734-a3b2-ebc3a684e983 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:09.267394 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b951c04-ff4d-4734-a3b2-ebc3a684e983 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:09.267876 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b951c04-ff4d-4734-a3b2-ebc3a684e983 None admin] PATH_INFO: `/v3/users/251bd18d5e344c25a32b6745a48797d7` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:09.271680 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b951c04-ff4d-4734-a3b2-ebc3a684e983 None admin] RBAC: Authorizing `identity:get_user(user_id=251bd18d5e344c25a32b6745a48797d7)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:09.273369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b951c04-ff4d-4734-a3b2-ebc3a684e983 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:09.275252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 141/288] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:09 2022] GET /identity/v3/users/251bd18d5e344c25a32b6745a48797d7 => generated 297 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:09.281864 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b951c04-ff4d-4734-a3b2-ebc3a684e983 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:09.306400 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c7534-bd17-4064-a5b4-7c46aeb2ea00 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:09.348029 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76cab8-f88a-460d-a3ef-9e6ea95376a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:09.348913 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76cab8-f88a-460d-a3ef-9e6ea95376a0 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:09.349193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76cab8-f88a-460d-a3ef-9e6ea95376a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:09.349469 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff76cab8-f88a-460d-a3ef-9e6ea95376a0 None admin] PATH_INFO: `/v3/users/206645d8ea504898a8aaed9c9ac7096f` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:09.350678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76cab8-f88a-460d-a3ef-9e6ea95376a0 None admin] RBAC: Authorizing `identity:get_user(user_id=206645d8ea504898a8aaed9c9ac7096f)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:09.352176 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff76cab8-f88a-460d-a3ef-9e6ea95376a0 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:09.353954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 148/289] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:09 2022] GET /identity/v3/users/206645d8ea504898a8aaed9c9ac7096f => generated 297 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:09.359165 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76cab8-f88a-460d-a3ef-9e6ea95376a0 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:09.371697 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:09.398418 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b951c04-ff4d-4734-a3b2-ebc3a684e983 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:09.424134 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:09.442060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d633e55-fdd7-4bb2-9aeb-c3c05d8c3fad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:09.443593 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d633e55-fdd7-4bb2-9aeb-c3c05d8c3fad None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:09.443908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d633e55-fdd7-4bb2-9aeb-c3c05d8c3fad None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:09.444189 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d633e55-fdd7-4bb2-9aeb-c3c05d8c3fad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:09.476181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff76cab8-f88a-460d-a3ef-9e6ea95376a0 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:09.512615 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294caa5a-1863-4a5d-9e70-6957e792cea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:09.513492 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294caa5a-1863-4a5d-9e70-6957e792cea3 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:09.513780 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294caa5a-1863-4a5d-9e70-6957e792cea3 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:09.514061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294caa5a-1863-4a5d-9e70-6957e792cea3 None admin] PATH_INFO: `/v3/projects/27e0d304f3c644b2b8db92d18a19d41a` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:09.515274 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294caa5a-1863-4a5d-9e70-6957e792cea3 None admin] RBAC: Authorizing `identity:get_project(project_id=27e0d304f3c644b2b8db92d18a19d41a)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:09.516855 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294caa5a-1863-4a5d-9e70-6957e792cea3 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:09.518886 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 149/290] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:09 2022] GET /identity/v3/projects/27e0d304f3c644b2b8db92d18a19d41a => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:09.526745 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294caa5a-1863-4a5d-9e70-6957e792cea3 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:09.535553 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d633e55-fdd7-4bb2-9aeb-c3c05d8c3fad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:09.537458 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d633e55-fdd7-4bb2-9aeb-c3c05d8c3fad None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:09.652118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 142/291] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:13:09.658015 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d633e55-fdd7-4bb2-9aeb-c3c05d8c3fad None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:09.701635 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:09.712517 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:09.760290 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294caa5a-1863-4a5d-9e70-6957e792cea3 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:09.829719 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d633e55-fdd7-4bb2-9aeb-c3c05d8c3fad None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:09.833255 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a20940-a7dc-45e2-9b79-5d5c24af4f2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:09.834175 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a20940-a7dc-45e2-9b79-5d5c24af4f2d None admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:09.834464 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a20940-a7dc-45e2-9b79-5d5c24af4f2d None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:09.834747 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a20940-a7dc-45e2-9b79-5d5c24af4f2d None admin] PATH_INFO: `/v3/projects/27e0d304f3c644b2b8db92d18a19d41a/users/206645d8ea504898a8aaed9c9ac7096f/roles/d80b3a9c2e6e45739aa3056330bc9ad8` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:09.843199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a20940-a7dc-45e2-9b79-5d5c24af4f2d None admin] RBAC: Authorizing `identity:create_grant(project_id=27e0d304f3c644b2b8db92d18a19d41a, user_id=206645d8ea504898a8aaed9c9ac7096f, role_id=d80b3a9c2e6e45739aa3056330bc9ad8)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:09.844725 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a20940-a7dc-45e2-9b79-5d5c24af4f2d None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:09.872675 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 150/292] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 00:13:09 2022] PUT /identity/v3/projects/27e0d304f3c644b2b8db92d18a19d41a/users/206645d8ea504898a8aaed9c9ac7096f/roles/d80b3a9c2e6e45739aa3056330bc9ad8 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:13:09.892830 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c129ae0d-c6bd-4269-89d5-9ea022275c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:09.893774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129ae0d-c6bd-4269-89d5-9ea022275c12 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:09.894058 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129ae0d-c6bd-4269-89d5-9ea022275c12 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:09.894335 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c129ae0d-c6bd-4269-89d5-9ea022275c12 None admin] PATH_INFO: `/v3/projects/27e0d304f3c644b2b8db92d18a19d41a` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:09.895731 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129ae0d-c6bd-4269-89d5-9ea022275c12 None admin] RBAC: Authorizing `identity:get_project(project_id=27e0d304f3c644b2b8db92d18a19d41a)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:09.897246 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c129ae0d-c6bd-4269-89d5-9ea022275c12 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:09.899515 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 143/293] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:09 2022] GET /identity/v3/projects/27e0d304f3c644b2b8db92d18a19d41a => generated 302 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:09.905510 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a20940-a7dc-45e2-9b79-5d5c24af4f2d None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:10.017391 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a20940-a7dc-45e2-9b79-5d5c24af4f2d None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:10.054765 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8d70d0-6f8a-4bf3-876d-691cffaca579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:10.055885 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d70d0-6f8a-4bf3-876d-691cffaca579 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:10.056364 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d70d0-6f8a-4bf3-876d-691cffaca579 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:10.056832 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8d70d0-6f8a-4bf3-876d-691cffaca579 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:10.057885 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d70d0-6f8a-4bf3-876d-691cffaca579 None admin] RBAC: Adding query filter params (role.id=d6fedf23abb64cd494e8b49acefff423, scope.project.id=27e0d304f3c644b2b8db92d18a19d41a, user.id=251bd18d5e344c25a32b6745a48797d7) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:10.058428 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d70d0-6f8a-4bf3-876d-691cffaca579 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:10.060199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8d70d0-6f8a-4bf3-876d-691cffaca579 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:10.063918 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:10.071765 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 151/294] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:09 2022] GET /identity/v3/role_assignments?user.id=251bd18d5e344c25a32b6745a48797d7&scope.project.id=27e0d304f3c644b2b8db92d18a19d41a&role.id=d6fedf23abb64cd494e8b49acefff423 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:10.857710 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d3a2b-2626-4c13-8a87-62ae5db7f981 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:10.858240 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d3a2b-2626-4c13-8a87-62ae5db7f981 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:10.858319 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d3a2b-2626-4c13-8a87-62ae5db7f981 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:10.859945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 144/295] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:10.865038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f7507-a13d-4bd5-a18e-e571ef4d0fb7 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:10.865421 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f7507-a13d-4bd5-a18e-e571ef4d0fb7 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:10.865603 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2f7507-a13d-4bd5-a18e-e571ef4d0fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:10.882519 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-9d2f7507-a13d-4bd5-a18e-e571ef4d0fb7 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:10.883767 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-9d2f7507-a13d-4bd5-a18e-e571ef4d0fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:10.951857 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 152/296] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:10.975129 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d3a2b-2626-4c13-8a87-62ae5db7f981 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:11.076071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:11.087840 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d3a2b-2626-4c13-8a87-62ae5db7f981 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:11.124774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad4506-3764-41aa-9b98-7b5c89fbd8b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:11.125569 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad4506-3764-41aa-9b98-7b5c89fbd8b0 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:11.125850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad4506-3764-41aa-9b98-7b5c89fbd8b0 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:11.126123 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aad4506-3764-41aa-9b98-7b5c89fbd8b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:11.137263 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aad4506-3764-41aa-9b98-7b5c89fbd8b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:11.145689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-0aad4506-3764-41aa-9b98-7b5c89fbd8b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:11.145689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:11.145689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:11.145689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:11.145689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:11.145689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:11.145689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:11.145689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:11.145689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:11.145689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:11.145689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:11.145689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:11.145689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:11.145689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:11.145689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:11.145689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:11.146570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:11.146570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:11.146570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:11.146570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:11.146570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:11.146570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:11.146570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:11.146570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:11.146570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:11.146570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:11.146570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:11.146570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:11.146570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:11.146570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:11.146570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:11.146570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:11.147358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:11.147358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:11.147358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:11.147358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:11.147358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:11.147358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:11.147358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:11.147358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:11.147358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:11.147358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:11.147358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:11.147358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:11.147358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 145/297] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:13:11.154423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f7507-a13d-4bd5-a18e-e571ef4d0fb7 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:11.261825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2f7507-a13d-4bd5-a18e-e571ef4d0fb7 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:11.306345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:11.310261 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e059838-3811-44c7-8bc9-078ad8975cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:11.310941 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e059838-3811-44c7-8bc9-078ad8975cd3 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:11.311320 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e059838-3811-44c7-8bc9-078ad8975cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:11.311595 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e059838-3811-44c7-8bc9-078ad8975cd3 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:11.312377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e059838-3811-44c7-8bc9-078ad8975cd3 None admin] RBAC: Adding query filter params (name=member) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:11.312710 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e059838-3811-44c7-8bc9-078ad8975cd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:11.314931 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e059838-3811-44c7-8bc9-078ad8975cd3 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:11.324048 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 153/298] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:13:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:11.329485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad4506-3764-41aa-9b98-7b5c89fbd8b0 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:11.439938 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aad4506-3764-41aa-9b98-7b5c89fbd8b0 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:11.475096 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98183cf-72c0-479c-acac-c1f38cd1878b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:11.476002 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98183cf-72c0-479c-acac-c1f38cd1878b None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:11.476290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98183cf-72c0-479c-acac-c1f38cd1878b None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:11.476570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98183cf-72c0-479c-acac-c1f38cd1878b None admin] PATH_INFO: `/v3/users/319c1b74816e47d892ed1b5b2c3d3fcf` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:11.477792 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98183cf-72c0-479c-acac-c1f38cd1878b None admin] RBAC: Authorizing `identity:get_user(user_id=319c1b74816e47d892ed1b5b2c3d3fcf)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:11.479252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98183cf-72c0-479c-acac-c1f38cd1878b None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:11.481214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 146/299] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:11 2022] GET /identity/v3/users/319c1b74816e47d892ed1b5b2c3d3fcf => generated 293 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:11.486795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e059838-3811-44c7-8bc9-078ad8975cd3 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:11.560600 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31fe8e-dd49-4c59-896a-566ae45b7b37 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:11.560953 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31fe8e-dd49-4c59-896a-566ae45b7b37 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:11.561167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be31fe8e-dd49-4c59-896a-566ae45b7b37 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:11.562897 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 147/300] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:13:11.568580 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1f119-a986-417a-890e-a1592ea449f2 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:11.568904 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1f119-a986-417a-890e-a1592ea449f2 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:11.569143 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1f119-a986-417a-890e-a1592ea449f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:11.589902 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-e9a1f119-a986-417a-890e-a1592ea449f2 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:11.591418 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e9a1f119-a986-417a-890e-a1592ea449f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:11.606579 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e059838-3811-44c7-8bc9-078ad8975cd3 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:11.609694 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:11.646388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fb89f-d1d3-44c5-b274-8fcb14bfa1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:11.647412 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fb89f-d1d3-44c5-b274-8fcb14bfa1ff None admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:11.647738 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fb89f-d1d3-44c5-b274-8fcb14bfa1ff None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:11.648027 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fb89f-d1d3-44c5-b274-8fcb14bfa1ff None admin] PATH_INFO: `/v3/system/users/319c1b74816e47d892ed1b5b2c3d3fcf/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:11.649536 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fb89f-d1d3-44c5-b274-8fcb14bfa1ff None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=319c1b74816e47d892ed1b5b2c3d3fcf, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:11.650918 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fb89f-d1d3-44c5-b274-8fcb14bfa1ff None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:11.660596 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 154/301] 10.222.0.44 () {58 vars in 1334 bytes} [Thu Jun 16 00:13:11 2022] PUT /identity/v3/system/users/319c1b74816e47d892ed1b5b2c3d3fcf/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:13:11.662178 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d0e54-8fcb-47f2-9dae-db01b8ee7cb4 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:11.662647 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d0e54-8fcb-47f2-9dae-db01b8ee7cb4 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:11.663182 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d0e54-8fcb-47f2-9dae-db01b8ee7cb4 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:11.668716 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 155/302] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:11.670452 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c614c7b-1a62-4957-8df2-af30c0cde0f0 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:11.670812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c614c7b-1a62-4957-8df2-af30c0cde0f0 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:11.671040 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c614c7b-1a62-4957-8df2-af30c0cde0f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:11.684298 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 148/303] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:13:11.696420 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-5c614c7b-1a62-4957-8df2-af30c0cde0f0 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:11.696420 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-5c614c7b-1a62-4957-8df2-af30c0cde0f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:11.708247 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1f119-a986-417a-890e-a1592ea449f2 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:11.755774 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:11.785773 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 156/304] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:11.808350 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c614c7b-1a62-4957-8df2-af30c0cde0f0 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:11.831455 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1f119-a986-417a-890e-a1592ea449f2 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:11.878044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace669d-118b-4807-90b5-c7d7c8483013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:11.878951 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace669d-118b-4807-90b5-c7d7c8483013 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:11.879568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace669d-118b-4807-90b5-c7d7c8483013 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:11.879937 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eace669d-118b-4807-90b5-c7d7c8483013 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:11.881191 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace669d-118b-4807-90b5-c7d7c8483013 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:11.882718 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eace669d-118b-4807-90b5-c7d7c8483013 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:11.884538 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 149/305] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:11.889799 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace669d-118b-4807-90b5-c7d7c8483013 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:11.910155 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:11.938504 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c614c7b-1a62-4957-8df2-af30c0cde0f0 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:11.983491 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39053d-5949-40df-b3a9-c4eb43ecb297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:11.985111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39053d-5949-40df-b3a9-c4eb43ecb297 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:11.985886 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39053d-5949-40df-b3a9-c4eb43ecb297 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:11.986366 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d39053d-5949-40df-b3a9-c4eb43ecb297 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:11.996354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eace669d-118b-4807-90b5-c7d7c8483013 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:12.000939 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d39053d-5949-40df-b3a9-c4eb43ecb297 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:12.011337 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-6d39053d-5949-40df-b3a9-c4eb43ecb297 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:13:12.011337 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:12.011337 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:12.011337 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:12.011337 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:12.011337 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:12.011337 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:12.011337 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:12.011337 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:12.011337 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:12.011337 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:12.011337 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:12.011337 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:12.011337 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:12.011337 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:12.011337 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:12.012255 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:12.012255 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:12.012255 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:12.012255 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:12.012255 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:12.012255 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:12.012255 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:12.012255 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:12.012255 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:12.012255 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:12.012255 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:12.012255 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:12.012255 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:12.012255 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:12.012255 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:12.012255 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:12.013031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:12.013031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:12.013031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:12.013031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:12.013031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:12.013031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:12.013031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:12.013031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:12.013031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:12.013031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:12.013031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:13:12.013031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:12.019781 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 157/306] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:13:12.022168 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39053d-5949-40df-b3a9-c4eb43ecb297 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:12.041523 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df562de-ee10-4ebf-b8a5-624afc2cc948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:12.042932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df562de-ee10-4ebf-b8a5-624afc2cc948 None admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:12.043804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df562de-ee10-4ebf-b8a5-624afc2cc948 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:12.044284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df562de-ee10-4ebf-b8a5-624afc2cc948 None admin] PATH_INFO: `/v3/groups` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:12.045441 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df562de-ee10-4ebf-b8a5-624afc2cc948 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:12.047941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df562de-ee10-4ebf-b8a5-624afc2cc948 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:12.070369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 150/307] 10.222.0.44 () {60 vars in 1134 bytes} [Thu Jun 16 00:13:11 2022] POST /identity/v3/groups => generated 229 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:13:12.083704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:12.147450 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d39053d-5949-40df-b3a9-c4eb43ecb297 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:12.186264 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddeb98-7a55-40b4-9a1b-8c7a90529378 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:12.187305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddeb98-7a55-40b4-9a1b-8c7a90529378 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:12.187821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddeb98-7a55-40b4-9a1b-8c7a90529378 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:12.188298 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddeb98-7a55-40b4-9a1b-8c7a90529378 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:12.189285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddeb98-7a55-40b4-9a1b-8c7a90529378 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:12.189794 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddeb98-7a55-40b4-9a1b-8c7a90529378 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:12.192058 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ddeb98-7a55-40b4-9a1b-8c7a90529378 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:12.207849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 158/308] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:13:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:12.209918 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df562de-ee10-4ebf-b8a5-624afc2cc948 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:12.301045 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:12.324857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df562de-ee10-4ebf-b8a5-624afc2cc948 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:12.355955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55112628-92e0-4df5-862e-45bf817099cf None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:12.356281 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55112628-92e0-4df5-862e-45bf817099cf None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:12.356587 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55112628-92e0-4df5-862e-45bf817099cf None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:12.361776 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 159/309] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:13:12.363000 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d78f0-721b-4252-8501-fa228c65564f None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:12.363868 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d78f0-721b-4252-8501-fa228c65564f None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:12.364152 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1d78f0-721b-4252-8501-fa228c65564f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:12.364522 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0659192-ee04-424c-b9da-a3a682508be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:12.365643 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0659192-ee04-424c-b9da-a3a682508be5 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:12.366132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0659192-ee04-424c-b9da-a3a682508be5 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:12.366600 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0659192-ee04-424c-b9da-a3a682508be5 None admin] PATH_INFO: `/v3/users/5c7f7124a75e43888fa75767d33ee2ca` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:12.381487 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-0c1d78f0-721b-4252-8501-fa228c65564f None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:12.382650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0659192-ee04-424c-b9da-a3a682508be5 None admin] RBAC: Authorizing `identity:get_user(user_id=5c7f7124a75e43888fa75767d33ee2ca)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:12.382785 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-0c1d78f0-721b-4252-8501-fa228c65564f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:12.384521 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0659192-ee04-424c-b9da-a3a682508be5 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:12.386890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 151/310] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:12 2022] GET /identity/v3/users/5c7f7124a75e43888fa75767d33ee2ca => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:12.393067 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0659192-ee04-424c-b9da-a3a682508be5 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:12.459248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 160/311] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:13:12.481866 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d78f0-721b-4252-8501-fa228c65564f None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:12.500399 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0659192-ee04-424c-b9da-a3a682508be5 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:12.523634 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:12.540807 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3b585-8e3c-473d-b78b-3d0650f5e635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:12.541813 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3b585-8e3c-473d-b78b-3d0650f5e635 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:12.542291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3b585-8e3c-473d-b78b-3d0650f5e635 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:12.542801 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c3b585-8e3c-473d-b78b-3d0650f5e635 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:12.544040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3b585-8e3c-473d-b78b-3d0650f5e635 None admin] RBAC: Adding query filter params (role.id=d80b3a9c2e6e45739aa3056330bc9ad8, user.id=5c7f7124a75e43888fa75767d33ee2ca, scope.system=all) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:12.544571 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3b585-8e3c-473d-b78b-3d0650f5e635 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:12.546305 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c3b585-8e3c-473d-b78b-3d0650f5e635 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:12.552824 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 152/312] 10.222.0.44 () {56 vars in 1308 bytes} [Thu Jun 16 00:13:12 2022] GET /identity/v3/role_assignments?user.id=5c7f7124a75e43888fa75767d33ee2ca&scope.system=all&role.id=d80b3a9c2e6e45739aa3056330bc9ad8 => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:12.553096 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:12.594447 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1d78f0-721b-4252-8501-fa228c65564f None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:12.635119 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e46c60-8048-47e5-bcec-ccc64184517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:12.636210 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e46c60-8048-47e5-bcec-ccc64184517f None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:12.636593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e46c60-8048-47e5-bcec-ccc64184517f None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:12.636970 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e46c60-8048-47e5-bcec-ccc64184517f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:12.650172 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e46c60-8048-47e5-bcec-ccc64184517f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:12.658471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-39e46c60-8048-47e5-bcec-ccc64184517f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:13:12.658471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:12.658471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:12.658471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:12.658471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:12.658471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:12.658471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:12.658471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:12.658471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:12.658471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:12.658471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:12.658471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:12.658471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:12.658471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:12.658471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:12.658471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:12.659641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:12.659641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:12.659641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:12.659641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:12.659641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:12.659641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:12.659641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:12.659641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:12.659641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:12.659641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:12.659641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:12.659641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:12.659641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:12.659641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:12.659641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:12.659641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:12.661650 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:12.661650 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:12.661650 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:12.661650 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:12.661650 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:12.661650 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:12.661650 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:12.661650 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:12.661650 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:12.661650 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:12.661650 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:13:12.661650 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:12.663229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 161/313] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:12.667980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3b585-8e3c-473d-b78b-3d0650f5e635 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:12.772802 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c3b585-8e3c-473d-b78b-3d0650f5e635 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:12.807087 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0e59b-e67c-4bc3-a9d3-8d7713d2f82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:12.807807 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0e59b-e67c-4bc3-a9d3-8d7713d2f82e None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:12.808092 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0e59b-e67c-4bc3-a9d3-8d7713d2f82e None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:12.808367 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e0e59b-e67c-4bc3-a9d3-8d7713d2f82e None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:12.809136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0e59b-e67c-4bc3-a9d3-8d7713d2f82e None admin] RBAC: Adding query filter params (name=reader) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:12.809446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0e59b-e67c-4bc3-a9d3-8d7713d2f82e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:12.810899 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e0e59b-e67c-4bc3-a9d3-8d7713d2f82e None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:12.821489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 153/314] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:13:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:12.827069 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e46c60-8048-47e5-bcec-ccc64184517f None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:12.930385 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:12.935116 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e46c60-8048-47e5-bcec-ccc64184517f None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:12.971146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b4fbc-2c24-447d-b546-3e90c27bd203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:12.972094 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b4fbc-2c24-447d-b546-3e90c27bd203 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:12.972380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b4fbc-2c24-447d-b546-3e90c27bd203 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:12.972689 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b4fbc-2c24-447d-b546-3e90c27bd203 None admin] PATH_INFO: `/v3/users/206645d8ea504898a8aaed9c9ac7096f` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:12.973913 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b4fbc-2c24-447d-b546-3e90c27bd203 None admin] RBAC: Authorizing `identity:get_user(user_id=206645d8ea504898a8aaed9c9ac7096f)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:12.975378 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b4fbc-2c24-447d-b546-3e90c27bd203 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:12.977360 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 162/315] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:12 2022] GET /identity/v3/users/206645d8ea504898a8aaed9c9ac7096f => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:12.982834 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0e59b-e67c-4bc3-a9d3-8d7713d2f82e None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:13.047840 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:13.089374 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e0e59b-e67c-4bc3-a9d3-8d7713d2f82e None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:13.123068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221dca0-4eec-4452-812d-9abe4fba94dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:13.123749 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221dca0-4eec-4452-812d-9abe4fba94dd None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:13.124036 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221dca0-4eec-4452-812d-9abe4fba94dd None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:13.124312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5221dca0-4eec-4452-812d-9abe4fba94dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:13.196825 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221dca0-4eec-4452-812d-9abe4fba94dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:13.198353 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5221dca0-4eec-4452-812d-9abe4fba94dd None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:13.260326 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:13.305027 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 154/316] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:13:13.310685 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b4fbc-2c24-447d-b546-3e90c27bd203 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:13.419218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b4fbc-2c24-447d-b546-3e90c27bd203 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:13.454310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f5fa07-ee20-448d-b818-1e4724eb9e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:13.455497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5fa07-ee20-448d-b818-1e4724eb9e96 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:13.456036 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5fa07-ee20-448d-b818-1e4724eb9e96 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:13.456508 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f5fa07-ee20-448d-b818-1e4724eb9e96 None admin] PATH_INFO: `/v3/projects/27e0d304f3c644b2b8db92d18a19d41a` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:13.457978 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5fa07-ee20-448d-b818-1e4724eb9e96 None admin] RBAC: Authorizing `identity:get_project(project_id=27e0d304f3c644b2b8db92d18a19d41a)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:13.459662 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f5fa07-ee20-448d-b818-1e4724eb9e96 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:13.461662 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 163/317] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:13 2022] GET /identity/v3/projects/27e0d304f3c644b2b8db92d18a19d41a => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:13.467841 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221dca0-4eec-4452-812d-9abe4fba94dd None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:13.567932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5221dca0-4eec-4452-812d-9abe4fba94dd None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:13.601377 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99000313-4fc3-48cd-9e9f-1ba0abc6fa97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:13.602030 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99000313-4fc3-48cd-9e9f-1ba0abc6fa97 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:13.602317 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99000313-4fc3-48cd-9e9f-1ba0abc6fa97 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:13.602594 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99000313-4fc3-48cd-9e9f-1ba0abc6fa97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:13.603424 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99000313-4fc3-48cd-9e9f-1ba0abc6fa97 None admin] RBAC: Adding query filter params (role.id=d80b3a9c2e6e45739aa3056330bc9ad8, scope.project.id=27e0d304f3c644b2b8db92d18a19d41a, user.id=206645d8ea504898a8aaed9c9ac7096f) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:13.603774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99000313-4fc3-48cd-9e9f-1ba0abc6fa97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:13.605233 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99000313-4fc3-48cd-9e9f-1ba0abc6fa97 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:13.611416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 155/318] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:13 2022] GET /identity/v3/role_assignments?user.id=206645d8ea504898a8aaed9c9ac7096f&scope.project.id=27e0d304f3c644b2b8db92d18a19d41a&role.id=d80b3a9c2e6e45739aa3056330bc9ad8 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:13.888714 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ec4af-6155-447a-9307-fb11e01410f8 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:13.889000 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ec4af-6155-447a-9307-fb11e01410f8 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:13.889210 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ec4af-6155-447a-9307-fb11e01410f8 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:13.890636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 164/319] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:13.895708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad4054-5201-4431-bc5b-acdb5424f20b None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:13.895993 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad4054-5201-4431-bc5b-acdb5424f20b None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:13.896274 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ad4054-5201-4431-bc5b-acdb5424f20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:13.913385 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-b8ad4054-5201-4431-bc5b-acdb5424f20b None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:13.914574 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-b8ad4054-5201-4431-bc5b-acdb5424f20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:13.935108 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:13.982277 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 156/320] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:14.006333 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ec4af-6155-447a-9307-fb11e01410f8 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:14.040597 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:14.107277 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ec4af-6155-447a-9307-fb11e01410f8 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:14.141715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d185b-588f-4088-991e-0f434bfc1d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:14.142449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d185b-588f-4088-991e-0f434bfc1d25 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:14.142732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d185b-588f-4088-991e-0f434bfc1d25 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:14.143006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037d185b-588f-4088-991e-0f434bfc1d25 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:14.153104 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037d185b-588f-4088-991e-0f434bfc1d25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:14.160914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-037d185b-588f-4088-991e-0f434bfc1d25 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:14.160914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:14.160914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:14.160914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:14.160914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:14.160914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:14.160914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:14.160914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:14.160914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:14.160914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:14.160914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:14.160914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:14.160914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:14.160914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:14.160914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:14.160914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:14.161790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:14.161790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:14.161790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:14.161790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:14.161790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:14.161790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:14.161790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:14.161790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:14.161790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:14.161790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:14.161790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:14.161790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:14.161790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:14.161790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:14.161790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:14.161790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:14.162651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:14.162651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:14.162651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:14.162651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:14.162651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:14.162651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:14.162651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:14.162651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:14.162651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:14.162651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:14.162651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:14.162651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:14.166822 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 165/321] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:14.167844 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad4054-5201-4431-bc5b-acdb5424f20b None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:14.266942 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ad4054-5201-4431-bc5b-acdb5424f20b None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:14.303597 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5077a8-1b9b-45d5-b3bb-1ad38e17e92f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:14.304330 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5077a8-1b9b-45d5-b3bb-1ad38e17e92f None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:14.304613 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5077a8-1b9b-45d5-b3bb-1ad38e17e92f None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:14.304887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5077a8-1b9b-45d5-b3bb-1ad38e17e92f None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:14.305647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5077a8-1b9b-45d5-b3bb-1ad38e17e92f None admin] RBAC: Adding query filter params (name=member) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:14.305956 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5077a8-1b9b-45d5-b3bb-1ad38e17e92f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:14.307382 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5077a8-1b9b-45d5-b3bb-1ad38e17e92f None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:14.317474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 157/322] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:13:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:14.322783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d185b-588f-4088-991e-0f434bfc1d25 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:14.354416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09e8c5-1366-43f4-9576-e08f7ca984b5 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:14.354702 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09e8c5-1366-43f4-9576-e08f7ca984b5 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:14.354983 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b09e8c5-1366-43f4-9576-e08f7ca984b5 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:14.356518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 158/323] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:13:14.361176 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3dfb8-42b1-4a06-9de4-14f1c40e22b5 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:14.361463 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3dfb8-42b1-4a06-9de4-14f1c40e22b5 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:14.361736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e3dfb8-42b1-4a06-9de4-14f1c40e22b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:14.380405 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-a2e3dfb8-42b1-4a06-9de4-14f1c40e22b5 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:14.381582 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a2e3dfb8-42b1-4a06-9de4-14f1c40e22b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:14.396086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:14.426636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:14.435896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037d185b-588f-4088-991e-0f434bfc1d25 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:14.451070 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 159/324] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:14.470992 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf5a8a-c2be-4754-98a5-b0dd767c5bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:14.471893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf5a8a-c2be-4754-98a5-b0dd767c5bad None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:14.472381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf5a8a-c2be-4754-98a5-b0dd767c5bad None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:14.472553 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf5a8a-c2be-4754-98a5-b0dd767c5bad None admin] PATH_INFO: `/v3/users/319c1b74816e47d892ed1b5b2c3d3fcf` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:14.473306 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3dfb8-42b1-4a06-9de4-14f1c40e22b5 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:14.473781 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf5a8a-c2be-4754-98a5-b0dd767c5bad None admin] RBAC: Authorizing `identity:get_user(user_id=319c1b74816e47d892ed1b5b2c3d3fcf)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:14.475229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf5a8a-c2be-4754-98a5-b0dd767c5bad None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:14.481483 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 166/325] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:14 2022] GET /identity/v3/users/319c1b74816e47d892ed1b5b2c3d3fcf => generated 293 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:14.482413 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf5a8a-c2be-4754-98a5-b0dd767c5bad None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:14.577190 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e3dfb8-42b1-4a06-9de4-14f1c40e22b5 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:14.599309 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf5a8a-c2be-4754-98a5-b0dd767c5bad None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:14.613984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b12fc9-d180-47ab-b35a-f705e53565f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:14.614787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b12fc9-d180-47ab-b35a-f705e53565f4 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:14.615078 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b12fc9-d180-47ab-b35a-f705e53565f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:14.615359 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b12fc9-d180-47ab-b35a-f705e53565f4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:14.616567 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b12fc9-d180-47ab-b35a-f705e53565f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:14.618014 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b12fc9-d180-47ab-b35a-f705e53565f4 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:14.624003 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 160/326] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:14.624912 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b12fc9-d180-47ab-b35a-f705e53565f4 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:14.638084 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9421a458-cbf4-4620-b9b5-7448cf7e37e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:14.638903 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421a458-cbf4-4620-b9b5-7448cf7e37e2 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:14.639185 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421a458-cbf4-4620-b9b5-7448cf7e37e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:14.639459 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9421a458-cbf4-4620-b9b5-7448cf7e37e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:14.640340 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421a458-cbf4-4620-b9b5-7448cf7e37e2 None admin] RBAC: Adding query filter params (role.id=d6fedf23abb64cd494e8b49acefff423, user.id=319c1b74816e47d892ed1b5b2c3d3fcf, scope.system=all) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:14.640655 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421a458-cbf4-4620-b9b5-7448cf7e37e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:14.642080 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9421a458-cbf4-4620-b9b5-7448cf7e37e2 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:14.644016 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:14.656243 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 167/327] 10.222.0.44 () {56 vars in 1308 bytes} [Thu Jun 16 00:13:14 2022] GET /identity/v3/role_assignments?user.id=319c1b74816e47d892ed1b5b2c3d3fcf&scope.system=all&role.id=d6fedf23abb64cd494e8b49acefff423 => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:14.740057 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b12fc9-d180-47ab-b35a-f705e53565f4 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:14.778173 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1db01-c2b6-4087-9790-e11235385188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:14.778862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1db01-c2b6-4087-9790-e11235385188 None admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:14.779149 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1db01-c2b6-4087-9790-e11235385188 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:14.779427 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec1db01-c2b6-4087-9790-e11235385188 None admin] PATH_INFO: `/v3/groups` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:14.780183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1db01-c2b6-4087-9790-e11235385188 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:14.784509 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec1db01-c2b6-4087-9790-e11235385188 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:14.790802 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315ad07-75c5-44aa-adfe-093d4c027ede None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:14.791120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315ad07-75c5-44aa-adfe-093d4c027ede None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:14.791356 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c315ad07-75c5-44aa-adfe-093d4c027ede None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:14.793178 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 168/328] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:13:14.800010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3ac81-3b1f-4886-89bb-38d19e94d6e2 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:14.800302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3ac81-3b1f-4886-89bb-38d19e94d6e2 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:14.801329 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d3ac81-3b1f-4886-89bb-38d19e94d6e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:14.815665 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 161/329] 10.222.0.44 () {60 vars in 1134 bytes} [Thu Jun 16 00:13:14 2022] POST /identity/v3/groups => generated 226 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:13:14.829782 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-42d3ac81-3b1f-4886-89bb-38d19e94d6e2 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:14.830999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-42d3ac81-3b1f-4886-89bb-38d19e94d6e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:14.849387 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:14.915714 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 169/330] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:13:14.938510 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1db01-c2b6-4087-9790-e11235385188 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:15.018099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:15.044058 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec1db01-c2b6-4087-9790-e11235385188 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:15.077303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c83898-07d4-42ae-9582-0ab3d2b4ddf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:15.078105 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c83898-07d4-42ae-9582-0ab3d2b4ddf9 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:15.078387 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c83898-07d4-42ae-9582-0ab3d2b4ddf9 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:15.078655 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c83898-07d4-42ae-9582-0ab3d2b4ddf9 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:15.089681 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c83898-07d4-42ae-9582-0ab3d2b4ddf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:15.097389 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-04c83898-07d4-42ae-9582-0ab3d2b4ddf9 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:13:15.097389 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:15.097389 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:15.097389 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:15.097389 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:15.097389 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:15.097389 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:15.097389 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:15.097389 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:15.097389 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:15.097389 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:15.097389 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:15.097389 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:15.097389 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:15.097389 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:15.097389 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:15.098303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:15.098303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:15.098303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:15.098303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:15.098303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:15.098303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:15.098303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:15.098303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:15.098303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:15.098303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:15.098303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:15.098303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:15.098303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:15.098303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:15.098303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:15.098303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:15.099086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:15.099086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:15.099086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:15.099086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:15.099086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:15.099086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:15.099086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:15.099086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:15.099086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:15.099086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:15.099086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:13:15.099086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:15.099086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 162/331] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:15.104784 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3ac81-3b1f-4886-89bb-38d19e94d6e2 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:15.208048 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d3ac81-3b1f-4886-89bb-38d19e94d6e2 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:15.245179 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531ef79-3a57-4fe1-9acd-1ac2cabde3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:15.245854 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531ef79-3a57-4fe1-9acd-1ac2cabde3b4 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:15.246137 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531ef79-3a57-4fe1-9acd-1ac2cabde3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:15.246414 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e531ef79-3a57-4fe1-9acd-1ac2cabde3b4 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:15.247165 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531ef79-3a57-4fe1-9acd-1ac2cabde3b4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:15.247477 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531ef79-3a57-4fe1-9acd-1ac2cabde3b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:15.248882 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e531ef79-3a57-4fe1-9acd-1ac2cabde3b4 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:15.258559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 170/332] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:13:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:15.264314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c83898-07d4-42ae-9582-0ab3d2b4ddf9 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:15.377142 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c83898-07d4-42ae-9582-0ab3d2b4ddf9 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:15.416755 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b23b28-c2a5-443c-b161-befc6db1a5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:15.418025 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b23b28-c2a5-443c-b161-befc6db1a5de None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:15.418509 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b23b28-c2a5-443c-b161-befc6db1a5de None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:15.418998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b23b28-c2a5-443c-b161-befc6db1a5de None admin] PATH_INFO: `/v3/users/5c7f7124a75e43888fa75767d33ee2ca` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:15.421389 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b23b28-c2a5-443c-b161-befc6db1a5de None admin] RBAC: Authorizing `identity:get_user(user_id=5c7f7124a75e43888fa75767d33ee2ca)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:15.423083 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b23b28-c2a5-443c-b161-befc6db1a5de None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:15.425384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 163/333] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:15 2022] GET /identity/v3/users/5c7f7124a75e43888fa75767d33ee2ca => generated 293 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:15.432004 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531ef79-3a57-4fe1-9acd-1ac2cabde3b4 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:15.449665 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:15.550276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e531ef79-3a57-4fe1-9acd-1ac2cabde3b4 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:15.586000 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c33f43-ce2e-45f1-b9ee-2d23065f6d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:15.586922 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c33f43-ce2e-45f1-b9ee-2d23065f6d87 None admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:15.587207 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c33f43-ce2e-45f1-b9ee-2d23065f6d87 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:15.587483 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c33f43-ce2e-45f1-b9ee-2d23065f6d87 None admin] PATH_INFO: `/v3/system/users/5c7f7124a75e43888fa75767d33ee2ca/roles/d80b3a9c2e6e45739aa3056330bc9ad8` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:15.589019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c33f43-ce2e-45f1-b9ee-2d23065f6d87 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5c7f7124a75e43888fa75767d33ee2ca, role_id=d80b3a9c2e6e45739aa3056330bc9ad8)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:15.590384 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c33f43-ce2e-45f1-b9ee-2d23065f6d87 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:15.601641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 171/334] 10.222.0.44 () {58 vars in 1334 bytes} [Thu Jun 16 00:13:15 2022] PUT /identity/v3/system/users/5c7f7124a75e43888fa75767d33ee2ca/roles/d80b3a9c2e6e45739aa3056330bc9ad8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:13:17.670313 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201bd73-d65f-47dd-86a8-dec70167659a None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:17.671148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201bd73-d65f-47dd-86a8-dec70167659a None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:17.671568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0201bd73-d65f-47dd-86a8-dec70167659a None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:17.673370 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 164/335] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:17.679506 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bd41a-9312-48df-ba56-18837a0973a6 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:17.679943 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bd41a-9312-48df-ba56-18837a0973a6 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:17.680093 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3bd41a-9312-48df-ba56-18837a0973a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:17.695049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843ef4c-3828-425b-b226-e74409098451 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:17.695679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843ef4c-3828-425b-b226-e74409098451 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:17.696150 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843ef4c-3828-425b-b226-e74409098451 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:17.697966 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 165/336] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:17.702584 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b320ff-b20a-4c6a-98a2-596298123cd9 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:17.703083 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b320ff-b20a-4c6a-98a2-596298123cd9 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:17.703567 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b320ff-b20a-4c6a-98a2-596298123cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:17.707710 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-1f3bd41a-9312-48df-ba56-18837a0973a6 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:17.708925 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-1f3bd41a-9312-48df-ba56-18837a0973a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:17.713674 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:17.728842 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-49b320ff-b20a-4c6a-98a2-596298123cd9 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:17.730034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-49b320ff-b20a-4c6a-98a2-596298123cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:17.858268 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 172/337] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:17.870489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 166/338] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:17.905132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3bd41a-9312-48df-ba56-18837a0973a6 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:17.907335 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b320ff-b20a-4c6a-98a2-596298123cd9 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:17.918358 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:18.079427 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3bd41a-9312-48df-ba56-18837a0973a6 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:18.132068 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d5789-1244-4b86-a076-5b1fc1a8ec07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:18.132895 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d5789-1244-4b86-a076-5b1fc1a8ec07 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:18.133181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d5789-1244-4b86-a076-5b1fc1a8ec07 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:18.133458 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d5789-1244-4b86-a076-5b1fc1a8ec07 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:18.136111 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b320ff-b20a-4c6a-98a2-596298123cd9 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:18.155774 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447d5789-1244-4b86-a076-5b1fc1a8ec07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:18.167054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-447d5789-1244-4b86-a076-5b1fc1a8ec07 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:13:18.167054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:18.167054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:18.167054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:18.167054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:18.167054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:18.167054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:18.167054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:18.167054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:18.167054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:18.167054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:18.167054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:18.167054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:18.167054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:18.167054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:18.167054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:18.167997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:18.167997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:18.167997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:18.167997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:18.167997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:18.167997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:18.167997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:18.167997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:18.167997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:18.167997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:18.167997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:18.167997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:18.167997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:18.167997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:18.167997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:18.167997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:18.168781 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:18.168781 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:18.168781 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:18.168781 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:18.168781 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:18.168781 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:18.168781 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:18.168781 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:18.168781 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:18.168781 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:18.168781 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:13:18.168781 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:18.169836 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 173/339] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 00:13:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:18.174014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8c844-d242-4869-b24f-e15b752804d0 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:18.177153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8c844-d242-4869-b24f-e15b752804d0 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:18.177436 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f8c844-d242-4869-b24f-e15b752804d0 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:18.178804 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 174/340] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:18.179524 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8c844-d242-4869-b24f-e15b752804d0 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:18.203097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a56880f-ad32-4e4b-b4fd-f8968d7773a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:18.203927 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56880f-ad32-4e4b-b4fd-f8968d7773a5 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:18.204210 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56880f-ad32-4e4b-b4fd-f8968d7773a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:18.204485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a56880f-ad32-4e4b-b4fd-f8968d7773a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:18.208186 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:18.227410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a56880f-ad32-4e4b-b4fd-f8968d7773a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:18.235477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-6a56880f-ad32-4e4b-b4fd-f8968d7773a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:18.235477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:18.235477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:18.235477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:18.235477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:18.235477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:18.235477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:18.235477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:18.235477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:18.235477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:18.235477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:18.235477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:18.235477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:18.235477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:18.235477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:18.235477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:18.236454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:18.236454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:18.236454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:18.236454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:18.236454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:18.236454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:18.236454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:18.236454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:18.236454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:18.236454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:18.236454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:18.236454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:18.236454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:18.236454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:18.236454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:18.236454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:18.237229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:18.237229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:18.237229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:18.237229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:18.237229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:18.237229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:18.237229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:18.237229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:18.237229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:18.237229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:18.237229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:18.237229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:18.238418 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 167/341] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:13:18.246332 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ea4ab-0b6c-4978-bae1-04cae08855ef None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:18.246635 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ea4ab-0b6c-4978-bae1-04cae08855ef None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:18.246918 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991ea4ab-0b6c-4978-bae1-04cae08855ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:18.283239 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-991ea4ab-0b6c-4978-bae1-04cae08855ef None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:18.284463 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-991ea4ab-0b6c-4978-bae1-04cae08855ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:18.326682 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:18.398873 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f8c844-d242-4869-b24f-e15b752804d0 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:18.421383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 168/342] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:18.422992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ea4ab-0b6c-4978-bae1-04cae08855ef None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:18.462606 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39895b0-78ff-4284-b458-58b04a3939c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:18.463646 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39895b0-78ff-4284-b458-58b04a3939c2 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:18.464128 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39895b0-78ff-4284-b458-58b04a3939c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:18.464622 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39895b0-78ff-4284-b458-58b04a3939c2 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:18.465581 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39895b0-78ff-4284-b458-58b04a3939c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:18.466082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39895b0-78ff-4284-b458-58b04a3939c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:18.467680 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39895b0-78ff-4284-b458-58b04a3939c2 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:18.480252 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 175/343] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:18.481438 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39895b0-78ff-4284-b458-58b04a3939c2 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:18.539981 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991ea4ab-0b6c-4978-bae1-04cae08855ef None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:18.567725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:18.583412 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f802a-d69e-4b78-9014-9c0215f9813b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:18.584455 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f802a-d69e-4b78-9014-9c0215f9813b None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:18.584946 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f802a-d69e-4b78-9014-9c0215f9813b None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:18.585391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818f802a-d69e-4b78-9014-9c0215f9813b None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:18.586351 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f802a-d69e-4b78-9014-9c0215f9813b None admin] RBAC: Adding query filter params (name=member) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:18.586845 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f802a-d69e-4b78-9014-9c0215f9813b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:18.588501 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818f802a-d69e-4b78-9014-9c0215f9813b None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:18.599884 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 169/344] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:13:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:18.601108 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f802a-d69e-4b78-9014-9c0215f9813b None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:18.633523 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39895b0-78ff-4284-b458-58b04a3939c2 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:18.682249 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:18.693144 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eca991-c364-4979-9ceb-bfdc3f832134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:18.694077 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eca991-c364-4979-9ceb-bfdc3f832134 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:18.694359 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eca991-c364-4979-9ceb-bfdc3f832134 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:18.694635 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eca991-c364-4979-9ceb-bfdc3f832134 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:18.708063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eca991-c364-4979-9ceb-bfdc3f832134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:18.719370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-33eca991-c364-4979-9ceb-bfdc3f832134 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:18.719370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:18.719370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:18.719370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:18.719370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:18.719370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:18.719370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:18.719370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:18.719370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:18.719370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:18.719370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:18.719370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:18.719370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:18.719370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:18.719370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:18.719370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:18.720345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:18.720345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:18.720345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:18.720345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:18.720345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:18.720345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:18.720345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:18.720345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:18.720345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:18.720345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:18.720345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:18.720345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:18.720345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:18.720345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:18.720345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:18.720345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:18.721195 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:18.721195 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:18.721195 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:18.721195 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:18.721195 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:18.721195 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:18.721195 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:18.721195 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:18.721195 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:18.721195 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:18.721195 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:18.721195 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:18.721823 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 176/345] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:18.722362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eca991-c364-4979-9ceb-bfdc3f832134 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:18.744849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818f802a-d69e-4b78-9014-9c0215f9813b None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:18.786797 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9625e9-066f-424b-86b8-8e6c80303f55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:18.787939 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9625e9-066f-424b-86b8-8e6c80303f55 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:18.788519 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9625e9-066f-424b-86b8-8e6c80303f55 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:18.788807 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9625e9-066f-424b-86b8-8e6c80303f55 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:18.854907 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eca991-c364-4979-9ceb-bfdc3f832134 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:18.866672 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:18.884627 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9625e9-066f-424b-86b8-8e6c80303f55 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:18.886128 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9625e9-066f-424b-86b8-8e6c80303f55 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:18.902205 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c775fd-2f71-4437-839e-d82a358f6afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:18.902868 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c775fd-2f71-4437-839e-d82a358f6afb None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:18.903157 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c775fd-2f71-4437-839e-d82a358f6afb None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:18.903439 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c775fd-2f71-4437-839e-d82a358f6afb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:18.975832 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:18.994409 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c775fd-2f71-4437-839e-d82a358f6afb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:18.995946 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c775fd-2f71-4437-839e-d82a358f6afb None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:19.012595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 170/346] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:13:19.014251 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee401b00-d266-48b2-be8c-c4d03705f6dd None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:19.014550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee401b00-d266-48b2-be8c-c4d03705f6dd None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:19.014832 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee401b00-d266-48b2-be8c-c4d03705f6dd None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:19.016418 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 171/347] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:19.017127 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee401b00-d266-48b2-be8c-c4d03705f6dd None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:19.122831 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:19.124552 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 177/348] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:13:19.126282 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb87d8-e957-4c64-a264-950ef150a863 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:19.127205 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb87d8-e957-4c64-a264-950ef150a863 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:19.127716 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96eb87d8-e957-4c64-a264-950ef150a863 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:19.130086 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 178/349] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:19.130963 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb87d8-e957-4c64-a264-950ef150a863 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:19.154259 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee401b00-d266-48b2-be8c-c4d03705f6dd None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:19.200963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9fa765-c491-4e98-b8a2-c2c79c77805c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:19.202275 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fa765-c491-4e98-b8a2-c2c79c77805c None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:19.202840 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fa765-c491-4e98-b8a2-c2c79c77805c None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:19.203319 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9fa765-c491-4e98-b8a2-c2c79c77805c None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:19.204336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fa765-c491-4e98-b8a2-c2c79c77805c None admin] RBAC: Adding query filter params (name=member) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:19.204852 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fa765-c491-4e98-b8a2-c2c79c77805c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:19.206580 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9fa765-c491-4e98-b8a2-c2c79c77805c None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:19.217666 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 172/350] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:13:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:19.219448 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245887fc-ba02-4528-95c5-81dd38cfd9fe None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:19.219955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245887fc-ba02-4528-95c5-81dd38cfd9fe None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:19.220463 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245887fc-ba02-4528-95c5-81dd38cfd9fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:19.239764 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-245887fc-ba02-4528-95c5-81dd38cfd9fe None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:19.241354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-245887fc-ba02-4528-95c5-81dd38cfd9fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:19.253687 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:19.268973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96eb87d8-e957-4c64-a264-950ef150a863 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:19.314448 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2590d182-1d36-4364-b677-ac2c609bf0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:19.315358 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590d182-1d36-4364-b677-ac2c609bf0d8 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:19.317482 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590d182-1d36-4364-b677-ac2c609bf0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:19.317482 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2590d182-1d36-4364-b677-ac2c609bf0d8 None admin] PATH_INFO: `/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:19.317650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 173/351] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:19.317650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245887fc-ba02-4528-95c5-81dd38cfd9fe None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:19.324509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590d182-1d36-4364-b677-ac2c609bf0d8 None admin] RBAC: Authorizing `identity:get_project(project_id=b5d7f8028eb1486d8dbc58cd5d98a225)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:19.326007 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2590d182-1d36-4364-b677-ac2c609bf0d8 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:19.327940 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 179/352] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:19 2022] GET /identity/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225 => generated 298 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:19.329115 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8dc51-b47e-41d2-98dd-e4b7c1cd8e5e None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:19.329412 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8dc51-b47e-41d2-98dd-e4b7c1cd8e5e None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:19.329694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8dc51-b47e-41d2-98dd-e4b7c1cd8e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:19.355267 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-b7a8dc51-b47e-41d2-98dd-e4b7c1cd8e5e None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:19.357092 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-b7a8dc51-b47e-41d2-98dd-e4b7c1cd8e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:19.420971 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:19.445501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 180/353] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:19.446818 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8dc51-b47e-41d2-98dd-e4b7c1cd8e5e None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:19.448734 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245887fc-ba02-4528-95c5-81dd38cfd9fe None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:19.496562 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ea61e-21df-427d-bb5c-dd7637e25d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:19.497904 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ea61e-21df-427d-bb5c-dd7637e25d02 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:19.498380 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ea61e-21df-427d-bb5c-dd7637e25d02 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:19.498843 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ea61e-21df-427d-bb5c-dd7637e25d02 None admin] PATH_INFO: `/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:19.500293 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ea61e-21df-427d-bb5c-dd7637e25d02 None admin] RBAC: Authorizing `identity:get_project(project_id=b5d7f8028eb1486d8dbc58cd5d98a225)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:19.501732 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74ea61e-21df-427d-bb5c-dd7637e25d02 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:19.503583 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 174/354] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:19 2022] GET /identity/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:19.507765 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ea61e-21df-427d-bb5c-dd7637e25d02 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:19.559937 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:19.583466 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8dc51-b47e-41d2-98dd-e4b7c1cd8e5e None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:19.626805 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5471464-2a8d-48b7-999d-43d0501ae1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:19.627939 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5471464-2a8d-48b7-999d-43d0501ae1f3 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:19.628228 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5471464-2a8d-48b7-999d-43d0501ae1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:19.628787 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5471464-2a8d-48b7-999d-43d0501ae1f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:19.640000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ea61e-21df-427d-bb5c-dd7637e25d02 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:19.687175 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290ac9e-ba12-4966-b787-8f546550dffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:19.688084 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290ac9e-ba12-4966-b787-8f546550dffb None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:19.688373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290ac9e-ba12-4966-b787-8f546550dffb None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:19.688652 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290ac9e-ba12-4966-b787-8f546550dffb None admin] PATH_INFO: `/v3/groups/38ff84729e1b473ea8f8d7b6177f32f1` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:19.695653 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290ac9e-ba12-4966-b787-8f546550dffb None admin] RBAC: Authorizing `identity:get_group(group_id=38ff84729e1b473ea8f8d7b6177f32f1)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:19.697105 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5290ac9e-ba12-4966-b787-8f546550dffb None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:19.699029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 175/355] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 00:13:19 2022] GET /identity/v3/groups/38ff84729e1b473ea8f8d7b6177f32f1 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:19.699638 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290ac9e-ba12-4966-b787-8f546550dffb None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:19.709742 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5471464-2a8d-48b7-999d-43d0501ae1f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:19.711215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5471464-2a8d-48b7-999d-43d0501ae1f3 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:19.717123 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:19.823964 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:19.824146 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290ac9e-ba12-4966-b787-8f546550dffb None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:19.839449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 181/356] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:13:19.839755 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5471464-2a8d-48b7-999d-43d0501ae1f3 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:19.868216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5404e-97c0-4eeb-b1b4-4c3071359ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:19.869328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5404e-97c0-4eeb-b1b4-4c3071359ba2 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:19.869685 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5404e-97c0-4eeb-b1b4-4c3071359ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:19.869965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5404e-97c0-4eeb-b1b4-4c3071359ba2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:19.886478 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5404e-97c0-4eeb-b1b4-4c3071359ba2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:19.894774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-63e5404e-97c0-4eeb-b1b4-4c3071359ba2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:13:19.894774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:19.894774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:19.894774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:19.894774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:19.894774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:19.894774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:19.894774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:19.894774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:19.894774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:19.894774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:19.894774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:19.894774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:19.894774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:19.894774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:19.894774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:19.895671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:19.895671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:19.895671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:19.895671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:19.895671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:19.895671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:19.895671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:19.895671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:19.895671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:19.895671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:19.895671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:19.895671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:19.895671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:19.895671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:19.895671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:19.895671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:19.896475 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:19.896475 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:19.896475 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:19.896475 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:19.896475 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:19.896475 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:19.896475 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:19.896475 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:19.896475 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:19.896475 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:19.896475 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:13:19.896475 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:19.898182 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 176/357] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 00:13:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:19.898789 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5404e-97c0-4eeb-b1b4-4c3071359ba2 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:19.954220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5471464-2a8d-48b7-999d-43d0501ae1f3 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:19.978296 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:20.002286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f95f8-7bbd-46df-8ddc-4a3c44819dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:20.002557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f95f8-7bbd-46df-8ddc-4a3c44819dd6 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:20.002865 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f95f8-7bbd-46df-8ddc-4a3c44819dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:20.003115 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f95f8-7bbd-46df-8ddc-4a3c44819dd6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:20.013468 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5404e-97c0-4eeb-b1b4-4c3071359ba2 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:20.014523 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f95f8-7bbd-46df-8ddc-4a3c44819dd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:20.022726 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-8e5f95f8-7bbd-46df-8ddc-4a3c44819dd6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:13:20.022726 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:20.022726 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:20.022726 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:20.022726 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:20.022726 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:20.022726 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:20.022726 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:20.022726 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:20.022726 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:20.022726 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:20.022726 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:20.022726 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:20.022726 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:20.022726 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:20.022726 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:20.023741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:20.023741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:20.023741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:20.023741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:20.023741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:20.023741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:20.023741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:20.023741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:20.023741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:20.023741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:20.023741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:20.023741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:20.023741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:20.023741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:20.023741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:20.023741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:20.024567 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:20.024567 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:20.024567 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:20.024567 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:20.024567 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:20.024567 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:20.024567 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:20.024567 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:20.024567 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:20.024567 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:20.024567 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 16 00:13:20.024567 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:20.025184 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 182/358] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:20.026286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e8456-d015-4fbc-a34d-9fd6b71b848e None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:20.028252 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e8456-d015-4fbc-a34d-9fd6b71b848e None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:20.028252 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e8456-d015-4fbc-a34d-9fd6b71b848e None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:20.028468 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 183/359] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:20.029025 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e8456-d015-4fbc-a34d-9fd6b71b848e None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:20.063121 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906e19e-e036-4313-8eb3-df6fc46bcac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:20.063994 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906e19e-e036-4313-8eb3-df6fc46bcac6 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:20.064281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906e19e-e036-4313-8eb3-df6fc46bcac6 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:20.064556 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906e19e-e036-4313-8eb3-df6fc46bcac6 None admin] PATH_INFO: `/v3/groups/38ff84729e1b473ea8f8d7b6177f32f1` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:20.065742 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906e19e-e036-4313-8eb3-df6fc46bcac6 None admin] RBAC: Authorizing `identity:get_group(group_id=38ff84729e1b473ea8f8d7b6177f32f1)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:20.067266 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906e19e-e036-4313-8eb3-df6fc46bcac6 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:20.069743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 177/360] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 00:13:19 2022] GET /identity/v3/groups/38ff84729e1b473ea8f8d7b6177f32f1 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:20.070527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906e19e-e036-4313-8eb3-df6fc46bcac6 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:20.092118 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:20.164352 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e8456-d015-4fbc-a34d-9fd6b71b848e None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:20.185267 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906e19e-e036-4313-8eb3-df6fc46bcac6 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:20.204034 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5358df-2832-4952-9dbb-46fe5c5d7266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:20.204701 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5358df-2832-4952-9dbb-46fe5c5d7266 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:20.204983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5358df-2832-4952-9dbb-46fe5c5d7266 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:20.205259 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5358df-2832-4952-9dbb-46fe5c5d7266 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:20.206102 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5358df-2832-4952-9dbb-46fe5c5d7266 None admin] RBAC: Adding query filter params (group.id=38ff84729e1b473ea8f8d7b6177f32f1, role.id=e6bcb832ed6d4843825263e23d8fb208, scope.project.id=b5d7f8028eb1486d8dbc58cd5d98a225) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:20.206444 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5358df-2832-4952-9dbb-46fe5c5d7266 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:20.208011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5358df-2832-4952-9dbb-46fe5c5d7266 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:20.213890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 184/361] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 16 00:13:20 2022] GET /identity/v3/role_assignments?group.id=38ff84729e1b473ea8f8d7b6177f32f1&scope.project.id=b5d7f8028eb1486d8dbc58cd5d98a225&role.id=e6bcb832ed6d4843825263e23d8fb208 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:20.214608 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5358df-2832-4952-9dbb-46fe5c5d7266 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:20.223997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddb5ba-80a5-4c2a-aa07-9cd255ee5770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:20.224891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddb5ba-80a5-4c2a-aa07-9cd255ee5770 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:20.225173 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddb5ba-80a5-4c2a-aa07-9cd255ee5770 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:20.225451 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caddb5ba-80a5-4c2a-aa07-9cd255ee5770 None admin] PATH_INFO: `/v3/projects/27e0d304f3c644b2b8db92d18a19d41a` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:20.229513 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caddb5ba-80a5-4c2a-aa07-9cd255ee5770 None admin] RBAC: Authorizing `identity:get_project(project_id=27e0d304f3c644b2b8db92d18a19d41a)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:20.229513 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caddb5ba-80a5-4c2a-aa07-9cd255ee5770 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:20.231564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 178/362] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:20 2022] GET /identity/v3/projects/27e0d304f3c644b2b8db92d18a19d41a => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:20.232327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddb5ba-80a5-4c2a-aa07-9cd255ee5770 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:20.242256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:20.340099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5358df-2832-4952-9dbb-46fe5c5d7266 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:20.351450 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:20.374258 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caddb5ba-80a5-4c2a-aa07-9cd255ee5770 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:20.399594 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f113d-dac2-4f0a-b9a7-1f8a76b36442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:20.400306 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f113d-dac2-4f0a-b9a7-1f8a76b36442 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:20.400591 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f113d-dac2-4f0a-b9a7-1f8a76b36442 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:20.400867 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f113d-dac2-4f0a-b9a7-1f8a76b36442 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:20.401625 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f113d-dac2-4f0a-b9a7-1f8a76b36442 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:20.401936 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f113d-dac2-4f0a-b9a7-1f8a76b36442 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:20.403327 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266f113d-dac2-4f0a-b9a7-1f8a76b36442 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:20.416629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 185/363] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:20.417886 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925000d6-d0b9-4d29-a3b8-fe0df6b436ea None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:20.418181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925000d6-d0b9-4d29-a3b8-fe0df6b436ea None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:20.418458 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925000d6-d0b9-4d29-a3b8-fe0df6b436ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:20.424879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e90a5-7e5f-4a1e-8c42-1c054e1c4aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:20.425560 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e90a5-7e5f-4a1e-8c42-1c054e1c4aa9 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:20.425877 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e90a5-7e5f-4a1e-8c42-1c054e1c4aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:20.426193 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e90a5-7e5f-4a1e-8c42-1c054e1c4aa9 None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:20.426957 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e90a5-7e5f-4a1e-8c42-1c054e1c4aa9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:20.427268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e90a5-7e5f-4a1e-8c42-1c054e1c4aa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:20.428681 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9e90a5-7e5f-4a1e-8c42-1c054e1c4aa9 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:20.438927 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 179/364] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:13:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:20.442033 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e90a5-7e5f-4a1e-8c42-1c054e1c4aa9 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:20.442553 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-925000d6-d0b9-4d29-a3b8-fe0df6b436ea None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:20.443804 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-925000d6-d0b9-4d29-a3b8-fe0df6b436ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:20.531654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:20.535924 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 186/365] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:20.536703 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925000d6-d0b9-4d29-a3b8-fe0df6b436ea None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:20.564176 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e90a5-7e5f-4a1e-8c42-1c054e1c4aa9 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:20.599035 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a571969-6047-4474-9386-b15837b83f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:20.599638 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a571969-6047-4474-9386-b15837b83f3d None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:20.599918 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a571969-6047-4474-9386-b15837b83f3d None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:20.600192 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a571969-6047-4474-9386-b15837b83f3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:20.601020 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a571969-6047-4474-9386-b15837b83f3d None admin] RBAC: Adding query filter params (group.id=38ff84729e1b473ea8f8d7b6177f32f1, role.id=d6fedf23abb64cd494e8b49acefff423, scope.project.id=b5d7f8028eb1486d8dbc58cd5d98a225) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:20.601341 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a571969-6047-4474-9386-b15837b83f3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:20.602769 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a571969-6047-4474-9386-b15837b83f3d None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:20.608152 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 180/366] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 16 00:13:20 2022] GET /identity/v3/role_assignments?group.id=38ff84729e1b473ea8f8d7b6177f32f1&scope.project.id=b5d7f8028eb1486d8dbc58cd5d98a225&role.id=d6fedf23abb64cd494e8b49acefff423 => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:20.608918 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a571969-6047-4474-9386-b15837b83f3d None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:20.662482 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925000d6-d0b9-4d29-a3b8-fe0df6b436ea None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:20.664722 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:20.705840 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2dd83b-09db-4b82-8821-0a618f464095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:20.707786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dd83b-09db-4b82-8821-0a618f464095 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:20.708291 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dd83b-09db-4b82-8821-0a618f464095 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:20.708825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2dd83b-09db-4b82-8821-0a618f464095 None admin] PATH_INFO: `/v3/groups/38ff84729e1b473ea8f8d7b6177f32f1` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:20.710119 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2dd83b-09db-4b82-8821-0a618f464095 None admin] RBAC: Authorizing `identity:get_group(group_id=38ff84729e1b473ea8f8d7b6177f32f1)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:20.711649 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2dd83b-09db-4b82-8821-0a618f464095 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:20.713718 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 187/367] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 00:13:20 2022] GET /identity/v3/groups/38ff84729e1b473ea8f8d7b6177f32f1 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:20.714604 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2dd83b-09db-4b82-8821-0a618f464095 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:20.759026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a571969-6047-4474-9386-b15837b83f3d None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:20.792285 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:20.804677 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240d8d5-d9d3-41f8-9e9b-f6e0c01e8d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:20.805335 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240d8d5-d9d3-41f8-9e9b-f6e0c01e8d3b None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:20.805616 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240d8d5-d9d3-41f8-9e9b-f6e0c01e8d3b None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:20.805909 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7240d8d5-d9d3-41f8-9e9b-f6e0c01e8d3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:20.844341 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2dd83b-09db-4b82-8821-0a618f464095 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:20.879436 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240d8d5-d9d3-41f8-9e9b-f6e0c01e8d3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:20.881485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7240d8d5-d9d3-41f8-9e9b-f6e0c01e8d3b None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:20.887261 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10160c4-8ef8-42af-ba56-93d051970ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:20.888250 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10160c4-8ef8-42af-ba56-93d051970ff8 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:20.888600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10160c4-8ef8-42af-ba56-93d051970ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:20.888944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10160c4-8ef8-42af-ba56-93d051970ff8 None admin] PATH_INFO: `/v3/users/5c7f7124a75e43888fa75767d33ee2ca` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:20.890247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10160c4-8ef8-42af-ba56-93d051970ff8 None admin] RBAC: Authorizing `identity:get_user(user_id=5c7f7124a75e43888fa75767d33ee2ca)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:20.892257 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10160c4-8ef8-42af-ba56-93d051970ff8 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:20.895442 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 188/368] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:13:20 2022] GET /identity/v3/users/5c7f7124a75e43888fa75767d33ee2ca => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:20.896661 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10160c4-8ef8-42af-ba56-93d051970ff8 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:20.951650 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:21.001959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 181/369] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:13:21.003493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240d8d5-d9d3-41f8-9e9b-f6e0c01e8d3b None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:21.025885 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10160c4-8ef8-42af-ba56-93d051970ff8 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:21.041032 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:21.073423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ed09b-a856-4dff-9b3e-64265dbd244a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:21.074646 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ed09b-a856-4dff-9b3e-64265dbd244a None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:21.074937 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ed09b-a856-4dff-9b3e-64265dbd244a None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:21.075219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694ed09b-a856-4dff-9b3e-64265dbd244a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:21.090328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694ed09b-a856-4dff-9b3e-64265dbd244a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:21.100302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-694ed09b-a856-4dff-9b3e-64265dbd244a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:21.100302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:21.100302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:21.100302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:21.100302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:21.100302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:21.100302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:21.100302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:21.100302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:21.100302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:21.100302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:21.100302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:21.100302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:21.100302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:21.100302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:21.100302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:21.101629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:21.101629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:21.101629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:21.101629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:21.101629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:21.101629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:21.101629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:21.101629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:21.101629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:21.101629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:21.101629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:21.101629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:21.101629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:21.101629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:21.101629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:21.101629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:21.102480 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:21.102480 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:21.102480 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:21.102480 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:21.102480 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:21.102480 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:21.102480 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:21.102480 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:21.102480 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:21.102480 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:21.102480 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:21.102480 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:21.106978 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 189/370] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:13:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:21.107941 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ed09b-a856-4dff-9b3e-64265dbd244a None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:21.147048 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7240d8d5-d9d3-41f8-9e9b-f6e0c01e8d3b None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:21.183177 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21991197-4fb7-4930-b3c5-6fcf166e95bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:21.184011 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21991197-4fb7-4930-b3c5-6fcf166e95bf None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:21.184304 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21991197-4fb7-4930-b3c5-6fcf166e95bf None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:21.184581 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21991197-4fb7-4930-b3c5-6fcf166e95bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:21.185412 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21991197-4fb7-4930-b3c5-6fcf166e95bf None admin] RBAC: Adding query filter params (group.id=38ff84729e1b473ea8f8d7b6177f32f1, role.id=d6fedf23abb64cd494e8b49acefff423, scope.project.id=27e0d304f3c644b2b8db92d18a19d41a) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:21.185723 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21991197-4fb7-4930-b3c5-6fcf166e95bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:21.187278 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21991197-4fb7-4930-b3c5-6fcf166e95bf None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:21.193531 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 182/371] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 16 00:13:21 2022] GET /identity/v3/role_assignments?group.id=38ff84729e1b473ea8f8d7b6177f32f1&scope.project.id=27e0d304f3c644b2b8db92d18a19d41a&role.id=d6fedf23abb64cd494e8b49acefff423 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:21.194395 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21991197-4fb7-4930-b3c5-6fcf166e95bf None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:21.229781 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:21.236701 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694ed09b-a856-4dff-9b3e-64265dbd244a None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:21.286174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c00d2-1d7c-46f6-85bb-e15fcda4abc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:21.287302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c00d2-1d7c-46f6-85bb-e15fcda4abc0 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:21.287859 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c00d2-1d7c-46f6-85bb-e15fcda4abc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:21.288344 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10c00d2-1d7c-46f6-85bb-e15fcda4abc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:21.289493 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c00d2-1d7c-46f6-85bb-e15fcda4abc0 None admin] RBAC: Adding query filter params (role.id=d80b3a9c2e6e45739aa3056330bc9ad8, user.id=5c7f7124a75e43888fa75767d33ee2ca, scope.system=all) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:21.290046 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c00d2-1d7c-46f6-85bb-e15fcda4abc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:21.291771 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10c00d2-1d7c-46f6-85bb-e15fcda4abc0 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:21.310853 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 190/372] 10.222.0.44 () {56 vars in 1308 bytes} [Thu Jun 16 00:13:21 2022] GET /identity/v3/role_assignments?user.id=5c7f7124a75e43888fa75767d33ee2ca&scope.system=all&role.id=d80b3a9c2e6e45739aa3056330bc9ad8 => generated 510 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:21.313529 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c00d2-1d7c-46f6-85bb-e15fcda4abc0 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:21.440231 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10c00d2-1d7c-46f6-85bb-e15fcda4abc0 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:21.477187 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:21.478715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8bdf1-a125-4b10-a98e-46e4b02195ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:21.479898 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8bdf1-a125-4b10-a98e-46e4b02195ec None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:21.480559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8bdf1-a125-4b10-a98e-46e4b02195ec None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:21.481117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8bdf1-a125-4b10-a98e-46e4b02195ec None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:21.482442 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8bdf1-a125-4b10-a98e-46e4b02195ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:21.482972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8bdf1-a125-4b10-a98e-46e4b02195ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:21.484878 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8bdf1-a125-4b10-a98e-46e4b02195ec None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:21.491111 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21991197-4fb7-4930-b3c5-6fcf166e95bf None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:21.496590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 191/373] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:21.505527 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8bdf1-a125-4b10-a98e-46e4b02195ec None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:21.551281 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:21.571821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2562cc-c61c-4733-a802-867b50f755f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:21.571821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2562cc-c61c-4733-a802-867b50f755f9 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:21.571821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2562cc-c61c-4733-a802-867b50f755f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:21.571821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2562cc-c61c-4733-a802-867b50f755f9 None admin] PATH_INFO: `/v3/projects/27e0d304f3c644b2b8db92d18a19d41a` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:21.577227 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2562cc-c61c-4733-a802-867b50f755f9 None admin] RBAC: Authorizing `identity:get_project(project_id=27e0d304f3c644b2b8db92d18a19d41a)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:21.578042 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2562cc-c61c-4733-a802-867b50f755f9 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:21.580098 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 183/374] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:21 2022] GET /identity/v3/projects/27e0d304f3c644b2b8db92d18a19d41a => generated 302 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:21.588716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2562cc-c61c-4733-a802-867b50f755f9 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:21.706719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8bdf1-a125-4b10-a98e-46e4b02195ec None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:21.751567 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39095c2b-3c91-48d8-beac-e8e22a5462a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:21.752395 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39095c2b-3c91-48d8-beac-e8e22a5462a5 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:21.752643 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39095c2b-3c91-48d8-beac-e8e22a5462a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:21.752816 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39095c2b-3c91-48d8-beac-e8e22a5462a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:21.794551 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2562cc-c61c-4733-a802-867b50f755f9 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:21.865196 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39095c2b-3c91-48d8-beac-e8e22a5462a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:21.868769 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39095c2b-3c91-48d8-beac-e8e22a5462a5 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:21.893940 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:21.895295 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cf51c-5ba4-46a9-b509-527065c7a533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:21.896581 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cf51c-5ba4-46a9-b509-527065c7a533 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:21.896868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cf51c-5ba4-46a9-b509-527065c7a533 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:21.897147 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777cf51c-5ba4-46a9-b509-527065c7a533 None admin] PATH_INFO: `/v3/groups/38ff84729e1b473ea8f8d7b6177f32f1` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:21.900357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cf51c-5ba4-46a9-b509-527065c7a533 None admin] RBAC: Authorizing `identity:get_group(group_id=38ff84729e1b473ea8f8d7b6177f32f1)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:21.903038 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777cf51c-5ba4-46a9-b509-527065c7a533 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:21.907406 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 184/375] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 00:13:21 2022] GET /identity/v3/groups/38ff84729e1b473ea8f8d7b6177f32f1 => generated 226 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:21.913631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cf51c-5ba4-46a9-b509-527065c7a533 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:21.957810 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:22.076425 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 192/376] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 572 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:13:22.077571 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39095c2b-3c91-48d8-beac-e8e22a5462a5 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:22.137487 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777cf51c-5ba4-46a9-b509-527065c7a533 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:22.197842 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4f639-f4e2-4e12-bc14-532e3075f0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:22.198773 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4f639-f4e2-4e12-bc14-532e3075f0ed None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:22.199208 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4f639-f4e2-4e12-bc14-532e3075f0ed None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:22.199664 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4f639-f4e2-4e12-bc14-532e3075f0ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:22.200655 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4f639-f4e2-4e12-bc14-532e3075f0ed None admin] RBAC: Adding query filter params (group.id=38ff84729e1b473ea8f8d7b6177f32f1, role.id=e6bcb832ed6d4843825263e23d8fb208, scope.project.id=27e0d304f3c644b2b8db92d18a19d41a) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:22.201139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4f639-f4e2-4e12-bc14-532e3075f0ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:22.202841 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f4f639-f4e2-4e12-bc14-532e3075f0ed None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:22.209548 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 185/377] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 16 00:13:21 2022] GET /identity/v3/role_assignments?group.id=38ff84729e1b473ea8f8d7b6177f32f1&scope.project.id=27e0d304f3c644b2b8db92d18a19d41a&role.id=e6bcb832ed6d4843825263e23d8fb208 => generated 260 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:22.240159 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39095c2b-3c91-48d8-beac-e8e22a5462a5 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:22.272058 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:22.309932 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec50d9-30d4-4f7c-a010-cbc175f2a4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:22.310844 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec50d9-30d4-4f7c-a010-cbc175f2a4b7 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:22.311122 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec50d9-30d4-4f7c-a010-cbc175f2a4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:22.311394 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ec50d9-30d4-4f7c-a010-cbc175f2a4b7 None admin] PATH_INFO: `/v3/projects/ec07de477e084ea786d462c55e9192b8` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:22.312636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ec50d9-30d4-4f7c-a010-cbc175f2a4b7 None admin] RBAC: Authorizing `identity:get_project(project_id=ec07de477e084ea786d462c55e9192b8)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:22.314091 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ec50d9-30d4-4f7c-a010-cbc175f2a4b7 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:22.316192 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 193/378] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:22 2022] GET /identity/v3/projects/ec07de477e084ea786d462c55e9192b8 => generated 344 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:22.321913 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4f639-f4e2-4e12-bc14-532e3075f0ed None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:22.472161 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:22.479205 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4f639-f4e2-4e12-bc14-532e3075f0ed None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:22.516371 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4523ab77-3867-47ec-a44d-949780a94d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:22.517609 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523ab77-3867-47ec-a44d-949780a94d0b None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:22.518109 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523ab77-3867-47ec-a44d-949780a94d0b None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:22.518651 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4523ab77-3867-47ec-a44d-949780a94d0b None admin] PATH_INFO: `/v3/groups/6d2cdb8a68cf4f0483f80012bada5c89` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:22.524357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523ab77-3867-47ec-a44d-949780a94d0b None admin] RBAC: Authorizing `identity:get_group(group_id=6d2cdb8a68cf4f0483f80012bada5c89)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:22.526082 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4523ab77-3867-47ec-a44d-949780a94d0b None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:22.528293 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 186/379] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 00:13:22 2022] GET /identity/v3/groups/6d2cdb8a68cf4f0483f80012bada5c89 => generated 229 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:22.534372 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec50d9-30d4-4f7c-a010-cbc175f2a4b7 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:22.655918 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ec50d9-30d4-4f7c-a010-cbc175f2a4b7 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:22.700167 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25db1ff-a9ca-494b-9b4b-c1b0793ca875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:22.700847 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25db1ff-a9ca-494b-9b4b-c1b0793ca875 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:22.701129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25db1ff-a9ca-494b-9b4b-c1b0793ca875 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:22.701405 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25db1ff-a9ca-494b-9b4b-c1b0793ca875 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:22.702260 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25db1ff-a9ca-494b-9b4b-c1b0793ca875 None admin] RBAC: Adding query filter params (group.id=6d2cdb8a68cf4f0483f80012bada5c89, role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab, scope.project.id=ec07de477e084ea786d462c55e9192b8) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:22.702579 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25db1ff-a9ca-494b-9b4b-c1b0793ca875 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:22.704121 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25db1ff-a9ca-494b-9b4b-c1b0793ca875 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:22.709282 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aef436-1c30-40c2-8470-a7499f896164 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:22.709894 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aef436-1c30-40c2-8470-a7499f896164 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:22.710400 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aef436-1c30-40c2-8470-a7499f896164 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:22.711441 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 194/380] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 16 00:13:22 2022] GET /identity/v3/role_assignments?group.id=6d2cdb8a68cf4f0483f80012bada5c89&scope.project.id=ec07de477e084ea786d462c55e9192b8&role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:22.712502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 187/381] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:13:22.717878 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb541249-d3ca-4ee3-a794-ad81d7767031 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:22.718178 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb541249-d3ca-4ee3-a794-ad81d7767031 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:22.718441 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb541249-d3ca-4ee3-a794-ad81d7767031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:22.738592 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-eb541249-d3ca-4ee3-a794-ad81d7767031 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:22.739841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-eb541249-d3ca-4ee3-a794-ad81d7767031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:22.804021 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:22.835345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 195/382] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:22.859626 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aef436-1c30-40c2-8470-a7499f896164 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:22.999214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aef436-1c30-40c2-8470-a7499f896164 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:23.034370 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4097d-7536-407a-b2fc-f25f9d7228d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:23.035238 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4097d-7536-407a-b2fc-f25f9d7228d7 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:23.035527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4097d-7536-407a-b2fc-f25f9d7228d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:23.035830 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd4097d-7536-407a-b2fc-f25f9d7228d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:23.046586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd4097d-7536-407a-b2fc-f25f9d7228d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:23.055647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-ecd4097d-7536-407a-b2fc-f25f9d7228d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:13:23.055647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:23.055647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:23.055647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:23.055647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:23.055647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:23.055647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:23.055647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:23.055647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:23.055647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:23.055647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:23.055647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:23.055647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:23.055647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:23.055647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:23.055647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:23.056534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:23.056534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:23.056534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:23.056534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:23.056534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:23.056534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:23.056534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:23.056534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:23.056534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:23.056534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:23.056534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:23.056534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:23.056534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:23.056534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:23.056534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:23.056534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:23.057340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:23.057340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:23.057340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:23.057340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:23.057340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:23.057340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:23.057340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:23.057340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:23.057340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:23.057340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:23.057340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:13:23.057340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:23.057340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 188/383] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 00:13:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:23.063278 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb541249-d3ca-4ee3-a794-ad81d7767031 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:23.206693 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb541249-d3ca-4ee3-a794-ad81d7767031 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:23.241979 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef8688e-6d78-4078-a584-00a7b7405963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:23.243032 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8688e-6d78-4078-a584-00a7b7405963 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:23.243537 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8688e-6d78-4078-a584-00a7b7405963 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:23.244065 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef8688e-6d78-4078-a584-00a7b7405963 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:23.245015 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8688e-6d78-4078-a584-00a7b7405963 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:23.245538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8688e-6d78-4078-a584-00a7b7405963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:23.247116 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef8688e-6d78-4078-a584-00a7b7405963 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:23.256856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 196/384] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:23.263724 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4097d-7536-407a-b2fc-f25f9d7228d7 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:23.299923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:23.419302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850dd820-1f9e-4c61-a845-4de4fda5137a None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:23.419713 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd4097d-7536-407a-b2fc-f25f9d7228d7 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:23.419907 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850dd820-1f9e-4c61-a845-4de4fda5137a None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:23.420365 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850dd820-1f9e-4c61-a845-4de4fda5137a None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:23.427751 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 197/385] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:23.431143 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ace1c-32ae-43ae-a212-f20e76284083 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:23.431440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ace1c-32ae-43ae-a212-f20e76284083 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:23.431750 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ace1c-32ae-43ae-a212-f20e76284083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:23.448645 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-314ace1c-32ae-43ae-a212-f20e76284083 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:23.449824 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-314ace1c-32ae-43ae-a212-f20e76284083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:23.469623 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6af53-86e1-480f-9949-e7590abd1feb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:23.470485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6af53-86e1-480f-9949-e7590abd1feb None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:23.470761 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6af53-86e1-480f-9949-e7590abd1feb None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:23.471028 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6af53-86e1-480f-9949-e7590abd1feb None admin] PATH_INFO: `/v3/groups/38ff84729e1b473ea8f8d7b6177f32f1` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:23.472432 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6af53-86e1-480f-9949-e7590abd1feb None admin] RBAC: Authorizing `identity:get_group(group_id=38ff84729e1b473ea8f8d7b6177f32f1)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:23.475284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6af53-86e1-480f-9949-e7590abd1feb None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:23.478869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 189/386] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 00:13:23 2022] GET /identity/v3/groups/38ff84729e1b473ea8f8d7b6177f32f1 => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:23.483567 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6af53-86e1-480f-9949-e7590abd1feb None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:23.510715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:23.552410 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 198/387] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:23.574562 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ace1c-32ae-43ae-a212-f20e76284083 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:23.668155 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:23.694090 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6af53-86e1-480f-9949-e7590abd1feb None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:23.748256 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ace1c-32ae-43ae-a212-f20e76284083 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:23.767398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e30c1-3b41-40d5-a924-f58ce5a3ae5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:23.768622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e30c1-3b41-40d5-a924-f58ce5a3ae5b None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:23.769247 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e30c1-3b41-40d5-a924-f58ce5a3ae5b None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:23.769768 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e30c1-3b41-40d5-a924-f58ce5a3ae5b None admin] PATH_INFO: `/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:23.776485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e30c1-3b41-40d5-a924-f58ce5a3ae5b None admin] RBAC: Authorizing `identity:get_project(project_id=b5d7f8028eb1486d8dbc58cd5d98a225)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:23.778313 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e30c1-3b41-40d5-a924-f58ce5a3ae5b None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:23.780708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 190/388] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:23 2022] GET /identity/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225 => generated 298 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:23.786085 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e30c1-3b41-40d5-a924-f58ce5a3ae5b None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:23.792678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17132d93-f006-4fc3-9ad6-4fcd3ed99fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:23.793879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17132d93-f006-4fc3-9ad6-4fcd3ed99fe7 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:23.793879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17132d93-f006-4fc3-9ad6-4fcd3ed99fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:23.794147 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17132d93-f006-4fc3-9ad6-4fcd3ed99fe7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:23.818676 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17132d93-f006-4fc3-9ad6-4fcd3ed99fe7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:23.831117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-17132d93-f006-4fc3-9ad6-4fcd3ed99fe7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:23.831117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:23.831117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:23.831117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:23.831117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:23.831117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:23.831117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:23.831117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:23.831117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:23.831117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:23.831117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:23.831117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:23.831117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:23.831117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:23.831117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:23.831117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:23.832082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:23.832082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:23.832082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:23.832082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:23.832082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:23.832082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:23.832082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:23.832082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:23.832082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:23.832082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:23.832082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:23.832082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:23.832082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:23.832082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:23.832082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:23.832082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:23.832900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:23.832900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:23.832900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:23.832900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:23.832900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:23.832900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:23.832900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:23.832900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:23.832900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:23.832900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:23.832900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:23.832900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:23.832900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 199/389] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:13:23.843209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17132d93-f006-4fc3-9ad6-4fcd3ed99fe7 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:23.885713 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:23.964119 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17132d93-f006-4fc3-9ad6-4fcd3ed99fe7 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:24.016545 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84a948-abce-4ce1-a09a-228ca9ef8809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:24.017216 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84a948-abce-4ce1-a09a-228ca9ef8809 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:24.017554 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84a948-abce-4ce1-a09a-228ca9ef8809 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:24.017775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84a948-abce-4ce1-a09a-228ca9ef8809 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:24.018523 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84a948-abce-4ce1-a09a-228ca9ef8809 None admin] RBAC: Adding query filter params (name=member) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:24.018832 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84a948-abce-4ce1-a09a-228ca9ef8809 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:24.020258 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84a948-abce-4ce1-a09a-228ca9ef8809 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:24.039183 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 200/390] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:13:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:24.039459 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e30c1-3b41-40d5-a924-f58ce5a3ae5b None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:24.047374 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84a948-abce-4ce1-a09a-228ca9ef8809 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:24.110432 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4b44bb-d73e-4921-a145-29209e089947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:24.111322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b44bb-d73e-4921-a145-29209e089947 None admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:24.111600 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b44bb-d73e-4921-a145-29209e089947 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:24.112045 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4b44bb-d73e-4921-a145-29209e089947 None admin] PATH_INFO: `/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225/groups/38ff84729e1b473ea8f8d7b6177f32f1/roles/e6bcb832ed6d4843825263e23d8fb208` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:24.114501 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b44bb-d73e-4921-a145-29209e089947 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5d7f8028eb1486d8dbc58cd5d98a225, group_id=38ff84729e1b473ea8f8d7b6177f32f1, role_id=e6bcb832ed6d4843825263e23d8fb208)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:24.115970 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4b44bb-d73e-4921-a145-29209e089947 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:24.147374 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 191/391] 10.222.0.44 () {58 vars in 1442 bytes} [Thu Jun 16 00:13:23 2022] PUT /identity/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225/groups/38ff84729e1b473ea8f8d7b6177f32f1/roles/e6bcb832ed6d4843825263e23d8fb208 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:13:24.148988 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff009ed-e644-4a84-905f-689b0917c65b None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:24.149283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff009ed-e644-4a84-905f-689b0917c65b None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:24.149566 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff009ed-e644-4a84-905f-689b0917c65b None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:24.156058 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 192/392] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:24.172453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f747cb9-d539-4a02-9ca6-2fb91c272ae2 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:24.172782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f747cb9-d539-4a02-9ca6-2fb91c272ae2 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:24.172999 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f747cb9-d539-4a02-9ca6-2fb91c272ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:24.202431 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-9f747cb9-d539-4a02-9ca6-2fb91c272ae2 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:24.204213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-9f747cb9-d539-4a02-9ca6-2fb91c272ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:24.216014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:24.227420 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84a948-abce-4ce1-a09a-228ca9ef8809 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:24.239868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:24.294168 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a7a81-f768-4821-9049-37d3ddc2368a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:24.294380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a7a81-f768-4821-9049-37d3ddc2368a None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:24.294614 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a7a81-f768-4821-9049-37d3ddc2368a None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:24.294774 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8a7a81-f768-4821-9049-37d3ddc2368a None admin] PATH_INFO: `/v3/groups/38ff84729e1b473ea8f8d7b6177f32f1` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:24.299663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a7a81-f768-4821-9049-37d3ddc2368a None admin] RBAC: Authorizing `identity:get_group(group_id=38ff84729e1b473ea8f8d7b6177f32f1)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:24.299663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8a7a81-f768-4821-9049-37d3ddc2368a None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:24.299917 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 201/393] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 00:13:24 2022] GET /identity/v3/groups/38ff84729e1b473ea8f8d7b6177f32f1 => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:24.306849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a7a81-f768-4821-9049-37d3ddc2368a None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:24.357385 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 193/394] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:24.381165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f747cb9-d539-4a02-9ca6-2fb91c272ae2 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:24.445658 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8a7a81-f768-4821-9049-37d3ddc2368a None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:24.488108 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233049d-5f8a-48bb-8858-2c0d4d2d365b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:24.490098 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233049d-5f8a-48bb-8858-2c0d4d2d365b None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:24.490591 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233049d-5f8a-48bb-8858-2c0d4d2d365b None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:24.491068 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7233049d-5f8a-48bb-8858-2c0d4d2d365b None admin] PATH_INFO: `/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:24.493240 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233049d-5f8a-48bb-8858-2c0d4d2d365b None admin] RBAC: Authorizing `identity:get_project(project_id=b5d7f8028eb1486d8dbc58cd5d98a225)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:24.495406 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7233049d-5f8a-48bb-8858-2c0d4d2d365b None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:24.498338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 202/395] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:24 2022] GET /identity/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:24.506265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233049d-5f8a-48bb-8858-2c0d4d2d365b None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:24.516067 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f747cb9-d539-4a02-9ca6-2fb91c272ae2 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:24.553998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0faf761-cd27-4d74-a23f-ee6321c276e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:24.554833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faf761-cd27-4d74-a23f-ee6321c276e3 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:24.555183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faf761-cd27-4d74-a23f-ee6321c276e3 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:24.555584 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0faf761-cd27-4d74-a23f-ee6321c276e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:24.563842 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:24.568955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0faf761-cd27-4d74-a23f-ee6321c276e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:24.583398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-a0faf761-cd27-4d74-a23f-ee6321c276e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:24.583398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:24.583398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:24.583398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:24.583398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:24.583398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:24.583398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:24.583398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:24.583398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:24.583398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:24.583398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:24.583398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:24.583398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:24.583398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:24.583398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:24.583398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:24.584410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:24.584410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:24.584410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:24.584410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:24.584410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:24.584410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:24.584410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:24.584410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:24.584410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:24.584410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:24.584410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:24.584410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:24.584410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:24.584410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:24.584410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:24.584410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:24.585293 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:24.585293 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:24.585293 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:24.585293 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:24.585293 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:24.585293 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:24.585293 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:24.585293 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:24.585293 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:24.585293 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:24.585293 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:24.585293 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:24.585293 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 194/396] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:13:24.585293 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0faf761-cd27-4d74-a23f-ee6321c276e3 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:24.602409 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:24.721728 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7233049d-5f8a-48bb-8858-2c0d4d2d365b None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:24.737383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0faf761-cd27-4d74-a23f-ee6321c276e3 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:24.777666 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20134030-3b6a-4242-9efc-0f48ee9d678a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:24.778395 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20134030-3b6a-4242-9efc-0f48ee9d678a None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:24.778681 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20134030-3b6a-4242-9efc-0f48ee9d678a None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:24.778958 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20134030-3b6a-4242-9efc-0f48ee9d678a None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:24.779801 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20134030-3b6a-4242-9efc-0f48ee9d678a None admin] RBAC: Adding query filter params (name=member) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:24.780113 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20134030-3b6a-4242-9efc-0f48ee9d678a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:24.781513 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20134030-3b6a-4242-9efc-0f48ee9d678a None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:24.790682 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 195/397] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:13:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:24.802688 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20134030-3b6a-4242-9efc-0f48ee9d678a None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:24.817827 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bda8340-ad98-4615-84aa-e1839ec17963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:24.819038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda8340-ad98-4615-84aa-e1839ec17963 None admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:24.819971 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda8340-ad98-4615-84aa-e1839ec17963 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:24.820499 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bda8340-ad98-4615-84aa-e1839ec17963 None admin] PATH_INFO: `/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225/groups/38ff84729e1b473ea8f8d7b6177f32f1/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:24.824652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda8340-ad98-4615-84aa-e1839ec17963 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5d7f8028eb1486d8dbc58cd5d98a225, group_id=38ff84729e1b473ea8f8d7b6177f32f1, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:24.826345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bda8340-ad98-4615-84aa-e1839ec17963 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:24.850149 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 203/398] 10.222.0.44 () {58 vars in 1442 bytes} [Thu Jun 16 00:13:24 2022] PUT /identity/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225/groups/38ff84729e1b473ea8f8d7b6177f32f1/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:13:24.909169 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:24.937367 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd490036-9491-42bf-a213-1f154bfe9473 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:24.938045 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd490036-9491-42bf-a213-1f154bfe9473 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:24.938522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd490036-9491-42bf-a213-1f154bfe9473 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:24.940514 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 204/399] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:13:24.947123 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1776baa-50d2-4bd3-8e1e-4e86d1d35160 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:24.947762 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1776baa-50d2-4bd3-8e1e-4e86d1d35160 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:24.948339 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1776baa-50d2-4bd3-8e1e-4e86d1d35160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:24.956212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20134030-3b6a-4242-9efc-0f48ee9d678a None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:24.985759 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-c1776baa-50d2-4bd3-8e1e-4e86d1d35160 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:24.986987 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-c1776baa-50d2-4bd3-8e1e-4e86d1d35160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:25.020876 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0de5ed-2078-4a95-8092-50239ed59526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:25.023156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0de5ed-2078-4a95-8092-50239ed59526 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:25.023444 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0de5ed-2078-4a95-8092-50239ed59526 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:25.023750 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0de5ed-2078-4a95-8092-50239ed59526 None admin] PATH_INFO: `/v3/groups/38ff84729e1b473ea8f8d7b6177f32f1` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:25.025304 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0de5ed-2078-4a95-8092-50239ed59526 None admin] RBAC: Authorizing `identity:get_group(group_id=38ff84729e1b473ea8f8d7b6177f32f1)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:25.026777 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0de5ed-2078-4a95-8092-50239ed59526 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:25.039771 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 196/400] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 00:13:24 2022] GET /identity/v3/groups/38ff84729e1b473ea8f8d7b6177f32f1 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:25.041738 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0de5ed-2078-4a95-8092-50239ed59526 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:25.110838 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 205/401] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:13:25.134910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1776baa-50d2-4bd3-8e1e-4e86d1d35160 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:25.167986 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:25.199741 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0de5ed-2078-4a95-8092-50239ed59526 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:25.243978 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d0121-2be0-4296-bdf4-8c85a77da0ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:25.244853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d0121-2be0-4296-bdf4-8c85a77da0ad None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:25.245135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d0121-2be0-4296-bdf4-8c85a77da0ad None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:25.245410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d0121-2be0-4296-bdf4-8c85a77da0ad None admin] PATH_INFO: `/v3/projects/27e0d304f3c644b2b8db92d18a19d41a` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:25.247282 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d0121-2be0-4296-bdf4-8c85a77da0ad None admin] RBAC: Authorizing `identity:get_project(project_id=27e0d304f3c644b2b8db92d18a19d41a)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:25.249504 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506d0121-2be0-4296-bdf4-8c85a77da0ad None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:25.255583 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 197/402] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:25 2022] GET /identity/v3/projects/27e0d304f3c644b2b8db92d18a19d41a => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:25.257228 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d0121-2be0-4296-bdf4-8c85a77da0ad None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:25.265177 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:25.335771 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1776baa-50d2-4bd3-8e1e-4e86d1d35160 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:25.364558 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13265f-93e1-42a7-8688-5d253a81c32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:25.365347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13265f-93e1-42a7-8688-5d253a81c32a None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:25.365639 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13265f-93e1-42a7-8688-5d253a81c32a None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:25.365910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13265f-93e1-42a7-8688-5d253a81c32a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:25.376871 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de13265f-93e1-42a7-8688-5d253a81c32a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:25.385856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-de13265f-93e1-42a7-8688-5d253a81c32a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:13:25.385856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:25.385856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:25.385856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:25.385856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:25.385856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:25.385856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:25.385856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:25.385856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:25.385856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:25.385856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:25.385856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:25.385856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:25.385856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:25.385856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:25.385856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:25.386732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:25.386732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:25.386732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:25.386732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:25.386732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:25.386732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:25.386732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:25.386732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:25.386732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:25.386732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:25.386732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:25.386732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:25.386732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:25.386732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:25.386732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:25.386732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:25.387547 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:25.387547 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:25.387547 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:25.387547 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:25.387547 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:25.387547 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:25.387547 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:25.387547 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:25.387547 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:25.387547 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:25.387547 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:13:25.387547 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:25.387547 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 206/403] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 00:13:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:25.388824 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a565d5-b0e3-402b-9b82-9e74f5b6a9b4 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:25.391648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a565d5-b0e3-402b-9b82-9e74f5b6a9b4 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:25.391648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a565d5-b0e3-402b-9b82-9e74f5b6a9b4 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:25.391648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 207/404] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:25.396186 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a565d5-b0e3-402b-9b82-9e74f5b6a9b4 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:25.402737 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d0121-2be0-4296-bdf4-8c85a77da0ad None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:25.447668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4413129-2bc2-4e6c-b986-ea1f0c6705a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:25.448806 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4413129-2bc2-4e6c-b986-ea1f0c6705a2 None admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:25.449548 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4413129-2bc2-4e6c-b986-ea1f0c6705a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:25.449828 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4413129-2bc2-4e6c-b986-ea1f0c6705a2 None admin] PATH_INFO: `/v3/projects/27e0d304f3c644b2b8db92d18a19d41a/groups/38ff84729e1b473ea8f8d7b6177f32f1/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:25.452362 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4413129-2bc2-4e6c-b986-ea1f0c6705a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=27e0d304f3c644b2b8db92d18a19d41a, group_id=38ff84729e1b473ea8f8d7b6177f32f1, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:25.454194 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4413129-2bc2-4e6c-b986-ea1f0c6705a2 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:25.476782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 198/405] 10.222.0.44 () {58 vars in 1442 bytes} [Thu Jun 16 00:13:25 2022] PUT /identity/v3/projects/27e0d304f3c644b2b8db92d18a19d41a/groups/38ff84729e1b473ea8f8d7b6177f32f1/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:13:25.479075 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218c0d9-1618-4740-83a3-799ec80f75fc None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:25.479384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218c0d9-1618-4740-83a3-799ec80f75fc None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:25.479678 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218c0d9-1618-4740-83a3-799ec80f75fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:25.501340 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:25.508467 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-7218c0d9-1618-4740-83a3-799ec80f75fc None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:25.510239 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-7218c0d9-1618-4740-83a3-799ec80f75fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:25.531212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a565d5-b0e3-402b-9b82-9e74f5b6a9b4 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:25.578322 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b7956-887e-45b4-85c9-7bb8043f30b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:25.579007 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b7956-887e-45b4-85c9-7bb8043f30b1 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:25.579297 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b7956-887e-45b4-85c9-7bb8043f30b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:25.579644 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b7956-887e-45b4-85c9-7bb8043f30b1 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:25.580426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b7956-887e-45b4-85c9-7bb8043f30b1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:25.580800 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b7956-887e-45b4-85c9-7bb8043f30b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:25.582762 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b7956-887e-45b4-85c9-7bb8043f30b1 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:25.590096 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:25.592396 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 208/406] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:25.598761 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b7956-887e-45b4-85c9-7bb8043f30b1 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:25.602607 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 199/407] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:25.637570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218c0d9-1618-4740-83a3-799ec80f75fc None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:25.727524 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b7956-887e-45b4-85c9-7bb8043f30b1 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:25.772141 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b005fc9-08d6-40e5-867d-fd9adf733a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:25.773278 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b005fc9-08d6-40e5-867d-fd9adf733a7b None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:25.773563 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b005fc9-08d6-40e5-867d-fd9adf733a7b None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:25.773841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b005fc9-08d6-40e5-867d-fd9adf733a7b None admin] PATH_INFO: `/v3/groups/38ff84729e1b473ea8f8d7b6177f32f1` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:25.775796 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b005fc9-08d6-40e5-867d-fd9adf733a7b None admin] RBAC: Authorizing `identity:get_group(group_id=38ff84729e1b473ea8f8d7b6177f32f1)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:25.777790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b005fc9-08d6-40e5-867d-fd9adf733a7b None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:25.780114 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 209/408] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 00:13:25 2022] GET /identity/v3/groups/38ff84729e1b473ea8f8d7b6177f32f1 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:25.788712 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b005fc9-08d6-40e5-867d-fd9adf733a7b None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:25.799201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218c0d9-1618-4740-83a3-799ec80f75fc None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:25.813708 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:25.834964 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa613dba-a49b-499e-858a-320e16aa5d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:25.835793 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa613dba-a49b-499e-858a-320e16aa5d15 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:25.836078 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa613dba-a49b-499e-858a-320e16aa5d15 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:25.836351 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa613dba-a49b-499e-858a-320e16aa5d15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:25.846762 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa613dba-a49b-499e-858a-320e16aa5d15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:25.854527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-fa613dba-a49b-499e-858a-320e16aa5d15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:25.854527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:25.854527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:25.854527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:25.854527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:25.854527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:25.854527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:25.854527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:25.854527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:25.854527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:25.854527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:25.854527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:25.854527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:25.854527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:25.854527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:25.854527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:25.855384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:25.855384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:25.855384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:25.855384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:25.855384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:25.855384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:25.855384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:25.855384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:25.855384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:25.855384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:25.855384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:25.855384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:25.855384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:25.855384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:25.855384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:25.855384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:25.856194 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:25.856194 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:25.856194 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:25.856194 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:25.856194 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:25.856194 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:25.856194 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:25.856194 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:25.856194 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:25.856194 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:25.856194 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:25.856194 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:25.856194 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 200/409] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:13:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:13:25.862513 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa613dba-a49b-499e-858a-320e16aa5d15 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:25.948063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b005fc9-08d6-40e5-867d-fd9adf733a7b None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:25.981598 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:25.986745 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb7188-8570-4099-894d-ea99af3ffb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:25.987998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb7188-8570-4099-894d-ea99af3ffb80 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:25.988956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb7188-8570-4099-894d-ea99af3ffb80 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:25.989241 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bb7188-8570-4099-894d-ea99af3ffb80 None admin] PATH_INFO: `/v3/projects/27e0d304f3c644b2b8db92d18a19d41a` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:25.990451 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb7188-8570-4099-894d-ea99af3ffb80 None admin] RBAC: Authorizing `identity:get_project(project_id=27e0d304f3c644b2b8db92d18a19d41a)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:25.992228 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bb7188-8570-4099-894d-ea99af3ffb80 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:25.994388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 210/410] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:25 2022] GET /identity/v3/projects/27e0d304f3c644b2b8db92d18a19d41a => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:26.000366 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb7188-8570-4099-894d-ea99af3ffb80 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:26.088046 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa613dba-a49b-499e-858a-320e16aa5d15 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:26.089776 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:26.114491 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bb7188-8570-4099-894d-ea99af3ffb80 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:26.154995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a85bd9-004b-4fcd-b779-85e79d86a569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:26.154995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a85bd9-004b-4fcd-b779-85e79d86a569 None admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:26.154995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a85bd9-004b-4fcd-b779-85e79d86a569 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:26.154995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a85bd9-004b-4fcd-b779-85e79d86a569 None admin] PATH_INFO: `/v3/projects/27e0d304f3c644b2b8db92d18a19d41a/groups/38ff84729e1b473ea8f8d7b6177f32f1/roles/e6bcb832ed6d4843825263e23d8fb208` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:26.157604 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a85bd9-004b-4fcd-b779-85e79d86a569 None admin] RBAC: Authorizing `identity:create_grant(project_id=27e0d304f3c644b2b8db92d18a19d41a, group_id=38ff84729e1b473ea8f8d7b6177f32f1, role_id=e6bcb832ed6d4843825263e23d8fb208)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:26.159468 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a85bd9-004b-4fcd-b779-85e79d86a569 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:26.171363 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55d934-7858-4c7b-865b-f80a9f61c486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:26.172347 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55d934-7858-4c7b-865b-f80a9f61c486 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:26.172802 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55d934-7858-4c7b-865b-f80a9f61c486 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:26.173299 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55d934-7858-4c7b-865b-f80a9f61c486 None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:26.174240 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55d934-7858-4c7b-865b-f80a9f61c486 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:26.174757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55d934-7858-4c7b-865b-f80a9f61c486 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:26.175019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 211/411] 10.222.0.44 () {58 vars in 1442 bytes} [Thu Jun 16 00:13:25 2022] PUT /identity/v3/projects/27e0d304f3c644b2b8db92d18a19d41a/groups/38ff84729e1b473ea8f8d7b6177f32f1/roles/e6bcb832ed6d4843825263e23d8fb208 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:13:26.177151 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55d934-7858-4c7b-865b-f80a9f61c486 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:26.200172 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 201/412] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:26.205812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a85bd9-004b-4fcd-b779-85e79d86a569 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:26.328878 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a85bd9-004b-4fcd-b779-85e79d86a569 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:26.366456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe774e7-5bf7-49f1-9499-ae8b485b2cd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:26.367329 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe774e7-5bf7-49f1-9499-ae8b485b2cd9 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:26.367635 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe774e7-5bf7-49f1-9499-ae8b485b2cd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:26.367913 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe774e7-5bf7-49f1-9499-ae8b485b2cd9 None admin] PATH_INFO: `/v3/groups/6d2cdb8a68cf4f0483f80012bada5c89` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:26.369105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe774e7-5bf7-49f1-9499-ae8b485b2cd9 None admin] RBAC: Authorizing `identity:get_group(group_id=6d2cdb8a68cf4f0483f80012bada5c89)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:26.370620 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe774e7-5bf7-49f1-9499-ae8b485b2cd9 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:26.372654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 212/413] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 00:13:26 2022] GET /identity/v3/groups/6d2cdb8a68cf4f0483f80012bada5c89 => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:26.378812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55d934-7858-4c7b-865b-f80a9f61c486 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:26.545612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55d934-7858-4c7b-865b-f80a9f61c486 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:26.562633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:26.582512 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd51358-4c5c-4745-9aae-2b2b799ed86d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:26.583396 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd51358-4c5c-4745-9aae-2b2b799ed86d None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:26.583715 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd51358-4c5c-4745-9aae-2b2b799ed86d None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:26.583992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd51358-4c5c-4745-9aae-2b2b799ed86d None admin] PATH_INFO: `/v3/projects/ec07de477e084ea786d462c55e9192b8` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:26.585198 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd51358-4c5c-4745-9aae-2b2b799ed86d None admin] RBAC: Authorizing `identity:get_project(project_id=ec07de477e084ea786d462c55e9192b8)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:26.586646 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd51358-4c5c-4745-9aae-2b2b799ed86d None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:26.593168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 202/414] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:26 2022] GET /identity/v3/projects/ec07de477e084ea786d462c55e9192b8 => generated 344 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:26.594473 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe774e7-5bf7-49f1-9499-ae8b485b2cd9 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:26.607977 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:26.699677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe774e7-5bf7-49f1-9499-ae8b485b2cd9 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:26.740939 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fddfc5-73ec-4810-be00-573fa659bd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:26.741861 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fddfc5-73ec-4810-be00-573fa659bd39 None admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:26.742149 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fddfc5-73ec-4810-be00-573fa659bd39 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:26.742430 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fddfc5-73ec-4810-be00-573fa659bd39 None admin] PATH_INFO: `/v3/projects/ec07de477e084ea786d462c55e9192b8/groups/6d2cdb8a68cf4f0483f80012bada5c89/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:26.745574 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fddfc5-73ec-4810-be00-573fa659bd39 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec07de477e084ea786d462c55e9192b8, group_id=6d2cdb8a68cf4f0483f80012bada5c89, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:26.747124 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fddfc5-73ec-4810-be00-573fa659bd39 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:26.768740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 213/415] 10.222.0.44 () {58 vars in 1442 bytes} [Thu Jun 16 00:13:26 2022] PUT /identity/v3/projects/ec07de477e084ea786d462c55e9192b8/groups/6d2cdb8a68cf4f0483f80012bada5c89/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:13:26.810883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b0927-1c34-453c-9350-d8b39373158b None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:26.811210 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b0927-1c34-453c-9350-d8b39373158b None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:26.811449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3b0927-1c34-453c-9350-d8b39373158b None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:26.813225 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 203/416] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:26.818834 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347ca14-e925-430a-8a4c-b1336f691a2d None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:26.819132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347ca14-e925-430a-8a4c-b1336f691a2d None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:26.819418 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347ca14-e925-430a-8a4c-b1336f691a2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:26.845247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-5347ca14-e925-430a-8a4c-b1336f691a2d None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:26.846494 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-5347ca14-e925-430a-8a4c-b1336f691a2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:26.934903 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:26.944103 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 214/417] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:26.984365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b0927-1c34-453c-9350-d8b39373158b None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:27.114902 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3b0927-1c34-453c-9350-d8b39373158b None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:27.161983 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede0f3e-1138-4529-8fac-79b3b0da275a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:27.162799 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede0f3e-1138-4529-8fac-79b3b0da275a None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:27.163084 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede0f3e-1138-4529-8fac-79b3b0da275a None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:27.163362 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dede0f3e-1138-4529-8fac-79b3b0da275a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:27.173783 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dede0f3e-1138-4529-8fac-79b3b0da275a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:27.182079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-dede0f3e-1138-4529-8fac-79b3b0da275a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:13:27.182079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:27.182079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:27.182079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:27.182079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:27.182079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:27.182079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:27.182079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:27.182079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:27.182079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:27.182079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:27.182079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:27.182079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:27.182079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:27.182079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:27.182079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:27.182976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:27.182976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:27.182976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:27.182976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:27.182976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:27.182976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:27.182976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:27.182976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:27.182976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:27.182976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:27.182976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:27.182976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:27.182976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:27.182976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:27.182976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:27.182976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:27.183786 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:27.183786 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:27.183786 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:27.183786 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:27.183786 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:27.183786 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:27.183786 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:27.183786 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:27.183786 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:27.183786 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:27.183786 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:13:27.183786 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:27.183786 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 204/418] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 00:13:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:27.191944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347ca14-e925-430a-8a4c-b1336f691a2d None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:27.294573 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347ca14-e925-430a-8a4c-b1336f691a2d None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:27.330376 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c936803-620b-42c8-8588-e224f159889d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:27.331355 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c936803-620b-42c8-8588-e224f159889d None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:27.331881 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c936803-620b-42c8-8588-e224f159889d None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:27.332896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c936803-620b-42c8-8588-e224f159889d None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:27.333872 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c936803-620b-42c8-8588-e224f159889d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:27.334359 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c936803-620b-42c8-8588-e224f159889d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:27.335934 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c936803-620b-42c8-8588-e224f159889d None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:27.345108 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 215/419] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:27.356695 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede0f3e-1138-4529-8fac-79b3b0da275a None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:27.434045 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:27.509920 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dede0f3e-1138-4529-8fac-79b3b0da275a None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:27.565932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e10a774-905b-4a4d-aa00-9dcc2c68776b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:27.567187 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10a774-905b-4a4d-aa00-9dcc2c68776b None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:27.567470 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10a774-905b-4a4d-aa00-9dcc2c68776b None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:27.567771 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e10a774-905b-4a4d-aa00-9dcc2c68776b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:27.617821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb740e5-04ad-4ddd-902c-849dc67942df None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:27.618522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb740e5-04ad-4ddd-902c-849dc67942df None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:27.619033 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb740e5-04ad-4ddd-902c-849dc67942df None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:27.621755 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 216/420] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:27.627069 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901080f-1ca2-4a77-9dbb-85b47fde8720 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:27.628190 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901080f-1ca2-4a77-9dbb-85b47fde8720 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:27.628673 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4901080f-1ca2-4a77-9dbb-85b47fde8720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:27.650606 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-4901080f-1ca2-4a77-9dbb-85b47fde8720 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:27.652268 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-4901080f-1ca2-4a77-9dbb-85b47fde8720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:27.688763 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10a774-905b-4a4d-aa00-9dcc2c68776b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:27.690203 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e10a774-905b-4a4d-aa00-9dcc2c68776b None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:27.719985 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:27.731100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 217/421] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:13:27.758013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901080f-1ca2-4a77-9dbb-85b47fde8720 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:27.841502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:27.879733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4901080f-1ca2-4a77-9dbb-85b47fde8720 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:27.959603 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f149f9b3-5371-45b7-a3c5-d4887342f6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:27.960449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149f9b3-5371-45b7-a3c5-d4887342f6af None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:27.960733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149f9b3-5371-45b7-a3c5-d4887342f6af None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:27.961009 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f149f9b3-5371-45b7-a3c5-d4887342f6af None admin] PATH_INFO: `/v3/roles/member` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:27.962469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 205/422] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:13:27.968453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903fe61-5280-460f-86e4-650499c8fb6e None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:27.968981 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903fe61-5280-460f-86e4-650499c8fb6e None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:27.969479 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a903fe61-5280-460f-86e4-650499c8fb6e None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:27.971037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 206/423] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:27 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:27.971955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903fe61-5280-460f-86e4-650499c8fb6e None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:27.975728 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f149f9b3-5371-45b7-a3c5-d4887342f6af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:27.985293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-f149f9b3-5371-45b7-a3c5-d4887342f6af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:27.985293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:27.985293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:27.985293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:27.985293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:27.985293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:27.985293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:27.985293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:27.985293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:27.985293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:27.985293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:27.985293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:27.985293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:27.985293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:27.985293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:27.985293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:27.986285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:27.986285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:27.986285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:27.986285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:27.986285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:27.986285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:27.986285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:27.986285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:27.986285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:27.986285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:27.986285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:27.986285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:27.986285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:27.986285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:27.986285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:27.986285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:27.987071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:27.987071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:27.987071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:27.987071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:27.987071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:27.987071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:27.987071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:27.987071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:27.987071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:27.987071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:27.987071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:27.987071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:27.989611 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 218/424] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:13:27.991048 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbd0c3-4040-46d2-8d05-8714c2ae8d6c None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:27.991532 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbd0c3-4040-46d2-8d05-8714c2ae8d6c None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:27.993291 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbd0c3-4040-46d2-8d05-8714c2ae8d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:28.018203 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-5dcbd0c3-4040-46d2-8d05-8714c2ae8d6c None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:28.020654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-5dcbd0c3-4040-46d2-8d05-8714c2ae8d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:28.080626 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:28.111740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 219/425] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:28.111740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbd0c3-4040-46d2-8d05-8714c2ae8d6c None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:28.115025 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a903fe61-5280-460f-86e4-650499c8fb6e None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:28.164558 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ce1b0-8734-43e3-8fb7-3408d61fde7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:28.166409 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ce1b0-8734-43e3-8fb7-3408d61fde7d None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:28.166804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ce1b0-8734-43e3-8fb7-3408d61fde7d None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:28.167206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ce1b0-8734-43e3-8fb7-3408d61fde7d None admin] PATH_INFO: `/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:28.169329 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ce1b0-8734-43e3-8fb7-3408d61fde7d None admin] RBAC: Authorizing `identity:get_project(project_id=b5d7f8028eb1486d8dbc58cd5d98a225)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:28.171723 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108ce1b0-8734-43e3-8fb7-3408d61fde7d None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:28.174855 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 207/426] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:27 2022] GET /identity/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225 => generated 298 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:28.176703 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ce1b0-8734-43e3-8fb7-3408d61fde7d None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:28.196286 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:28.243190 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbd0c3-4040-46d2-8d05-8714c2ae8d6c None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:28.288460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff922ef-25f0-485e-b025-7a9c23e786e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:28.289383 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff922ef-25f0-485e-b025-7a9c23e786e8 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:28.290087 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff922ef-25f0-485e-b025-7a9c23e786e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:28.290374 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff922ef-25f0-485e-b025-7a9c23e786e8 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:28.291136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff922ef-25f0-485e-b025-7a9c23e786e8 None admin] RBAC: Adding query filter params (name=member) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:28.291448 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff922ef-25f0-485e-b025-7a9c23e786e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:28.293459 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff922ef-25f0-485e-b025-7a9c23e786e8 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:28.305043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ce1b0-8734-43e3-8fb7-3408d61fde7d None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:28.307711 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 220/427] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:13:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:28.308555 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff922ef-25f0-485e-b025-7a9c23e786e8 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:28.346020 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc085ff6-ae61-4075-baab-e402a37e5a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:28.346815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc085ff6-ae61-4075-baab-e402a37e5a33 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:28.347092 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc085ff6-ae61-4075-baab-e402a37e5a33 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:28.347483 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc085ff6-ae61-4075-baab-e402a37e5a33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:28.357900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc085ff6-ae61-4075-baab-e402a37e5a33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:28.365872 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:28.366201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-dc085ff6-ae61-4075-baab-e402a37e5a33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:28.366201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:28.366201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:28.366201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:28.366201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:28.366201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:28.366201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:28.366201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:28.366201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:28.366201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:28.366201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:28.366201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:28.366201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:28.366201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:28.366201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:28.366201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:28.369157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:28.369157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:28.369157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:28.369157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:28.369157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:28.369157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:28.369157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:28.369157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:28.369157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:28.369157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:28.369157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:28.369157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:28.369157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:28.369157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:28.369157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:28.369157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:28.371107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:28.371107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:28.371107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:28.371107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:28.371107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:28.371107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:28.371107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:28.371107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:28.371107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:28.371107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:28.371107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 16 00:13:28.371107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:28.372892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 208/428] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:28.379691 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc085ff6-ae61-4075-baab-e402a37e5a33 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:28.443978 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff922ef-25f0-485e-b025-7a9c23e786e8 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:28.454850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:28.482898 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33421378-11c2-462a-b732-dad0305413ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:28.484065 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33421378-11c2-462a-b732-dad0305413ab None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:28.484530 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33421378-11c2-462a-b732-dad0305413ab None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:28.485005 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33421378-11c2-462a-b732-dad0305413ab None admin] PATH_INFO: `/v3/groups/38ff84729e1b473ea8f8d7b6177f32f1` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:28.485302 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc085ff6-ae61-4075-baab-e402a37e5a33 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:28.486667 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33421378-11c2-462a-b732-dad0305413ab None admin] RBAC: Authorizing `identity:get_group(group_id=38ff84729e1b473ea8f8d7b6177f32f1)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:28.488469 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33421378-11c2-462a-b732-dad0305413ab None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:28.490598 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 221/429] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 00:13:28 2022] GET /identity/v3/groups/38ff84729e1b473ea8f8d7b6177f32f1 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:28.491582 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33421378-11c2-462a-b732-dad0305413ab None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:28.520936 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfb815-3af7-4758-89e0-945ccc03c22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:28.521480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfb815-3af7-4758-89e0-945ccc03c22d None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:28.521764 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfb815-3af7-4758-89e0-945ccc03c22d None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:28.522037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bfb815-3af7-4758-89e0-945ccc03c22d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:28.591509 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfb815-3af7-4758-89e0-945ccc03c22d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:28.593271 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1bfb815-3af7-4758-89e0-945ccc03c22d None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:28.603204 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33421378-11c2-462a-b732-dad0305413ab None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:28.613958 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:28.642812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d1bb2-dec7-445f-8087-040d6a8dafb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:28.643936 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d1bb2-dec7-445f-8087-040d6a8dafb8 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:28.644448 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d1bb2-dec7-445f-8087-040d6a8dafb8 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:28.644959 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d1bb2-dec7-445f-8087-040d6a8dafb8 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:28.645905 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d1bb2-dec7-445f-8087-040d6a8dafb8 None admin] RBAC: Adding query filter params (name=member) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:28.646461 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d1bb2-dec7-445f-8087-040d6a8dafb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:28.648146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d1bb2-dec7-445f-8087-040d6a8dafb8 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:28.657590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 222/430] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:13:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:28.658747 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d1bb2-dec7-445f-8087-040d6a8dafb8 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:28.668562 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:28.701492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 209/431] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:13:28.706570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfb815-3af7-4758-89e0-945ccc03c22d None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:28.778495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d1bb2-dec7-445f-8087-040d6a8dafb8 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:28.805452 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bfb815-3af7-4758-89e0-945ccc03c22d None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:28.818271 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27540f6-a32d-43cf-97a2-a065258d75c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:28.819325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27540f6-a32d-43cf-97a2-a065258d75c7 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:28.819839 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27540f6-a32d-43cf-97a2-a065258d75c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:28.820439 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27540f6-a32d-43cf-97a2-a065258d75c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:28.821484 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27540f6-a32d-43cf-97a2-a065258d75c7 None admin] RBAC: Adding query filter params (group.id=38ff84729e1b473ea8f8d7b6177f32f1, role.id=e6bcb832ed6d4843825263e23d8fb208, scope.project.id=b5d7f8028eb1486d8dbc58cd5d98a225) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:28.821999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27540f6-a32d-43cf-97a2-a065258d75c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:28.823867 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27540f6-a32d-43cf-97a2-a065258d75c7 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:28.830814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 223/432] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 16 00:13:28 2022] GET /identity/v3/role_assignments?group.id=38ff84729e1b473ea8f8d7b6177f32f1&scope.project.id=b5d7f8028eb1486d8dbc58cd5d98a225&role.id=e6bcb832ed6d4843825263e23d8fb208 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:28.832062 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27540f6-a32d-43cf-97a2-a065258d75c7 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:28.840908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66cb89-cfc0-4340-b34b-0292758050dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:28.841568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66cb89-cfc0-4340-b34b-0292758050dd None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:28.841899 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66cb89-cfc0-4340-b34b-0292758050dd None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:28.842177 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66cb89-cfc0-4340-b34b-0292758050dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:28.873263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:28.888718 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:28.917643 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66cb89-cfc0-4340-b34b-0292758050dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:28.919528 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff66cb89-cfc0-4340-b34b-0292758050dd None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:28.954221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27540f6-a32d-43cf-97a2-a065258d75c7 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:28.992411 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66790af-630b-4518-9c56-d0f65339901a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:28.993681 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66790af-630b-4518-9c56-d0f65339901a None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:28.994170 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66790af-630b-4518-9c56-d0f65339901a None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:28.994662 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66790af-630b-4518-9c56-d0f65339901a None admin] PATH_INFO: `/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:28.996191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66790af-630b-4518-9c56-d0f65339901a None admin] RBAC: Authorizing `identity:get_project(project_id=b5d7f8028eb1486d8dbc58cd5d98a225)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:28.998015 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66790af-630b-4518-9c56-d0f65339901a None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:29.000057 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 224/433] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:28 2022] GET /identity/v3/projects/b5d7f8028eb1486d8dbc58cd5d98a225 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:29.016598 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66790af-630b-4518-9c56-d0f65339901a None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:29.038840 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 210/434] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:13:29.044173 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66cb89-cfc0-4340-b34b-0292758050dd None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:29.134730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66790af-630b-4518-9c56-d0f65339901a None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:29.136818 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:29.138821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:29.178219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28260e1-0754-4865-87a0-a7a5e88eef0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:29.179495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28260e1-0754-4865-87a0-a7a5e88eef0d None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:29.180018 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28260e1-0754-4865-87a0-a7a5e88eef0d None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:29.180682 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28260e1-0754-4865-87a0-a7a5e88eef0d None admin] PATH_INFO: `/v3/groups/38ff84729e1b473ea8f8d7b6177f32f1` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:29.181961 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66cb89-cfc0-4340-b34b-0292758050dd None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:29.182500 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28260e1-0754-4865-87a0-a7a5e88eef0d None admin] RBAC: Authorizing `identity:get_group(group_id=38ff84729e1b473ea8f8d7b6177f32f1)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:29.184315 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28260e1-0754-4865-87a0-a7a5e88eef0d None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:29.186613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 225/435] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 00:13:29 2022] GET /identity/v3/groups/38ff84729e1b473ea8f8d7b6177f32f1 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:29.193257 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28260e1-0754-4865-87a0-a7a5e88eef0d None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:29.223517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1469a4e-f046-42d9-98e0-c11df03917e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:29.224439 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1469a4e-f046-42d9-98e0-c11df03917e8 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:29.224729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1469a4e-f046-42d9-98e0-c11df03917e8 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:29.225298 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1469a4e-f046-42d9-98e0-c11df03917e8 None admin] PATH_INFO: `/v3/projects/27e0d304f3c644b2b8db92d18a19d41a` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:29.226336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1469a4e-f046-42d9-98e0-c11df03917e8 None admin] RBAC: Authorizing `identity:get_project(project_id=27e0d304f3c644b2b8db92d18a19d41a)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:29.227856 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1469a4e-f046-42d9-98e0-c11df03917e8 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:29.230827 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 211/436] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:29 2022] GET /identity/v3/projects/27e0d304f3c644b2b8db92d18a19d41a => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:29.236631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1469a4e-f046-42d9-98e0-c11df03917e8 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:29.322228 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28260e1-0754-4865-87a0-a7a5e88eef0d None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:29.350578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1469a4e-f046-42d9-98e0-c11df03917e8 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:29.356448 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe9d2fb-0652-4c9f-93e3-eab38233412c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:29.357106 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9d2fb-0652-4c9f-93e3-eab38233412c None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:29.357389 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9d2fb-0652-4c9f-93e3-eab38233412c None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:29.357675 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe9d2fb-0652-4c9f-93e3-eab38233412c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:29.358498 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9d2fb-0652-4c9f-93e3-eab38233412c None admin] RBAC: Adding query filter params (group.id=38ff84729e1b473ea8f8d7b6177f32f1, role.id=d6fedf23abb64cd494e8b49acefff423, scope.project.id=b5d7f8028eb1486d8dbc58cd5d98a225) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:29.358814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9d2fb-0652-4c9f-93e3-eab38233412c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:29.360280 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe9d2fb-0652-4c9f-93e3-eab38233412c None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:29.366038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 226/437] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 16 00:13:29 2022] GET /identity/v3/role_assignments?group.id=38ff84729e1b473ea8f8d7b6177f32f1&scope.project.id=b5d7f8028eb1486d8dbc58cd5d98a225&role.id=d6fedf23abb64cd494e8b49acefff423 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:29.367297 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b48a89-4182-41dd-9cd6-241bdddcf3e0 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:29.367590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b48a89-4182-41dd-9cd6-241bdddcf3e0 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:29.367905 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b48a89-4182-41dd-9cd6-241bdddcf3e0 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:29.369195 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 227/438] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:29.370401 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78450c-ba8d-443d-8354-713d7bd1615a None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:29.370690 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78450c-ba8d-443d-8354-713d7bd1615a None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:29.370969 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e78450c-ba8d-443d-8354-713d7bd1615a None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:29.372450 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 228/439] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:29.378408 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63eec1-148c-40ac-ac3b-ee4e7a969901 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:29.378702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63eec1-148c-40ac-ac3b-ee4e7a969901 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:29.379524 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b63eec1-148c-40ac-ac3b-ee4e7a969901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:29.391442 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bab613-c31c-4a3e-9e9b-339c8a98e48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:29.392609 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bab613-c31c-4a3e-9e9b-339c8a98e48e None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:29.393041 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bab613-c31c-4a3e-9e9b-339c8a98e48e None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:29.393468 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bab613-c31c-4a3e-9e9b-339c8a98e48e None admin] PATH_INFO: `/v3/groups/38ff84729e1b473ea8f8d7b6177f32f1` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:29.394966 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bab613-c31c-4a3e-9e9b-339c8a98e48e None admin] RBAC: Authorizing `identity:get_group(group_id=38ff84729e1b473ea8f8d7b6177f32f1)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:29.396821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bab613-c31c-4a3e-9e9b-339c8a98e48e None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:29.397261 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-7b63eec1-148c-40ac-ac3b-ee4e7a969901 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:29.398491 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-7b63eec1-148c-40ac-ac3b-ee4e7a969901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:29.399361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 212/440] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 00:13:29 2022] GET /identity/v3/groups/38ff84729e1b473ea8f8d7b6177f32f1 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:29.400820 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57b30e-9dc4-4189-8bc1-72e27e7d3219 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:29.401105 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57b30e-9dc4-4189-8bc1-72e27e7d3219 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:29.401379 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a57b30e-9dc4-4189-8bc1-72e27e7d3219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:29.419402 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-0a57b30e-9dc4-4189-8bc1-72e27e7d3219 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:29.420689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-0a57b30e-9dc4-4189-8bc1-72e27e7d3219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:29.423142 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:29.438527 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:29.485184 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 229/441] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:29.486433 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63eec1-148c-40ac-ac3b-ee4e7a969901 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:29.523998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 213/442] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:29.525093 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57b30e-9dc4-4189-8bc1-72e27e7d3219 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:29.611394 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b63eec1-148c-40ac-ac3b-ee4e7a969901 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:29.635246 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a57b30e-9dc4-4189-8bc1-72e27e7d3219 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:29.653394 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b33bff-8e51-4513-af5f-f279d1c4ba84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:29.654052 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b33bff-8e51-4513-af5f-f279d1c4ba84 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:29.654331 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b33bff-8e51-4513-af5f-f279d1c4ba84 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:29.654606 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b33bff-8e51-4513-af5f-f279d1c4ba84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:29.655476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b33bff-8e51-4513-af5f-f279d1c4ba84 None admin] RBAC: Adding query filter params (group.id=38ff84729e1b473ea8f8d7b6177f32f1, role.id=d6fedf23abb64cd494e8b49acefff423, scope.project.id=27e0d304f3c644b2b8db92d18a19d41a) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:29.655819 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b33bff-8e51-4513-af5f-f279d1c4ba84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:29.658792 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b33bff-8e51-4513-af5f-f279d1c4ba84 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:29.665061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 230/443] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 16 00:13:29 2022] GET /identity/v3/role_assignments?group.id=38ff84729e1b473ea8f8d7b6177f32f1&scope.project.id=27e0d304f3c644b2b8db92d18a19d41a&role.id=d6fedf23abb64cd494e8b49acefff423 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:29.666041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b33bff-8e51-4513-af5f-f279d1c4ba84 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:29.676476 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733ec31-09fd-43bc-82e2-9102d61ddf60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:29.677324 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733ec31-09fd-43bc-82e2-9102d61ddf60 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:29.677607 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733ec31-09fd-43bc-82e2-9102d61ddf60 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:29.677883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f733ec31-09fd-43bc-82e2-9102d61ddf60 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:29.688388 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:29.694047 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f733ec31-09fd-43bc-82e2-9102d61ddf60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:29.702980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-f733ec31-09fd-43bc-82e2-9102d61ddf60 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:13:29.702980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:29.702980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:29.702980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:29.702980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:29.702980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:29.702980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:29.702980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:29.702980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:29.702980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:29.702980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:29.702980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:29.702980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:29.702980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:29.702980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:29.702980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:29.704118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:29.704118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:29.704118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:29.704118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:29.704118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:29.704118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:29.704118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:29.704118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:29.704118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:29.704118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:29.704118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:29.704118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:29.704118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:29.704118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:29.704118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:29.704118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:29.704945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:29.704945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:29.704945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:29.704945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:29.704945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:29.704945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:29.704945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:29.704945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:29.704945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:29.704945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:29.704945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:13:29.704945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:29.704945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 214/444] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 00:13:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:29.707638 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:29.712477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733ec31-09fd-43bc-82e2-9102d61ddf60 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:29.801464 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b33bff-8e51-4513-af5f-f279d1c4ba84 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:29.849873 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f733ec31-09fd-43bc-82e2-9102d61ddf60 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:29.855120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026464b-af44-4967-bccd-7e7806cc6575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:29.855120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026464b-af44-4967-bccd-7e7806cc6575 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:29.855120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026464b-af44-4967-bccd-7e7806cc6575 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:29.855120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8026464b-af44-4967-bccd-7e7806cc6575 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:29.866898 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8026464b-af44-4967-bccd-7e7806cc6575 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:29.875557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-8026464b-af44-4967-bccd-7e7806cc6575 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:29.875557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:29.875557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:29.875557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:29.875557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:29.875557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:29.875557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:29.875557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:29.875557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:29.875557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:29.875557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:29.875557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:29.875557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:29.875557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:29.875557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:29.875557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:29.876522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:29.876522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:29.876522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:29.876522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:29.876522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:29.876522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:29.876522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:29.876522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:29.876522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:29.876522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:29.876522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:29.876522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:29.876522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:29.876522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:29.876522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:29.876522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:29.877304 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:29.877304 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:29.877304 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:29.877304 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:29.877304 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:29.877304 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:29.877304 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:29.877304 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:29.877304 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:29.877304 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:29.877304 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:29.877304 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:29.879655 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 231/445] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:13:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:29.885919 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026464b-af44-4967-bccd-7e7806cc6575 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:29.888214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f17d1f-0585-4702-99fb-a137e03a7a9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:29.888893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f17d1f-0585-4702-99fb-a137e03a7a9d None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:29.889178 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f17d1f-0585-4702-99fb-a137e03a7a9d None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:29.889518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f17d1f-0585-4702-99fb-a137e03a7a9d None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:29.890271 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f17d1f-0585-4702-99fb-a137e03a7a9d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:29.890635 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f17d1f-0585-4702-99fb-a137e03a7a9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:29.892150 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f17d1f-0585-4702-99fb-a137e03a7a9d None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:29.903169 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 215/446] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:29.911383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f17d1f-0585-4702-99fb-a137e03a7a9d None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:29.979809 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:29.998960 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:30.014301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8026464b-af44-4967-bccd-7e7806cc6575 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:30.026577 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f17d1f-0585-4702-99fb-a137e03a7a9d None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:30.054565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517b46b-47f1-4a89-bcca-3514c3c9271e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:30.055243 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517b46b-47f1-4a89-bcca-3514c3c9271e None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:30.055537 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517b46b-47f1-4a89-bcca-3514c3c9271e None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:30.055840 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4517b46b-47f1-4a89-bcca-3514c3c9271e None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:30.056599 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4517b46b-47f1-4a89-bcca-3514c3c9271e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:30.057000 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4517b46b-47f1-4a89-bcca-3514c3c9271e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:30.058292 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4517b46b-47f1-4a89-bcca-3514c3c9271e None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:30.068767 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8df271-b2fd-4058-a42a-314a35aad506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:30.069432 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8df271-b2fd-4058-a42a-314a35aad506 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:30.069720 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8df271-b2fd-4058-a42a-314a35aad506 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:30.069845 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 232/447] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:30.070013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8df271-b2fd-4058-a42a-314a35aad506 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:30.075380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517b46b-47f1-4a89-bcca-3514c3c9271e None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:30.154086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8df271-b2fd-4058-a42a-314a35aad506 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:30.155480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8df271-b2fd-4058-a42a-314a35aad506 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:30.190896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4517b46b-47f1-4a89-bcca-3514c3c9271e None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:30.212152 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:30.223604 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b50a28-e208-41ff-86b4-36a5eb764b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:30.224271 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b50a28-e208-41ff-86b4-36a5eb764b0a None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:30.224552 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b50a28-e208-41ff-86b4-36a5eb764b0a None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:30.224825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b50a28-e208-41ff-86b4-36a5eb764b0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:30.243268 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:30.254401 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 216/448] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:13:30.260043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8df271-b2fd-4058-a42a-314a35aad506 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:30.292371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b50a28-e208-41ff-86b4-36a5eb764b0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:30.293829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b50a28-e208-41ff-86b4-36a5eb764b0a None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:30.358632 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8df271-b2fd-4058-a42a-314a35aad506 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:30.390672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 233/449] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:13:30.396294 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69860ffd-e798-4be9-b060-6f14355dae79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:30.396621 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b50a28-e208-41ff-86b4-36a5eb764b0a None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:30.397159 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69860ffd-e798-4be9-b060-6f14355dae79 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:30.397448 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69860ffd-e798-4be9-b060-6f14355dae79 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:30.397725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69860ffd-e798-4be9-b060-6f14355dae79 None admin] PATH_INFO: `/v3/projects/27e0d304f3c644b2b8db92d18a19d41a` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:30.398932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69860ffd-e798-4be9-b060-6f14355dae79 None admin] RBAC: Authorizing `identity:get_project(project_id=27e0d304f3c644b2b8db92d18a19d41a)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:30.400418 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69860ffd-e798-4be9-b060-6f14355dae79 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:30.402215 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 217/450] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:30 2022] GET /identity/v3/projects/27e0d304f3c644b2b8db92d18a19d41a => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:30.407264 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69860ffd-e798-4be9-b060-6f14355dae79 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:30.435074 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:30.444538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:30.493840 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b50a28-e208-41ff-86b4-36a5eb764b0a None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:30.504511 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69860ffd-e798-4be9-b060-6f14355dae79 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:30.526595 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124c165-4513-4eab-805a-b0f7573b6a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:30.527443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124c165-4513-4eab-805a-b0f7573b6a79 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:30.527925 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124c165-4513-4eab-805a-b0f7573b6a79 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:30.528203 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124c165-4513-4eab-805a-b0f7573b6a79 None admin] PATH_INFO: `/v3/projects/ec07de477e084ea786d462c55e9192b8` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:30.529542 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124c165-4513-4eab-805a-b0f7573b6a79 None admin] RBAC: Authorizing `identity:get_project(project_id=ec07de477e084ea786d462c55e9192b8)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:30.530982 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124c165-4513-4eab-805a-b0f7573b6a79 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:30.532675 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 234/451] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:13:30 2022] GET /identity/v3/projects/ec07de477e084ea786d462c55e9192b8 => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:30.538513 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124c165-4513-4eab-805a-b0f7573b6a79 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:30.539552 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142340f-e3a9-4df3-be78-0436d233947a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:30.540449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142340f-e3a9-4df3-be78-0436d233947a None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:30.540732 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142340f-e3a9-4df3-be78-0436d233947a None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:30.541008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2142340f-e3a9-4df3-be78-0436d233947a None admin] PATH_INFO: `/v3/groups/38ff84729e1b473ea8f8d7b6177f32f1` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:30.542230 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142340f-e3a9-4df3-be78-0436d233947a None admin] RBAC: Authorizing `identity:get_group(group_id=38ff84729e1b473ea8f8d7b6177f32f1)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:30.543710 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2142340f-e3a9-4df3-be78-0436d233947a None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:30.545314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 218/452] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 00:13:30 2022] GET /identity/v3/groups/38ff84729e1b473ea8f8d7b6177f32f1 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:30.550844 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142340f-e3a9-4df3-be78-0436d233947a None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:30.640070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124c165-4513-4eab-805a-b0f7573b6a79 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:30.641693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:30.648349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2142340f-e3a9-4df3-be78-0436d233947a None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:30.659006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:30.676822 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9127a-ad25-45fb-a846-be3c7302f885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:30.677669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9127a-ad25-45fb-a846-be3c7302f885 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:30.677953 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9127a-ad25-45fb-a846-be3c7302f885 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:30.678227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f9127a-ad25-45fb-a846-be3c7302f885 None admin] PATH_INFO: `/v3/groups/6d2cdb8a68cf4f0483f80012bada5c89` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:30.679431 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9127a-ad25-45fb-a846-be3c7302f885 None admin] RBAC: Authorizing `identity:get_group(group_id=6d2cdb8a68cf4f0483f80012bada5c89)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:30.680938 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f9127a-ad25-45fb-a846-be3c7302f885 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:30.681947 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c063fc2b-69c7-42d8-9a63-56792bf69ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:30.682542 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 235/453] 10.222.0.44 () {56 vars in 1180 bytes} [Thu Jun 16 00:13:30 2022] GET /identity/v3/groups/6d2cdb8a68cf4f0483f80012bada5c89 => generated 229 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:30.682666 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063fc2b-69c7-42d8-9a63-56792bf69ed9 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:30.682874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063fc2b-69c7-42d8-9a63-56792bf69ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:30.683155 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063fc2b-69c7-42d8-9a63-56792bf69ed9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:30.684101 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063fc2b-69c7-42d8-9a63-56792bf69ed9 None admin] RBAC: Adding query filter params (group.id=38ff84729e1b473ea8f8d7b6177f32f1, role.id=e6bcb832ed6d4843825263e23d8fb208, scope.project.id=27e0d304f3c644b2b8db92d18a19d41a) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:30.684424 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063fc2b-69c7-42d8-9a63-56792bf69ed9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:30.685865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c063fc2b-69c7-42d8-9a63-56792bf69ed9 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:30.688261 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9127a-ad25-45fb-a846-be3c7302f885 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:30.695659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 219/454] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 16 00:13:30 2022] GET /identity/v3/role_assignments?group.id=38ff84729e1b473ea8f8d7b6177f32f1&scope.project.id=27e0d304f3c644b2b8db92d18a19d41a&role.id=e6bcb832ed6d4843825263e23d8fb208 => generated 611 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:30.795769 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f9127a-ad25-45fb-a846-be3c7302f885 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:30.831884 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e9241-aba0-47ea-9a35-707ba8478011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:30.833138 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e9241-aba0-47ea-9a35-707ba8478011 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:30.833427 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e9241-aba0-47ea-9a35-707ba8478011 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:30.833705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e9241-aba0-47ea-9a35-707ba8478011 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:30.834551 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e9241-aba0-47ea-9a35-707ba8478011 None admin] RBAC: Adding query filter params (group.id=6d2cdb8a68cf4f0483f80012bada5c89, role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab, scope.project.id=ec07de477e084ea786d462c55e9192b8) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:30.834866 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e9241-aba0-47ea-9a35-707ba8478011 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:30.836341 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680e9241-aba0-47ea-9a35-707ba8478011 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:30.842920 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 236/455] 10.222.0.44 () {56 vars in 1376 bytes} [Thu Jun 16 00:13:30 2022] GET /identity/v3/role_assignments?group.id=6d2cdb8a68cf4f0483f80012bada5c89&scope.project.id=ec07de477e084ea786d462c55e9192b8&role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 611 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:33.392383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd491270-f0b8-4c27-a087-51ae7f1a966d None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:33.392925 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd491270-f0b8-4c27-a087-51ae7f1a966d None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:33.392925 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd491270-f0b8-4c27-a087-51ae7f1a966d None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:33.395095 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 220/456] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:33.400581 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce973c7-6301-4594-8f73-0ef8be91be09 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:33.400980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce973c7-6301-4594-8f73-0ef8be91be09 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:33.401148 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce973c7-6301-4594-8f73-0ef8be91be09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:33.419913 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-bce973c7-6301-4594-8f73-0ef8be91be09 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:33.425084 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-bce973c7-6301-4594-8f73-0ef8be91be09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:33.488217 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:33.518166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 237/457] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:13:33.564258 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd491270-f0b8-4c27-a087-51ae7f1a966d None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:33.604556 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0366c-daff-4729-9a03-ff4e7cb7abf0 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:33.605187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0366c-daff-4729-9a03-ff4e7cb7abf0 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:33.605674 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0366c-daff-4729-9a03-ff4e7cb7abf0 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:33.607279 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 238/458] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:13:33.625927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3fcbd-40c6-44ca-80a0-870b2744f272 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:33.626519 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3fcbd-40c6-44ca-80a0-870b2744f272 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:33.627001 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e3fcbd-40c6-44ca-80a0-870b2744f272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:33.655955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-c1e3fcbd-40c6-44ca-80a0-870b2744f272 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:33.657477 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-c1e3fcbd-40c6-44ca-80a0-870b2744f272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:33.686535 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd491270-f0b8-4c27-a087-51ae7f1a966d None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:33.721959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eeafbb-ac8a-4df1-b3df-dbbfa6cf67e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:33.723492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eeafbb-ac8a-4df1-b3df-dbbfa6cf67e5 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:33.723895 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eeafbb-ac8a-4df1-b3df-dbbfa6cf67e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:33.724178 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eeafbb-ac8a-4df1-b3df-dbbfa6cf67e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:33.734838 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eeafbb-ac8a-4df1-b3df-dbbfa6cf67e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:33.736349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eeafbb-ac8a-4df1-b3df-dbbfa6cf67e5 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:33.755855 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-59eeafbb-ac8a-4df1-b3df-dbbfa6cf67e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:33.755855 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:33.755855 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:33.755855 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:33.755855 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:33.755855 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:33.755855 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:33.755855 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:33.755855 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:33.755855 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:33.755855 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:33.755855 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:33.755855 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:33.755855 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:33.755855 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:33.756774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:33.756774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:33.756774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:33.756774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:33.756774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:33.756774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:33.756774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:33.756774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:33.756774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:33.756774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:33.756774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:33.756774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:33.756774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:33.756774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:33.756774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:33.756774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:33.756774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:33.758031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:33.758031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:33.758031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:33.758031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:33.758031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 221/459] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:33.762895 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eeafbb-ac8a-4df1-b3df-dbbfa6cf67e5 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:33.796003 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:33.801081 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 239/460] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:33.836607 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3fcbd-40c6-44ca-80a0-870b2744f272 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:33.935295 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eeafbb-ac8a-4df1-b3df-dbbfa6cf67e5 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:33.973572 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e3fcbd-40c6-44ca-80a0-870b2744f272 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:33.981159 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e866c07-3eb6-4181-ac1f-68639c6aff92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:33.982345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e866c07-3eb6-4181-ac1f-68639c6aff92 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:33.982636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e866c07-3eb6-4181-ac1f-68639c6aff92 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:33.982915 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e866c07-3eb6-4181-ac1f-68639c6aff92 None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:33.983665 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e866c07-3eb6-4181-ac1f-68639c6aff92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:33.983984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e866c07-3eb6-4181-ac1f-68639c6aff92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:33.985865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e866c07-3eb6-4181-ac1f-68639c6aff92 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:33.987203 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:34.011846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 222/461] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:34.013487 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65bfe2-e2a5-40d3-8602-2e232bdeda04 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:34.013977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65bfe2-e2a5-40d3-8602-2e232bdeda04 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:34.014448 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca65bfe2-e2a5-40d3-8602-2e232bdeda04 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:34.019710 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 223/462] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:34.020307 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513493f3-f2a5-4f96-9c40-b15c5dcb999b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:34.021040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65bfe2-e2a5-40d3-8602-2e232bdeda04 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:34.021965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513493f3-f2a5-4f96-9c40-b15c5dcb999b None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:34.022248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513493f3-f2a5-4f96-9c40-b15c5dcb999b None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:34.022952 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513493f3-f2a5-4f96-9c40-b15c5dcb999b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:34.037292 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513493f3-f2a5-4f96-9c40-b15c5dcb999b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:34.039488 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513493f3-f2a5-4f96-9c40-b15c5dcb999b None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:34.061160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-513493f3-f2a5-4f96-9c40-b15c5dcb999b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:34.061160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:34.061160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:34.061160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:34.061160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:34.061160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:34.061160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:34.061160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:34.061160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:34.061160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:34.061160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:34.061160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:34.061160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:34.061160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:34.061160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:34.062013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:34.062013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:34.062013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:34.062013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:34.062013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:34.062013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:34.062013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:34.062013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:34.062013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:34.062013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:34.062013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:34.062013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:34.062013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:34.062013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:34.062013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:34.062013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:34.062013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:34.062845 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:34.062845 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:34.062845 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:34.062845 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:34.065116 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 240/463] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:34.066605 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a6808-e628-4c7f-824c-baf7809ee2de None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:34.067098 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a6808-e628-4c7f-824c-baf7809ee2de None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:34.067573 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a6808-e628-4c7f-824c-baf7809ee2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:34.085305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-e15a6808-e628-4c7f-824c-baf7809ee2de None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:34.086891 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-e15a6808-e628-4c7f-824c-baf7809ee2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:34.111050 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:34.155291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca65bfe2-e2a5-40d3-8602-2e232bdeda04 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:34.175634 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 241/464] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:34.175634 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a6808-e628-4c7f-824c-baf7809ee2de None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:34.193558 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e181339a-bf3f-403f-b4ad-876074e07551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:34.194588 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181339a-bf3f-403f-b4ad-876074e07551 None admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:34.194877 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181339a-bf3f-403f-b4ad-876074e07551 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:34.195153 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e181339a-bf3f-403f-b4ad-876074e07551 None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:34.195891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181339a-bf3f-403f-b4ad-876074e07551 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:34.197330 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e181339a-bf3f-403f-b4ad-876074e07551 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:34.220413 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 224/465] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 00:13:34 2022] POST /identity/v3/users => generated 246 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:13:34.221701 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a15e83-40a7-4c74-9375-f73b4c614803 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:34.222036 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a15e83-40a7-4c74-9375-f73b4c614803 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:34.222319 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a15e83-40a7-4c74-9375-f73b4c614803 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:34.223856 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 225/466] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:34.228571 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a15e83-40a7-4c74-9375-f73b4c614803 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:34.291308 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:34.302472 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a6808-e628-4c7f-824c-baf7809ee2de None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:34.341381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23baf1a-15d8-445a-8bc9-7961644a2110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:34.342062 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23baf1a-15d8-445a-8bc9-7961644a2110 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:34.342339 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23baf1a-15d8-445a-8bc9-7961644a2110 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:34.342614 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23baf1a-15d8-445a-8bc9-7961644a2110 None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:34.343341 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23baf1a-15d8-445a-8bc9-7961644a2110 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:34.343684 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23baf1a-15d8-445a-8bc9-7961644a2110 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:34.345108 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23baf1a-15d8-445a-8bc9-7961644a2110 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:34.358145 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 242/467] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:34.364381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30910c17-936d-413b-bcbd-e6b40473a120 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:34.364662 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30910c17-936d-413b-bcbd-e6b40473a120 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:34.365152 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30910c17-936d-413b-bcbd-e6b40473a120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:34.380549 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a15e83-40a7-4c74-9375-f73b4c614803 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:34.385030 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-30910c17-936d-413b-bcbd-e6b40473a120 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:34.386263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-30910c17-936d-413b-bcbd-e6b40473a120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:34.420784 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:34.438379 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd145f50-b3d8-42a1-b915-8d70d97cccaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:34.439181 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd145f50-b3d8-42a1-b915-8d70d97cccaa None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:34.439469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd145f50-b3d8-42a1-b915-8d70d97cccaa None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:34.439775 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd145f50-b3d8-42a1-b915-8d70d97cccaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:34.452598 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd145f50-b3d8-42a1-b915-8d70d97cccaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:34.454024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd145f50-b3d8-42a1-b915-8d70d97cccaa None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:34.466210 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 243/468] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:34.466878 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30910c17-936d-413b-bcbd-e6b40473a120 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:34.481148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-bd145f50-b3d8-42a1-b915-8d70d97cccaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:34.481148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:34.481148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:34.481148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:34.481148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:34.481148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:34.481148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:34.481148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:34.481148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:34.481148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:34.481148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:34.481148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:34.481148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:34.481148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:34.481148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:34.481996 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:34.481996 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:34.481996 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:34.481996 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:34.481996 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:34.481996 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:34.481996 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:34.481996 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:34.481996 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:34.481996 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:34.481996 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:34.481996 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:34.481996 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:34.481996 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:34.481996 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:34.481996 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:34.481996 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:34.482853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:34.482853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:34.482853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:34.482853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:34.482853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 226/469] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:34.488160 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd145f50-b3d8-42a1-b915-8d70d97cccaa None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:34.579787 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:34.599694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30910c17-936d-413b-bcbd-e6b40473a120 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:34.604941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd145f50-b3d8-42a1-b915-8d70d97cccaa None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:34.635595 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a36a20-3392-44b3-9740-3615531aa13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:34.636350 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a36a20-3392-44b3-9740-3615531aa13c None admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:34.636635 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a36a20-3392-44b3-9740-3615531aa13c None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:34.636912 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a36a20-3392-44b3-9740-3615531aa13c None admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:34.637729 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a36a20-3392-44b3-9740-3615531aa13c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:34.639176 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a36a20-3392-44b3-9740-3615531aa13c None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:34.640914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8d8f1-9897-432b-9021-07040e1302d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:34.641577 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8d8f1-9897-432b-9021-07040e1302d9 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:34.641868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8d8f1-9897-432b-9021-07040e1302d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:34.642298 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a8d8f1-9897-432b-9021-07040e1302d9 None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:34.643029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8d8f1-9897-432b-9021-07040e1302d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:34.643384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8d8f1-9897-432b-9021-07040e1302d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:34.644880 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a8d8f1-9897-432b-9021-07040e1302d9 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:34.658125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 227/470] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:34.661729 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 244/471] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 00:13:34 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:13:34.664073 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8d8f1-9897-432b-9021-07040e1302d9 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:34.669607 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a36a20-3392-44b3-9740-3615531aa13c None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:34.757413 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:34.826415 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a8d8f1-9897-432b-9021-07040e1302d9 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:34.874844 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a36a20-3392-44b3-9740-3615531aa13c None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:34.879300 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba80c185-99de-4f9c-a148-e0f4e05db628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:34.880546 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80c185-99de-4f9c-a148-e0f4e05db628 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:34.880828 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80c185-99de-4f9c-a148-e0f4e05db628 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:34.881100 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba80c185-99de-4f9c-a148-e0f4e05db628 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:34.892804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba80c185-99de-4f9c-a148-e0f4e05db628 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:34.894282 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba80c185-99de-4f9c-a148-e0f4e05db628 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:34.913654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-ba80c185-99de-4f9c-a148-e0f4e05db628 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:34.913654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:34.913654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:34.913654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:34.913654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:34.913654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:34.913654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:34.913654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:34.913654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:34.913654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:34.913654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:34.913654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:34.913654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:34.913654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:34.913654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:34.914693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:34.914693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:34.914693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:34.914693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:34.914693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:34.914693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:34.914693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:34.914693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:34.914693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:34.914693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:34.914693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:34.914693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:34.914693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:34.914693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:34.914693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:34.914693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:34.914693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:34.915901 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:34.915901 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:34.915901 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:34.915901 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:34.915901 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 228/472] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:34.916324 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4743c4-3ee8-4e6a-84ce-59f0adea094b None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:34.916612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4743c4-3ee8-4e6a-84ce-59f0adea094b None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:34.916888 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4743c4-3ee8-4e6a-84ce-59f0adea094b None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:34.918136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8571bd-9eb7-4782-b446-cf3d4eed01bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:34.918315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 229/473] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:34.919127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8571bd-9eb7-4782-b446-cf3d4eed01bd None admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:34.919660 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8571bd-9eb7-4782-b446-cf3d4eed01bd None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:34.920110 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8571bd-9eb7-4782-b446-cf3d4eed01bd None admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:34.920683 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4743c4-3ee8-4e6a-84ce-59f0adea094b None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:34.921177 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8571bd-9eb7-4782-b446-cf3d4eed01bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:34.922883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8571bd-9eb7-4782-b446-cf3d4eed01bd None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:34.934161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:34.955823 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 245/474] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 00:13:34 2022] POST /identity/v3/users => generated 248 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:13:34.958692 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4021661-f9d9-4360-ab57-fcef7d73301f None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:34.959461 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4021661-f9d9-4360-ab57-fcef7d73301f None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:34.960060 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4021661-f9d9-4360-ab57-fcef7d73301f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:34.983910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-c4021661-f9d9-4360-ab57-fcef7d73301f None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:34.986301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-c4021661-f9d9-4360-ab57-fcef7d73301f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:35.080704 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:35.093362 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4743c4-3ee8-4e6a-84ce-59f0adea094b None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:35.125346 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 246/475] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:35.133690 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51bd02-e27b-4810-b07a-76ffd51be83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:35.134574 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51bd02-e27b-4810-b07a-76ffd51be83a None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:35.135054 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51bd02-e27b-4810-b07a-76ffd51be83a None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:35.135510 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c51bd02-e27b-4810-b07a-76ffd51be83a None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:35.136484 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51bd02-e27b-4810-b07a-76ffd51be83a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:35.136966 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51bd02-e27b-4810-b07a-76ffd51be83a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:35.138807 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c51bd02-e27b-4810-b07a-76ffd51be83a None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:35.152711 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 230/476] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:35.157840 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4021661-f9d9-4360-ab57-fcef7d73301f None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:35.162604 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51bd02-e27b-4810-b07a-76ffd51be83a None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:35.283106 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4021661-f9d9-4360-ab57-fcef7d73301f None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:35.288662 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c51bd02-e27b-4810-b07a-76ffd51be83a None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:35.311955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:35.326586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea3ab3-513a-4805-a063-e6b2a19ec9c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:35.327585 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea3ab3-513a-4805-a063-e6b2a19ec9c7 None admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:35.328240 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea3ab3-513a-4805-a063-e6b2a19ec9c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:35.328839 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dea3ab3-513a-4805-a063-e6b2a19ec9c7 None admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:35.329792 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea3ab3-513a-4805-a063-e6b2a19ec9c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:35.332371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dea3ab3-513a-4805-a063-e6b2a19ec9c7 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:35.333597 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcc650-054e-4c29-bf38-6139ac03d4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:35.334364 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcc650-054e-4c29-bf38-6139ac03d4fd None admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:35.334626 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcc650-054e-4c29-bf38-6139ac03d4fd None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:35.334896 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bcc650-054e-4c29-bf38-6139ac03d4fd None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:35.335699 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcc650-054e-4c29-bf38-6139ac03d4fd None admin] RBAC: Authorizing `identity:create_role()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:35.337071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bcc650-054e-4c29-bf38-6139ac03d4fd None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:35.344896 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.sql.core [None req-e9bcc650-054e-4c29-bf38-6139ac03d4fd None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 00:13:35.344896 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 00:13:35.344896 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [parameters: {'id': 'f49e7e4865a140d39bd3d567ce4651be', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 00:13:35.344896 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86525) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 00:13:35.360192 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 247/477] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 00:13:35 2022] POST /identity/v3/users => generated 249 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:13:35.365890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-e9bcc650-054e-4c29-bf38-6139ac03d4fd None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 00:13:35.365890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:35.365890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 00:13:35.365890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 00:13:35.365890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 00:13:35.365890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 00:13:35.365890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 00:13:35.365890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 00:13:35.365890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 00:13:35.365890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application conn.query(q) Jun 16 00:13:35.365890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 00:13:35.365890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 00:13:35.365890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 00:13:35.365890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application result.read() Jun 16 00:13:35.365890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 00:13:35.366785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 00:13:35.366785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 00:13:35.366785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 00:13:35.366785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 00:13:35.366785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 00:13:35.366785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 00:13:35.366785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 00:13:35.366785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 00:13:35.366785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:35.366785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 00:13:35.366785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:35.366785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:35.366785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 00:13:35.366785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 00:13:35.366785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 16 00:13:35.366785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return ref.to_dict() Jun 16 00:13:35.366785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 00:13:35.366785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application next(self.gen) Jun 16 00:13:35.367816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 00:13:35.367816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application yield resource Jun 16 00:13:35.367816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 00:13:35.367816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application next(self.gen) Jun 16 00:13:35.367816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 00:13:35.367816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 00:13:35.367816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 00:13:35.367816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 00:13:35.367816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 00:13:35.367816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise self.value Jun 16 00:13:35.367816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 00:13:35.367816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 00:13:35.367816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 00:13:35.367816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application session.commit() Jun 16 00:13:35.367816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 00:13:35.367816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 00:13:35.367816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 00:13:35.368651 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 00:13:35.368651 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 00:13:35.368651 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self.session.flush() Jun 16 00:13:35.368651 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 00:13:35.368651 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 00:13:35.368651 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 00:13:35.368651 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 00:13:35.368651 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 00:13:35.368651 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application compat.raise_( Jun 16 00:13:35.368651 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 00:13:35.368651 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception Jun 16 00:13:35.368651 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 00:13:35.368651 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 00:13:35.368651 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 00:13:35.368651 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 00:13:35.368651 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 00:13:35.368651 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 00:13:35.370139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 00:13:35.370139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 00:13:35.370139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 00:13:35.370139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 00:13:35.370139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 00:13:35.370139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 00:13:35.370139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 00:13:35.370139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 00:13:35.370139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 00:13:35.370139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 00:13:35.370139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 00:13:35.370139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 00:13:35.370139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 00:13:35.370139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 00:13:35.370139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 00:13:35.370139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception Jun 16 00:13:35.373605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 00:13:35.373605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 00:13:35.373605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 00:13:35.373605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 00:13:35.373605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 00:13:35.373605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 00:13:35.373605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 00:13:35.373605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application conn.query(q) Jun 16 00:13:35.373605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 00:13:35.373605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 00:13:35.373605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 00:13:35.373605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application result.read() Jun 16 00:13:35.373605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 00:13:35.373605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 00:13:35.373605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 00:13:35.373605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 00:13:35.375654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 00:13:35.375654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 00:13:35.375654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 00:13:35.375654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 00:13:35.375654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 16 00:13:35.375654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 16 00:13:35.375654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [parameters: {'id': 'f49e7e4865a140d39bd3d567ce4651be', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 16 00:13:35.375654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 00:13:35.375654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:35.375654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:13:35.375654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:35.375654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:35.375654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:35.375654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:35.375654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:35.375654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:35.378492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:35.378492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:35.378492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:35.378492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:35.378492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:35.378492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:35.378492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 16 00:13:35.378492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 16 00:13:35.378492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:35.378492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:35.378492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 16 00:13:35.378492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 16 00:13:35.378492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 00:13:35.378492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 00:13:35.378492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 16 00:13:35.378492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:35.380821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 231/478] 10.222.0.44 () {60 vars in 1131 bytes} [Thu Jun 16 00:13:35 2022] POST /identity/v3/roles => generated 144 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:35.380954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea3ab3-513a-4805-a063-e6b2a19ec9c7 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:35.492057 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dea3ab3-513a-4805-a063-e6b2a19ec9c7 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:35.531417 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84fbe9-c58f-403b-9ead-21282edc7f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:35.532304 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84fbe9-c58f-403b-9ead-21282edc7f52 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:35.532587 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84fbe9-c58f-403b-9ead-21282edc7f52 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:35.532947 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84fbe9-c58f-403b-9ead-21282edc7f52 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:35.546360 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84fbe9-c58f-403b-9ead-21282edc7f52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:35.555485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-2b84fbe9-c58f-403b-9ead-21282edc7f52 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:13:35.555485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:35.555485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:35.555485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:35.555485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:35.555485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:35.555485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:35.555485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:35.555485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:35.555485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:35.555485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:35.555485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:35.555485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:35.555485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:35.555485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:35.555485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:35.559032 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:35.559032 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:35.559032 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:35.559032 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:35.559032 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:35.559032 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:35.559032 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:35.559032 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:35.559032 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:35.559032 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:35.559032 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:35.559032 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:35.559032 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:35.559032 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:35.559032 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:35.559032 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:35.561286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:35.561286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:35.561286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:35.561286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:35.561286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:35.561286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:35.561286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:35.561286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:35.561286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:35.561286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:35.561286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 16 00:13:35.561286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:35.561286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 248/479] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 00:13:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:35.564684 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcc650-054e-4c29-bf38-6139ac03d4fd None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:35.595716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:35.693320 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bcc650-054e-4c29-bf38-6139ac03d4fd None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:35.728493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e554b248-7114-45af-985a-7c5d4f1cd9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:35.729453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554b248-7114-45af-985a-7c5d4f1cd9cb None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:35.729913 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554b248-7114-45af-985a-7c5d4f1cd9cb None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:35.730389 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e554b248-7114-45af-985a-7c5d4f1cd9cb None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:35.731313 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554b248-7114-45af-985a-7c5d4f1cd9cb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:35.731820 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554b248-7114-45af-985a-7c5d4f1cd9cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:35.733370 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e554b248-7114-45af-985a-7c5d4f1cd9cb None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:35.742756 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 232/480] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:36.774854 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4432379-1b5f-4c92-94d3-897f4b7228c7 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:36.775369 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4432379-1b5f-4c92-94d3-897f4b7228c7 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:36.775445 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4432379-1b5f-4c92-94d3-897f4b7228c7 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:36.777041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 249/481] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:36.782341 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd194a-ab33-4113-8038-84f91d6c88fa None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:36.783144 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd194a-ab33-4113-8038-84f91d6c88fa None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:36.783647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcd194a-ab33-4113-8038-84f91d6c88fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:36.806229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-9fcd194a-ab33-4113-8038-84f91d6c88fa None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:36.807662 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-9fcd194a-ab33-4113-8038-84f91d6c88fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:36.881829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 233/482] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:36.906960 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4432379-1b5f-4c92-94d3-897f4b7228c7 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:36.971900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:37.057238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4432379-1b5f-4c92-94d3-897f4b7228c7 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:37.105943 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cf0657-6e2a-463f-95e6-a80635957b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:37.106765 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf0657-6e2a-463f-95e6-a80635957b0a None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:37.107047 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf0657-6e2a-463f-95e6-a80635957b0a None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:37.107318 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf0657-6e2a-463f-95e6-a80635957b0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:37.127780 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cf0657-6e2a-463f-95e6-a80635957b0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:37.135951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-24cf0657-6e2a-463f-95e6-a80635957b0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:37.135951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:37.135951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:37.135951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:37.135951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:37.135951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:37.135951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:37.135951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:37.135951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:37.135951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:37.135951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:37.135951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:37.135951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:37.135951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:37.135951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:37.135951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:37.136829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:37.136829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:37.136829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:37.136829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:37.136829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:37.136829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:37.136829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:37.136829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:37.136829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:37.136829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:37.136829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:37.136829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:37.136829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:37.136829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:37.136829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:37.136829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:37.137624 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:37.137624 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:37.137624 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:37.137624 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:37.137624 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:37.137624 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:37.137624 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:37.137624 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:37.137624 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:37.137624 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:37.137624 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:37.137624 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:37.141770 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 250/483] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 00:13:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:37.143005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd194a-ab33-4113-8038-84f91d6c88fa None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:37.149685 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5967a5d-56d6-4f0b-b604-768d77b96c7c None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:37.149975 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5967a5d-56d6-4f0b-b604-768d77b96c7c None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:37.150258 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5967a5d-56d6-4f0b-b604-768d77b96c7c None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:37.157642 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 251/484] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:13:37.158370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e713a-7a37-4041-bd6b-ceace89c7a22 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:37.158654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e713a-7a37-4041-bd6b-ceace89c7a22 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:37.158931 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5e713a-7a37-4041-bd6b-ceace89c7a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:37.167954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:37.187276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-ba5e713a-7a37-4041-bd6b-ceace89c7a22 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:37.188496 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-ba5e713a-7a37-4041-bd6b-ceace89c7a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:37.312504 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 252/485] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:37.321735 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcd194a-ab33-4113-8038-84f91d6c88fa None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:37.353809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e713a-7a37-4041-bd6b-ceace89c7a22 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:37.387203 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fa0b2-0956-4d0d-ac51-ca887d912c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:37.387899 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fa0b2-0956-4d0d-ac51-ca887d912c0c None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:37.388182 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fa0b2-0956-4d0d-ac51-ca887d912c0c None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:37.388454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358fa0b2-0956-4d0d-ac51-ca887d912c0c None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:37.389202 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fa0b2-0956-4d0d-ac51-ca887d912c0c None admin] RBAC: Adding query filter params (name=service) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:37.389571 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fa0b2-0956-4d0d-ac51-ca887d912c0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:37.391965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:37.392140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358fa0b2-0956-4d0d-ac51-ca887d912c0c None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:37.412262 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 234/486] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 00:13:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:37.415903 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fa0b2-0956-4d0d-ac51-ca887d912c0c None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:37.520133 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5e713a-7a37-4041-bd6b-ceace89c7a22 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:37.558881 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebd9fb-be9b-43b3-8f2b-40eb3220174f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:37.559716 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebd9fb-be9b-43b3-8f2b-40eb3220174f None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:37.560059 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebd9fb-be9b-43b3-8f2b-40eb3220174f None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:37.560269 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebd9fb-be9b-43b3-8f2b-40eb3220174f None admin] PATH_INFO: `/v3/roles/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:37.572440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eebd9fb-be9b-43b3-8f2b-40eb3220174f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:37.581209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-8eebd9fb-be9b-43b3-8f2b-40eb3220174f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:37.581209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:37.581209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:37.581209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:37.581209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:37.581209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:37.581209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:37.581209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:37.581209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:37.581209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:37.581209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:37.581209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:37.581209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:37.581209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:37.581209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:37.581209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:37.582328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:37.582328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:37.582328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:37.582328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:37.582328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:37.582328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:37.582328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:37.582328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:37.582328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:37.582328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:37.582328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:37.582328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:37.582328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:37.582328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:37.582328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:37.582328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:37.583317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:37.583317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:37.583317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:37.583317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:37.583317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:37.583317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:37.583317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:37.583317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:37.583317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:37.583317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:37.583317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:37.583317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:37.585552 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 253/487] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 00:13:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:13:37.590334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebd9fb-be9b-43b3-8f2b-40eb3220174f None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:37.607982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:37.706413 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358fa0b2-0956-4d0d-ac51-ca887d912c0c None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:37.715959 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:37.732967 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebd9fb-be9b-43b3-8f2b-40eb3220174f None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:37.764072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4fb1f-43df-4dcb-ba50-ad4fdb17e6cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:37.765213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4fb1f-43df-4dcb-ba50-ad4fdb17e6cc None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:37.765637 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4fb1f-43df-4dcb-ba50-ad4fdb17e6cc None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:37.766084 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4fb1f-43df-4dcb-ba50-ad4fdb17e6cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:37.775214 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95607f72-8151-44de-8db7-2f38ed41f0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:37.775921 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95607f72-8151-44de-8db7-2f38ed41f0e5 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:37.776207 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95607f72-8151-44de-8db7-2f38ed41f0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:37.776485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95607f72-8151-44de-8db7-2f38ed41f0e5 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:37.777297 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95607f72-8151-44de-8db7-2f38ed41f0e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:37.777542 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95607f72-8151-44de-8db7-2f38ed41f0e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:37.778922 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95607f72-8151-44de-8db7-2f38ed41f0e5 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:37.779597 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4fb1f-43df-4dcb-ba50-ad4fdb17e6cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:37.781402 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4fb1f-43df-4dcb-ba50-ad4fdb17e6cc None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:37.793433 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 254/488] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 00:13:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:37.793433 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03091272-8a5b-4afe-8fc6-dbc67e1bbffd None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:37.793433 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03091272-8a5b-4afe-8fc6-dbc67e1bbffd None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:37.793433 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03091272-8a5b-4afe-8fc6-dbc67e1bbffd None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:37.793433 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 255/489] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:37.793433 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03091272-8a5b-4afe-8fc6-dbc67e1bbffd None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:37.808932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-eaa4fb1f-43df-4dcb-ba50-ad4fdb17e6cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:37.808932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:37.808932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:37.808932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:37.808932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:37.808932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:37.808932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:37.808932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:37.808932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:37.808932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:37.808932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:37.808932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:37.808932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:37.808932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:37.808932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:37.810044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:37.810044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:37.810044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:37.810044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:37.810044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:37.810044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:37.810044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:37.810044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:37.810044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:37.810044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:37.810044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:37.810044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:37.810044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:37.810044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:37.810044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:37.810044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:37.810044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:37.810891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:37.810891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:37.810891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:37.810891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:37.817458 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 235/490] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:13:37.819116 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb3904-78bb-4dd5-82e4-f5e452924c27 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:37.819635 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb3904-78bb-4dd5-82e4-f5e452924c27 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:37.820109 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bb3904-78bb-4dd5-82e4-f5e452924c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:37.838804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-96bb3904-78bb-4dd5-82e4-f5e452924c27 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:37.840411 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-96bb3904-78bb-4dd5-82e4-f5e452924c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:37.901529 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03091272-8a5b-4afe-8fc6-dbc67e1bbffd None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:37.923715 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 236/491] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:37.924994 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb3904-78bb-4dd5-82e4-f5e452924c27 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:37.938022 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8fbcc-a11b-45ca-8620-e8bd0e56abb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:37.938745 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8fbcc-a11b-45ca-8620-e8bd0e56abb4 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:37.939034 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8fbcc-a11b-45ca-8620-e8bd0e56abb4 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:37.939316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a8fbcc-a11b-45ca-8620-e8bd0e56abb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:37.961300 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8fbcc-a11b-45ca-8620-e8bd0e56abb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:37.963520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a8fbcc-a11b-45ca-8620-e8bd0e56abb4 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:37.986920 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-05a8fbcc-a11b-45ca-8620-e8bd0e56abb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:37.986920 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:37.986920 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:37.986920 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:37.986920 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:37.986920 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:37.986920 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:37.986920 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:37.986920 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:37.986920 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:37.986920 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:37.986920 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:37.986920 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:37.986920 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:37.986920 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:37.988019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:37.988019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:37.988019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:37.988019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:37.988019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:37.988019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:37.988019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:37.988019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:37.988019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:37.988019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:37.988019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:37.988019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:37.988019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:37.988019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:37.988019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:37.988019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:37.988019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:37.989619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:37.989619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:37.989619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:37.989619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:37.996846 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 256/492] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:37.997844 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8fbcc-a11b-45ca-8620-e8bd0e56abb4 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:38.003035 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:38.011042 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:38.064387 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bb3904-78bb-4dd5-82e4-f5e452924c27 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:38.102199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725289d-e9bc-4701-93fe-ea551befd342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:38.103286 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725289d-e9bc-4701-93fe-ea551befd342 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:38.103806 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725289d-e9bc-4701-93fe-ea551befd342 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:38.104276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5725289d-e9bc-4701-93fe-ea551befd342 None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:38.105184 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725289d-e9bc-4701-93fe-ea551befd342 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:38.105704 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725289d-e9bc-4701-93fe-ea551befd342 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:38.105991 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a8fbcc-a11b-45ca-8620-e8bd0e56abb4 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:38.107590 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5725289d-e9bc-4701-93fe-ea551befd342 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:38.125110 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 237/493] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:38.126276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725289d-e9bc-4701-93fe-ea551befd342 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:38.142067 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e4b0d-faeb-4deb-8a36-0b4c5fe22b89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:38.142868 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e4b0d-faeb-4deb-8a36-0b4c5fe22b89 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:38.143153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e4b0d-faeb-4deb-8a36-0b4c5fe22b89 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:38.143432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e4b0d-faeb-4deb-8a36-0b4c5fe22b89 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:38.155092 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e4b0d-faeb-4deb-8a36-0b4c5fe22b89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:38.163139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-e48e4b0d-faeb-4deb-8a36-0b4c5fe22b89 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:38.163139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:38.163139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:38.163139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:38.163139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:38.163139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:38.163139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:38.163139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:38.163139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:38.163139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:38.163139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:38.163139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:38.163139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:38.163139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:38.163139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:38.163139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:38.164030 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:38.164030 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:38.164030 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:38.164030 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:38.164030 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:38.164030 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:38.164030 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:38.164030 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:38.164030 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:38.164030 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:38.164030 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:38.164030 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:38.164030 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:38.164030 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:38.164030 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:38.164030 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:38.164829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:38.164829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:38.164829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:38.164829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:38.164829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:38.164829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:38.164829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:38.164829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:38.164829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:38.164829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:38.164829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:38.164829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:38.169721 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 257/494] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 00:13:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:38.170212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e4b0d-faeb-4deb-8a36-0b4c5fe22b89 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:38.239491 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:38.244666 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5725289d-e9bc-4701-93fe-ea551befd342 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:38.260383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:38.279370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e4b0d-faeb-4deb-8a36-0b4c5fe22b89 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:38.284090 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4a346-8761-482e-95dc-5c91cb678ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:38.284752 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4a346-8761-482e-95dc-5c91cb678ee0 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:38.285036 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4a346-8761-482e-95dc-5c91cb678ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:38.285837 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4a346-8761-482e-95dc-5c91cb678ee0 None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:38.286554 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4a346-8761-482e-95dc-5c91cb678ee0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:38.286857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4a346-8761-482e-95dc-5c91cb678ee0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:38.288258 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c4a346-8761-482e-95dc-5c91cb678ee0 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:38.301267 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 238/495] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:38.304486 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4a346-8761-482e-95dc-5c91cb678ee0 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:38.320308 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d813b40-5011-40b1-aba8-a1ed03e8eb1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:38.321337 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d813b40-5011-40b1-aba8-a1ed03e8eb1f None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:38.321804 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d813b40-5011-40b1-aba8-a1ed03e8eb1f None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:38.322080 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d813b40-5011-40b1-aba8-a1ed03e8eb1f None admin] PATH_INFO: `/v3/users/nova` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:38.330035 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d813b40-5011-40b1-aba8-a1ed03e8eb1f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:38.331495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d813b40-5011-40b1-aba8-a1ed03e8eb1f None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:38.347883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-0d813b40-5011-40b1-aba8-a1ed03e8eb1f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:13:38.347883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:38.347883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:38.347883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:38.347883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:38.347883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:38.347883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:38.347883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:38.347883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:38.347883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:38.347883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:38.347883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:38.347883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:13:38.347883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:13:38.347883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:13:38.347883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:13:38.348810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:38.348810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:38.348810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:13:38.348810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:38.348810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:13:38.348810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:38.348810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:38.348810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:38.348810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:38.348810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:38.348810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:38.348810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:38.348810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:38.348810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:38.348810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:38.348810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:38.348810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:38.348810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:38.349699 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:38.349699 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:38.349699 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:13:38.349699 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:13:38.349699 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:13:38.349699 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:13:38.349699 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:13:38.349699 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:13:38.349699 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:13:38.349699 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:38.349699 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 258/496] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 16 00:13:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:38.350562 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546c5d3-7f9c-459c-99fb-1fb1e0aa7dc6 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:38.350649 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546c5d3-7f9c-459c-99fb-1fb1e0aa7dc6 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:38.350894 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4546c5d3-7f9c-459c-99fb-1fb1e0aa7dc6 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:38.355938 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 259/497] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:38 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:38.356918 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546c5d3-7f9c-459c-99fb-1fb1e0aa7dc6 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:38.417175 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c4a346-8761-482e-95dc-5c91cb678ee0 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:38.455409 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1199c6-aab6-4655-acdc-7381761d5d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:38.456130 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1199c6-aab6-4655-acdc-7381761d5d7d None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:38.456410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1199c6-aab6-4655-acdc-7381761d5d7d None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:38.456709 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1199c6-aab6-4655-acdc-7381761d5d7d None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:38.457514 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1199c6-aab6-4655-acdc-7381761d5d7d None admin] RBAC: Adding query filter params (name=service) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:38.457819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1199c6-aab6-4655-acdc-7381761d5d7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:38.459262 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1199c6-aab6-4655-acdc-7381761d5d7d None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:38.467386 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4546c5d3-7f9c-459c-99fb-1fb1e0aa7dc6 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:38.468460 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 239/498] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 00:13:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:38.469314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1199c6-aab6-4655-acdc-7381761d5d7d None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:38.499760 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:38.510165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:38.514534 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3b2c7-1e44-4613-90c2-57ea4d75a70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:38.515344 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3b2c7-1e44-4613-90c2-57ea4d75a70f None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:38.515643 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3b2c7-1e44-4613-90c2-57ea4d75a70f None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:38.515930 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3b2c7-1e44-4613-90c2-57ea4d75a70f None admin] PATH_INFO: `/v3/users/glance` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:38.523968 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3b2c7-1e44-4613-90c2-57ea4d75a70f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:38.525435 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a3b2c7-1e44-4613-90c2-57ea4d75a70f None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:38.540139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-11a3b2c7-1e44-4613-90c2-57ea4d75a70f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 00:13:38.540139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:38.540139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:38.540139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:38.540139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:38.540139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:38.540139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:38.540139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:38.540139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:38.540139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:38.540139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:38.540139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:38.540139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:13:38.540139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:13:38.540139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:13:38.540139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:13:38.541024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:38.541024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:38.541024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:13:38.541024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:38.541024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:13:38.541024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:38.541024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:38.541024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:38.541024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:38.541024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:38.541024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:38.541024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:38.541024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:38.541024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:38.541024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:38.541024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:38.541024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:38.541024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:38.541896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:38.541896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:38.541896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:13:38.541896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:13:38.541896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:13:38.541896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:13:38.541896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:13:38.541896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:13:38.541896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 00:13:38.541896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:38.541896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 260/499] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:38.542937 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7948f-1c6d-49d9-a150-cd083fb9e39f None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:38.542937 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7948f-1c6d-49d9-a150-cd083fb9e39f None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:38.543056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a7948f-1c6d-49d9-a150-cd083fb9e39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:38.558922 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-36a7948f-1c6d-49d9-a150-cd083fb9e39f None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:38.560135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-36a7948f-1c6d-49d9-a150-cd083fb9e39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:38.578205 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1199c6-aab6-4655-acdc-7381761d5d7d None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:38.612447 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea686a71-bd18-4b63-808f-f82008a1a11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:38.613043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea686a71-bd18-4b63-808f-f82008a1a11a None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:38.613351 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea686a71-bd18-4b63-808f-f82008a1a11a None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:38.613625 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea686a71-bd18-4b63-808f-f82008a1a11a None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:38.614444 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea686a71-bd18-4b63-808f-f82008a1a11a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:38.614751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea686a71-bd18-4b63-808f-f82008a1a11a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:38.616203 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea686a71-bd18-4b63-808f-f82008a1a11a None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:38.626748 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 261/500] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:38.627731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7948f-1c6d-49d9-a150-cd083fb9e39f None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:38.653832 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 240/501] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 16 00:13:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:38.655452 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0232cab-b30f-445d-89cb-530ae31f7e0e None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:38.655777 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0232cab-b30f-445d-89cb-530ae31f7e0e None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:38.656046 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0232cab-b30f-445d-89cb-530ae31f7e0e None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:38.657259 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 241/502] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:38.657932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0232cab-b30f-445d-89cb-530ae31f7e0e None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:38.732839 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a7948f-1c6d-49d9-a150-cd083fb9e39f None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:38.747290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:38.747748 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:38.757962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0232cab-b30f-445d-89cb-530ae31f7e0e None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:38.768031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63e04c-c6b8-4f42-8f55-f427fb47da13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:38.768828 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63e04c-c6b8-4f42-8f55-f427fb47da13 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:38.769109 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63e04c-c6b8-4f42-8f55-f427fb47da13 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:38.769383 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63e04c-c6b8-4f42-8f55-f427fb47da13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:38.779857 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63e04c-c6b8-4f42-8f55-f427fb47da13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:38.781407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db63e04c-c6b8-4f42-8f55-f427fb47da13 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:38.791166 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dcb46-faad-4ee1-9213-ee83e08d7058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:38.791914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dcb46-faad-4ee1-9213-ee83e08d7058 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:38.792196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dcb46-faad-4ee1-9213-ee83e08d7058 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:38.792467 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6dcb46-faad-4ee1-9213-ee83e08d7058 None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:38.793290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6dcb46-faad-4ee1-9213-ee83e08d7058 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:38.793597 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6dcb46-faad-4ee1-9213-ee83e08d7058 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:38.795037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6dcb46-faad-4ee1-9213-ee83e08d7058 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:38.800041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-db63e04c-c6b8-4f42-8f55-f427fb47da13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:38.800041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:38.800041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:38.800041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:38.800041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:38.800041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:38.800041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:38.800041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:38.800041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:38.800041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:38.800041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:38.800041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:38.800041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:38.800041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:38.800041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:38.801600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:38.801600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:38.801600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:38.801600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:38.801600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:38.801600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:38.801600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:38.801600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:38.801600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:38.801600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:38.801600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:38.801600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:38.801600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:38.801600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:38.801600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:38.801600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:38.801600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:38.802661 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:38.802661 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:38.802661 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:38.802661 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:38.806315 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 262/503] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:38.806991 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63e04c-c6b8-4f42-8f55-f427fb47da13 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:38.817939 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 242/504] 10.222.0.44 () {56 vars in 1137 bytes} [Thu Jun 16 00:13:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:38.817939 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dcb46-faad-4ee1-9213-ee83e08d7058 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:38.905071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63e04c-c6b8-4f42-8f55-f427fb47da13 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:38.912346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6dcb46-faad-4ee1-9213-ee83e08d7058 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:38.938170 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c826dc32-bf61-494b-974c-2fe3717fe727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:38.938956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826dc32-bf61-494b-974c-2fe3717fe727 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:38.939238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826dc32-bf61-494b-974c-2fe3717fe727 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:38.939517 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c826dc32-bf61-494b-974c-2fe3717fe727 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:38.945094 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a14cd-d208-4203-bd96-8b634bf0092e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:38.945731 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a14cd-d208-4203-bd96-8b634bf0092e None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:38.946021 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a14cd-d208-4203-bd96-8b634bf0092e None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:38.946297 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a14cd-d208-4203-bd96-8b634bf0092e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:38.949366 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c826dc32-bf61-494b-974c-2fe3717fe727 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:38.957100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-c826dc32-bf61-494b-974c-2fe3717fe727 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:38.957100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:38.957100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:38.957100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:38.957100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:38.957100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:38.957100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:38.957100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:38.957100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:38.957100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:38.957100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:38.957100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:38.957100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:38.957100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:38.957100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:38.957100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:38.958014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:38.958014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:38.958014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:38.958014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:38.958014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:38.958014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:38.958014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:38.958014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:38.958014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:38.958014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:38.958014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:38.958014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:38.958014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:38.958014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:38.958014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:38.958014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:38.958803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:38.958803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:38.958803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:38.958803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:38.958803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:38.958803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:38.958803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:38.958803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:38.958803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:38.958803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:38.958803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:38.958803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:38.958803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 263/505] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 00:13:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:38.959464 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ca6d3-2596-4882-a9cf-f7501d8bb553 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:38.959695 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ca6d3-2596-4882-a9cf-f7501d8bb553 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:38.959976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295ca6d3-2596-4882-a9cf-f7501d8bb553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:38.968925 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:38.976249 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-295ca6d3-2596-4882-a9cf-f7501d8bb553 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:38.977420 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-295ca6d3-2596-4882-a9cf-f7501d8bb553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:38.996877 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:39.018736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a14cd-d208-4203-bd96-8b634bf0092e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:39.020291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a14cd-d208-4203-bd96-8b634bf0092e None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:39.043514 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 264/506] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:39.044543 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ca6d3-2596-4882-a9cf-f7501d8bb553 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:39.118835 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 243/507] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:13:39.119695 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a14cd-d208-4203-bd96-8b634bf0092e None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:39.143954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295ca6d3-2596-4882-a9cf-f7501d8bb553 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:39.169615 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:39.178431 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d9ed1-d39d-436c-94ec-dba42c2e4ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:39.179099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d9ed1-d39d-436c-94ec-dba42c2e4ecf None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:39.179383 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d9ed1-d39d-436c-94ec-dba42c2e4ecf None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:39.179706 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d9ed1-d39d-436c-94ec-dba42c2e4ecf None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:39.180428 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d9ed1-d39d-436c-94ec-dba42c2e4ecf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:39.180742 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d9ed1-d39d-436c-94ec-dba42c2e4ecf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:39.182119 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d9ed1-d39d-436c-94ec-dba42c2e4ecf None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:39.193086 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 265/508] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:39.193864 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d9ed1-d39d-436c-94ec-dba42c2e4ecf None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:39.211267 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:39.221535 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a14cd-d208-4203-bd96-8b634bf0092e None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:39.254976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14d082-2f0e-4b8f-8594-026dc6d47b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:39.255891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14d082-2f0e-4b8f-8594-026dc6d47b46 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:39.256173 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14d082-2f0e-4b8f-8594-026dc6d47b46 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:39.256445 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e14d082-2f0e-4b8f-8594-026dc6d47b46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:39.293345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d9ed1-d39d-436c-94ec-dba42c2e4ecf None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:39.320668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14d082-2f0e-4b8f-8594-026dc6d47b46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:39.322139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e14d082-2f0e-4b8f-8594-026dc6d47b46 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:39.325396 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd50c1-21ec-4a0b-b3e6-933f15d2a18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:39.326084 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd50c1-21ec-4a0b-b3e6-933f15d2a18e None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:39.326405 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd50c1-21ec-4a0b-b3e6-933f15d2a18e None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:39.326686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfd50c1-21ec-4a0b-b3e6-933f15d2a18e None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:39.327425 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd50c1-21ec-4a0b-b3e6-933f15d2a18e None admin] RBAC: Adding query filter params (name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:39.327761 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd50c1-21ec-4a0b-b3e6-933f15d2a18e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:39.329096 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfd50c1-21ec-4a0b-b3e6-933f15d2a18e None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:39.337245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 266/509] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 00:13:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:39.338019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd50c1-21ec-4a0b-b3e6-933f15d2a18e None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:39.374122 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:39.414925 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:39.425163 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 244/510] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:13:39.426656 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14d082-2f0e-4b8f-8594-026dc6d47b46 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:39.437754 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfd50c1-21ec-4a0b-b3e6-933f15d2a18e None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:39.470728 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc163e-cb18-4e54-9acd-b813ff02cc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:39.471513 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc163e-cb18-4e54-9acd-b813ff02cc2e None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:39.472069 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc163e-cb18-4e54-9acd-b813ff02cc2e None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:39.472069 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc163e-cb18-4e54-9acd-b813ff02cc2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:39.483135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc163e-cb18-4e54-9acd-b813ff02cc2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:39.484631 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc163e-cb18-4e54-9acd-b813ff02cc2e None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:39.501814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-00fc163e-cb18-4e54-9acd-b813ff02cc2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:39.501814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:39.501814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:39.501814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:39.501814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:39.501814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:39.501814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:39.501814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:39.501814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:39.501814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:39.501814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:39.501814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:39.501814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:39.501814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:39.501814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:39.502731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:39.502731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:39.502731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:39.502731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:39.502731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:39.502731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:39.502731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:39.502731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:39.502731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:39.502731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:39.502731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:39.502731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:39.502731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:39.502731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:39.502731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:39.502731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:39.502731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:39.503588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:39.503588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:39.503588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:39.503588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:39.503588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 267/511] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:39.503943 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc163e-cb18-4e54-9acd-b813ff02cc2e None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:39.527334 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e14d082-2f0e-4b8f-8594-026dc6d47b46 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:39.561573 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4132fc1-38c8-474e-a23f-e45de2ae61af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:39.562360 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4132fc1-38c8-474e-a23f-e45de2ae61af None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:39.562642 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4132fc1-38c8-474e-a23f-e45de2ae61af None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:39.562908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4132fc1-38c8-474e-a23f-e45de2ae61af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:39.572875 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4132fc1-38c8-474e-a23f-e45de2ae61af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:39.574325 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4132fc1-38c8-474e-a23f-e45de2ae61af None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:39.598862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-c4132fc1-38c8-474e-a23f-e45de2ae61af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:39.598862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:39.598862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:39.598862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:39.598862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:39.598862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:39.598862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:39.598862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:39.598862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:39.598862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:39.598862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:39.598862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:39.598862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:39.598862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:39.598862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:39.599819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:39.599819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:39.599819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:39.599819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:39.599819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:39.599819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:39.599819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:39.599819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:39.599819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:39.599819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:39.599819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:39.599819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:39.599819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:39.599819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:39.599819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:39.599819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:39.599819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:39.600674 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:39.600674 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:39.600674 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:39.600674 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:39.601186 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 245/512] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:39.602114 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4132fc1-38c8-474e-a23f-e45de2ae61af None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:39.604885 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:39.611692 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc163e-cb18-4e54-9acd-b813ff02cc2e None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:39.639227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:39.646154 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33042b-11d1-4888-923e-f15a8fc9e411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:39.646952 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33042b-11d1-4888-923e-f15a8fc9e411 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:39.647238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33042b-11d1-4888-923e-f15a8fc9e411 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:39.647519 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae33042b-11d1-4888-923e-f15a8fc9e411 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:39.655132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33042b-11d1-4888-923e-f15a8fc9e411 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:39.657007 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae33042b-11d1-4888-923e-f15a8fc9e411 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:39.671338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-ae33042b-11d1-4888-923e-f15a8fc9e411 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:13:39.671338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:39.671338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:39.671338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:39.671338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:39.671338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:39.671338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:39.671338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:39.671338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:39.671338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:39.671338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:39.671338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:39.671338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:13:39.671338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:13:39.671338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:13:39.671338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:13:39.672419 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:39.672419 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:39.672419 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:13:39.672419 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:39.672419 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:13:39.672419 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:39.672419 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:39.672419 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:39.672419 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:39.672419 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:39.672419 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:39.672419 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:39.672419 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:39.672419 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:39.672419 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:39.672419 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:39.672419 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:39.672419 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:39.673311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:39.673311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:39.673311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:13:39.673311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:13:39.673311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:13:39.673311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:13:39.673311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:13:39.673311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:13:39.673311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:13:39.673311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:39.673311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 268/513] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:39.673311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33042b-11d1-4888-923e-f15a8fc9e411 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:39.705314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4132fc1-38c8-474e-a23f-e45de2ae61af None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:39.737897 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ab916-3d38-4892-963a-4286db45288a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:39.739237 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ab916-3d38-4892-963a-4286db45288a None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:39.739516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ab916-3d38-4892-963a-4286db45288a None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:39.739822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422ab916-3d38-4892-963a-4286db45288a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:39.750152 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ab916-3d38-4892-963a-4286db45288a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:39.751592 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422ab916-3d38-4892-963a-4286db45288a None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:39.768287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-422ab916-3d38-4892-963a-4286db45288a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:39.768287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:39.768287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:39.768287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:39.768287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:39.768287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:39.768287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:39.768287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:39.768287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:39.768287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:39.768287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:39.768287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:39.768287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:39.768287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:39.768287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:39.769141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:39.769141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:39.769141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:39.769141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:39.769141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:39.769141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:39.769141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:39.769141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:39.769141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:39.769141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:39.769141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:39.769141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:39.769141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:39.769141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:39.769141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:39.769141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:39.769141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:39.770003 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:39.770003 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:39.770003 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:39.770003 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:39.770003 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 246/514] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:39.771243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ab916-3d38-4892-963a-4286db45288a None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:39.771730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae33042b-11d1-4888-923e-f15a8fc9e411 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:39.807631 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cba352-4711-4cd2-8062-a6018c94a09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:39.808440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cba352-4711-4cd2-8062-a6018c94a09c None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:39.808718 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cba352-4711-4cd2-8062-a6018c94a09c None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:39.808994 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cba352-4711-4cd2-8062-a6018c94a09c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:39.819893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cba352-4711-4cd2-8062-a6018c94a09c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:39.821343 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cba352-4711-4cd2-8062-a6018c94a09c None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:39.828321 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:39.840229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-e8cba352-4711-4cd2-8062-a6018c94a09c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:39.840229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:39.840229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:39.840229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:39.840229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:39.840229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:39.840229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:39.840229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:39.840229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:39.840229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:39.840229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:39.840229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:39.840229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:39.840229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:39.840229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:39.841197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:39.841197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:39.841197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:39.841197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:39.841197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:39.841197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:39.841197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:39.841197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:39.841197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:39.841197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:39.841197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:39.841197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:39.841197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:39.841197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:39.841197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:39.841197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:39.841197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:39.842045 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:39.842045 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:39.842045 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:39.842045 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:39.842045 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 269/515] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:39.842301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cba352-4711-4cd2-8062-a6018c94a09c None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:39.872772 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422ab916-3d38-4892-963a-4286db45288a None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:39.885522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:39.906820 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8dbb94-0516-4f87-8796-1ee190dd36aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:39.907482 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dbb94-0516-4f87-8796-1ee190dd36aa None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:39.907876 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dbb94-0516-4f87-8796-1ee190dd36aa None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:39.908153 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8dbb94-0516-4f87-8796-1ee190dd36aa None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:39.908900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8dbb94-0516-4f87-8796-1ee190dd36aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:39.909209 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8dbb94-0516-4f87-8796-1ee190dd36aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:39.911133 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8dbb94-0516-4f87-8796-1ee190dd36aa None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:39.922561 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 247/516] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:39.923340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8dbb94-0516-4f87-8796-1ee190dd36aa None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:39.945576 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cba352-4711-4cd2-8062-a6018c94a09c None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:39.979181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9666bb-057d-4a0b-8dac-79b0821606ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:39.979869 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9666bb-057d-4a0b-8dac-79b0821606ea None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:39.980156 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9666bb-057d-4a0b-8dac-79b0821606ea None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:39.980435 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9666bb-057d-4a0b-8dac-79b0821606ea None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:39.981149 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9666bb-057d-4a0b-8dac-79b0821606ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:39.981519 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9666bb-057d-4a0b-8dac-79b0821606ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:39.982919 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9666bb-057d-4a0b-8dac-79b0821606ea None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:39.994821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 270/517] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:39.995626 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9666bb-057d-4a0b-8dac-79b0821606ea None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:40.021706 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8dbb94-0516-4f87-8796-1ee190dd36aa None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:40.035876 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:40.056199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df25d18-f720-4f7c-81e7-9545fd3f9762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:40.056858 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df25d18-f720-4f7c-81e7-9545fd3f9762 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:40.057136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df25d18-f720-4f7c-81e7-9545fd3f9762 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:40.057409 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df25d18-f720-4f7c-81e7-9545fd3f9762 None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:40.058230 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df25d18-f720-4f7c-81e7-9545fd3f9762 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:40.058541 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df25d18-f720-4f7c-81e7-9545fd3f9762 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:40.059994 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df25d18-f720-4f7c-81e7-9545fd3f9762 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:40.076402 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 248/518] 10.222.0.44 () {56 vars in 1137 bytes} [Thu Jun 16 00:13:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:40.077189 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df25d18-f720-4f7c-81e7-9545fd3f9762 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:40.099455 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9666bb-057d-4a0b-8dac-79b0821606ea None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:40.101179 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:40.133739 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34325f7-dc0d-4ecc-b3b1-0d24678c075e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:40.134407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34325f7-dc0d-4ecc-b3b1-0d24678c075e None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:40.134693 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34325f7-dc0d-4ecc-b3b1-0d24678c075e None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:40.134982 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34325f7-dc0d-4ecc-b3b1-0d24678c075e None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:40.135729 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34325f7-dc0d-4ecc-b3b1-0d24678c075e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:40.136041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34325f7-dc0d-4ecc-b3b1-0d24678c075e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:40.137420 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34325f7-dc0d-4ecc-b3b1-0d24678c075e None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:40.148971 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 271/519] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:40.149573 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34325f7-dc0d-4ecc-b3b1-0d24678c075e None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:40.177584 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df25d18-f720-4f7c-81e7-9545fd3f9762 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:40.210504 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c6c44-ac72-46a2-a02a-0e49a36577bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:40.211156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c6c44-ac72-46a2-a02a-0e49a36577bf None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:40.211437 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c6c44-ac72-46a2-a02a-0e49a36577bf None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:40.211742 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798c6c44-ac72-46a2-a02a-0e49a36577bf None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:40.212454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c6c44-ac72-46a2-a02a-0e49a36577bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:40.212766 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c6c44-ac72-46a2-a02a-0e49a36577bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:40.214127 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-798c6c44-ac72-46a2-a02a-0e49a36577bf None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:40.225372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 249/520] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:40.226142 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c6c44-ac72-46a2-a02a-0e49a36577bf None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:40.250342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34325f7-dc0d-4ecc-b3b1-0d24678c075e None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:40.258013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:40.284740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f96903-ee3a-4849-82dd-26fc89f4dda6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:40.285477 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f96903-ee3a-4849-82dd-26fc89f4dda6 None admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:40.285765 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f96903-ee3a-4849-82dd-26fc89f4dda6 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:40.286042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f96903-ee3a-4849-82dd-26fc89f4dda6 None admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:40.286738 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f96903-ee3a-4849-82dd-26fc89f4dda6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:40.288209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f96903-ee3a-4849-82dd-26fc89f4dda6 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:40.308204 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 272/521] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 00:13:40 2022] POST /identity/v3/users => generated 247 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:13:40.317301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f96903-ee3a-4849-82dd-26fc89f4dda6 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:40.331503 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798c6c44-ac72-46a2-a02a-0e49a36577bf None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:40.339467 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:40.373137 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b3b31-139c-4dd5-9865-c1a9c0d3a0e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:40.374288 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b3b31-139c-4dd5-9865-c1a9c0d3a0e5 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:40.374576 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b3b31-139c-4dd5-9865-c1a9c0d3a0e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:40.374845 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87b3b31-139c-4dd5-9865-c1a9c0d3a0e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:40.383693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b3b31-139c-4dd5-9865-c1a9c0d3a0e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:40.385189 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87b3b31-139c-4dd5-9865-c1a9c0d3a0e5 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:40.400962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-b87b3b31-139c-4dd5-9865-c1a9c0d3a0e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:40.400962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:40.400962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:40.400962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:40.400962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:40.400962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:40.400962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:40.400962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:40.400962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:40.400962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:40.400962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:40.400962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:40.400962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:13:40.400962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:13:40.400962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:13:40.401893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:13:40.401893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:40.401893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:40.401893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:40.401893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:40.401893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:40.401893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:40.401893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:40.401893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:40.401893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:40.401893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:40.401893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:40.401893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:40.401893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:40.401893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:40.401893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:40.401893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:40.402739 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:13:40.402739 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:13:40.402739 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:13:40.402739 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:13:40.402739 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:13:40.402739 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:13:40.402739 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:40.402739 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:40.402739 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 250/522] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:40.403207 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b3b31-139c-4dd5-9865-c1a9c0d3a0e5 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:40.443425 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f96903-ee3a-4849-82dd-26fc89f4dda6 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:40.481156 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9704e-3e66-442d-aa40-06123c5f2917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:40.481827 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9704e-3e66-442d-aa40-06123c5f2917 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:40.482102 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9704e-3e66-442d-aa40-06123c5f2917 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:40.482388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c9704e-3e66-442d-aa40-06123c5f2917 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:40.509451 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:40.520279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87b3b31-139c-4dd5-9865-c1a9c0d3a0e5 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:40.561109 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bc19a-abae-4e36-9fc0-7d726ccea565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:40.561444 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9704e-3e66-442d-aa40-06123c5f2917 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:40.562141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bc19a-abae-4e36-9fc0-7d726ccea565 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:40.562536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bc19a-abae-4e36-9fc0-7d726ccea565 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:40.562902 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965bc19a-abae-4e36-9fc0-7d726ccea565 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:40.563006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c9704e-3e66-442d-aa40-06123c5f2917 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:40.571348 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965bc19a-abae-4e36-9fc0-7d726ccea565 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:40.572981 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965bc19a-abae-4e36-9fc0-7d726ccea565 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:40.582309 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:40.589136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-965bc19a-abae-4e36-9fc0-7d726ccea565 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 00:13:40.589136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:40.589136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:40.589136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:40.589136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:40.589136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:40.589136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:40.589136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:40.589136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:40.589136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:40.589136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:40.589136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:40.589136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:13:40.589136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:13:40.589136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:13:40.589136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:13:40.590283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:40.590283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:40.590283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:13:40.590283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:40.590283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:13:40.590283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:40.590283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:40.590283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:40.590283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:40.590283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:40.590283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:40.590283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:40.590283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:40.590283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:40.590283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:40.590283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:40.590283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:40.590283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:40.591480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:40.591480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:40.591480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:13:40.591480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:13:40.591480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:13:40.591480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:13:40.591480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:13:40.591480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:13:40.591480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 00:13:40.591480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:40.592201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 251/523] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 00:13:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:40.592976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bc19a-abae-4e36-9fc0-7d726ccea565 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:40.674767 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 273/524] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:13:40.675640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9704e-3e66-442d-aa40-06123c5f2917 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:40.707330 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965bc19a-abae-4e36-9fc0-7d726ccea565 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:40.743866 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c07fd-a937-4870-9780-c65b80868451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:40.744760 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c07fd-a937-4870-9780-c65b80868451 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:40.745045 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c07fd-a937-4870-9780-c65b80868451 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:40.745317 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c07fd-a937-4870-9780-c65b80868451 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:40.752738 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c07fd-a937-4870-9780-c65b80868451 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:40.754831 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c07fd-a937-4870-9780-c65b80868451 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:40.769977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-d32c07fd-a937-4870-9780-c65b80868451 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:40.769977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:40.769977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:40.769977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:40.769977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:40.769977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:40.769977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:40.769977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:40.769977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:40.769977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:40.769977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:40.769977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:40.769977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:13:40.769977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:13:40.769977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:13:40.771008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:13:40.771008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:40.771008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:40.771008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:40.771008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:40.771008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:40.771008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:40.771008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:40.771008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:40.771008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:40.771008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:40.771008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:40.771008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:40.771008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:40.771008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:40.771008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:40.771008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:40.772076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:13:40.772076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:13:40.772076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:13:40.772076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:13:40.772076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:13:40.772076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:13:40.772076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:40.772076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:40.772076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 252/525] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:40.772076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c07fd-a937-4870-9780-c65b80868451 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:40.783407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c9704e-3e66-442d-aa40-06123c5f2917 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:40.794275 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:40.808824 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:40.831807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ac3c7-463a-431f-a193-7e724d0adfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:40.833059 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ac3c7-463a-431f-a193-7e724d0adfed None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:40.833347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ac3c7-463a-431f-a193-7e724d0adfed None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:40.833626 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ac3c7-463a-431f-a193-7e724d0adfed None admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:40.834433 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ac3c7-463a-431f-a193-7e724d0adfed None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:40.834739 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ac3c7-463a-431f-a193-7e724d0adfed None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:40.836283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ac3c7-463a-431f-a193-7e724d0adfed None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:40.853817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 274/526] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:13:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:40.854641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ac3c7-463a-431f-a193-7e724d0adfed None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:40.898561 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c07fd-a937-4870-9780-c65b80868451 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:40.934425 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15dcdb-0597-4589-9e3e-dd562df45715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:40.935089 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15dcdb-0597-4589-9e3e-dd562df45715 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:40.935368 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15dcdb-0597-4589-9e3e-dd562df45715 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:40.935653 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f15dcdb-0597-4589-9e3e-dd562df45715 None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:40.936477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15dcdb-0597-4589-9e3e-dd562df45715 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:40.936778 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15dcdb-0597-4589-9e3e-dd562df45715 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:40.938207 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f15dcdb-0597-4589-9e3e-dd562df45715 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:40.956100 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 253/527] 10.222.0.44 () {56 vars in 1139 bytes} [Thu Jun 16 00:13:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:40.961825 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15dcdb-0597-4589-9e3e-dd562df45715 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:40.967210 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ac3c7-463a-431f-a193-7e724d0adfed None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:41.003096 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7ecfd-b0a9-4ba1-8118-202c264e0868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:41.003959 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7ecfd-b0a9-4ba1-8118-202c264e0868 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:41.004244 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7ecfd-b0a9-4ba1-8118-202c264e0868 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:41.004520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c7ecfd-b0a9-4ba1-8118-202c264e0868 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:41.015063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7ecfd-b0a9-4ba1-8118-202c264e0868 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:41.016573 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c7ecfd-b0a9-4ba1-8118-202c264e0868 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:41.035846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:41.036107 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-b8c7ecfd-b0a9-4ba1-8118-202c264e0868 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:41.036107 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:41.036107 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:41.036107 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:41.036107 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:41.036107 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:41.036107 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:41.036107 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:41.036107 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:41.036107 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:41.036107 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:41.036107 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:41.036107 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:41.036107 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:41.036107 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:41.036927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:41.036927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:41.036927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:41.036927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:41.036927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:41.036927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:41.036927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:41.036927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:41.036927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:41.036927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:41.036927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:41.036927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:41.036927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:41.036927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:41.036927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:41.036927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:41.036927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:41.037769 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:41.037769 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:41.037769 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:41.037769 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:41.037769 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 275/528] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:41.038515 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7ecfd-b0a9-4ba1-8118-202c264e0868 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:41.068857 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:41.075187 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f15dcdb-0597-4589-9e3e-dd562df45715 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:41.112772 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c90a8-22d7-47a0-8b43-92641eb85764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:41.113958 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c90a8-22d7-47a0-8b43-92641eb85764 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:41.114243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c90a8-22d7-47a0-8b43-92641eb85764 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:41.114514 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c90a8-22d7-47a0-8b43-92641eb85764 None admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:41.115307 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c90a8-22d7-47a0-8b43-92641eb85764 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:41.115636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c90a8-22d7-47a0-8b43-92641eb85764 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:41.117103 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448c90a8-22d7-47a0-8b43-92641eb85764 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:41.141327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 254/529] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:13:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:41.141327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c90a8-22d7-47a0-8b43-92641eb85764 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:41.151849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c7ecfd-b0a9-4ba1-8118-202c264e0868 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:41.186859 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9aeb8e-8e41-4f30-b387-0357bbbaafa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:41.187506 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9aeb8e-8e41-4f30-b387-0357bbbaafa5 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:41.187831 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9aeb8e-8e41-4f30-b387-0357bbbaafa5 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:41.188424 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9aeb8e-8e41-4f30-b387-0357bbbaafa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:41.189261 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9aeb8e-8e41-4f30-b387-0357bbbaafa5 None admin] RBAC: Adding query filter params (role.id=338a913607974d379aad3249b3d0402d, scope.project.id=320d79ecbc2342af8031103e7308c10d, user.id=40432493f16b4df681daf5a1af87832a) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:41.189575 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9aeb8e-8e41-4f30-b387-0357bbbaafa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:41.190994 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9aeb8e-8e41-4f30-b387-0357bbbaafa5 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:41.198577 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 276/530] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:41 2022] GET /identity/v3/role_assignments?user.id=40432493f16b4df681daf5a1af87832a&scope.project.id=320d79ecbc2342af8031103e7308c10d&role.id=338a913607974d379aad3249b3d0402d => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:41.199375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9aeb8e-8e41-4f30-b387-0357bbbaafa5 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:41.274582 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c90a8-22d7-47a0-8b43-92641eb85764 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:41.308096 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:41.317372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:41.321026 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9aeb8e-8e41-4f30-b387-0357bbbaafa5 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:41.324704 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd2cec-3743-43f1-bd77-aa9f988429e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:41.325882 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd2cec-3743-43f1-bd77-aa9f988429e7 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:41.325882 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd2cec-3743-43f1-bd77-aa9f988429e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:41.326247 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd2cec-3743-43f1-bd77-aa9f988429e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:41.365274 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01a836-cdbe-489b-acab-43f9d243100f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:41.366220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01a836-cdbe-489b-acab-43f9d243100f None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:41.366508 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01a836-cdbe-489b-acab-43f9d243100f None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:41.366887 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f01a836-cdbe-489b-acab-43f9d243100f None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:41.367840 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01a836-cdbe-489b-acab-43f9d243100f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:41.368257 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01a836-cdbe-489b-acab-43f9d243100f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:41.369763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f01a836-cdbe-489b-acab-43f9d243100f None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:41.385352 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 277/531] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:41.387245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01a836-cdbe-489b-acab-43f9d243100f None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:41.413381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd2cec-3743-43f1-bd77-aa9f988429e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:41.415276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd2cec-3743-43f1-bd77-aa9f988429e7 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:41.494742 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f01a836-cdbe-489b-acab-43f9d243100f None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:41.534455 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7831b6-7470-4041-b492-c5f25f6d2dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:41.534748 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 255/532] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:13:41.536161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7831b6-7470-4041-b492-c5f25f6d2dc1 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:41.536560 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd2cec-3743-43f1-bd77-aa9f988429e7 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:41.536757 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7831b6-7470-4041-b492-c5f25f6d2dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:41.537191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7831b6-7470-4041-b492-c5f25f6d2dc1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:41.538161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7831b6-7470-4041-b492-c5f25f6d2dc1 None admin] RBAC: Adding query filter params (role.id=338a913607974d379aad3249b3d0402d, scope.project.id=320d79ecbc2342af8031103e7308c10d, user.id=faaab5440b7041faa5a6f9ea18c188c4) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:41.538613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7831b6-7470-4041-b492-c5f25f6d2dc1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:41.541529 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7831b6-7470-4041-b492-c5f25f6d2dc1 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:41.549349 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 278/533] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:41 2022] GET /identity/v3/role_assignments?user.id=faaab5440b7041faa5a6f9ea18c188c4&scope.project.id=320d79ecbc2342af8031103e7308c10d&role.id=338a913607974d379aad3249b3d0402d => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:41.551010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7831b6-7470-4041-b492-c5f25f6d2dc1 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:41.572303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:41.580204 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:41.653965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd2cec-3743-43f1-bd77-aa9f988429e7 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:41.696910 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bf448-88d6-4d40-bdd1-6e393eb7f0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:41.698063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bf448-88d6-4d40-bdd1-6e393eb7f0cb None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:41.698453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bf448-88d6-4d40-bdd1-6e393eb7f0cb None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:41.698829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372bf448-88d6-4d40-bdd1-6e393eb7f0cb None admin] PATH_INFO: `/v3/projects/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:41.699374 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7831b6-7470-4041-b492-c5f25f6d2dc1 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:41.706326 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bf448-88d6-4d40-bdd1-6e393eb7f0cb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:41.708738 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-372bf448-88d6-4d40-bdd1-6e393eb7f0cb None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:41.724489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-372bf448-88d6-4d40-bdd1-6e393eb7f0cb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:41.724489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:41.724489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:41.724489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:41.724489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:41.724489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:41.724489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:41.724489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:41.724489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:41.724489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:41.724489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:41.724489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:41.724489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:13:41.724489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:13:41.724489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:13:41.725585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:13:41.725585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:41.725585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:41.725585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:41.725585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:41.725585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:41.725585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:41.725585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:41.725585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:41.725585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:41.725585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:41.725585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:41.725585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:41.725585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:41.725585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:41.725585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:41.725585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:41.726611 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:13:41.726611 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:13:41.726611 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:13:41.726611 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:13:41.726611 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:13:41.726611 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:13:41.726611 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:41.726611 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:41.728392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 256/534] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:41.733713 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bf448-88d6-4d40-bdd1-6e393eb7f0cb None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:41.743261 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8bd25-ec37-4f51-ba24-348f95f36a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:41.744384 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8bd25-ec37-4f51-ba24-348f95f36a6a None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:41.744825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8bd25-ec37-4f51-ba24-348f95f36a6a None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:41.745242 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a8bd25-ec37-4f51-ba24-348f95f36a6a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:41.759243 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8bd25-ec37-4f51-ba24-348f95f36a6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:41.761653 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a8bd25-ec37-4f51-ba24-348f95f36a6a None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:41.783031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-91a8bd25-ec37-4f51-ba24-348f95f36a6a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:41.783031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:41.783031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:41.783031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:41.783031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:41.783031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:41.783031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:41.783031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:41.783031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:41.783031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:41.783031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:41.783031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:41.783031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:41.783031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:41.783031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:41.783956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:41.783956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:41.783956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:41.783956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:41.783956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:41.783956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:41.783956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:41.783956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:41.783956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:41.783956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:41.783956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:41.783956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:41.783956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:41.783956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:41.783956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:41.783956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:41.783956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:41.784801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:41.784801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:41.784801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:41.784801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:41.786600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 279/535] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:41.792236 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8bd25-ec37-4f51-ba24-348f95f36a6a None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:41.879079 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:41.904899 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:41.917193 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372bf448-88d6-4d40-bdd1-6e393eb7f0cb None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:41.942755 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a8bd25-ec37-4f51-ba24-348f95f36a6a None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:41.960415 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b279721-cfa7-43f7-af50-441d4e28a0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:41.961078 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b279721-cfa7-43f7-af50-441d4e28a0a0 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:41.961357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b279721-cfa7-43f7-af50-441d4e28a0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:41.961629 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b279721-cfa7-43f7-af50-441d4e28a0a0 None admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:41.962405 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b279721-cfa7-43f7-af50-441d4e28a0a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:41.962711 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b279721-cfa7-43f7-af50-441d4e28a0a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:41.964183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b279721-cfa7-43f7-af50-441d4e28a0a0 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:41.991852 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 257/536] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:13:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:41.993908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b279721-cfa7-43f7-af50-441d4e28a0a0 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:42.014418 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac5517-8158-491f-8cc9-cca3b1c65f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:42.014981 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac5517-8158-491f-8cc9-cca3b1c65f12 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:42.015269 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac5517-8158-491f-8cc9-cca3b1c65f12 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:42.015546 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ac5517-8158-491f-8cc9-cca3b1c65f12 None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:42.016325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac5517-8158-491f-8cc9-cca3b1c65f12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:42.016635 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac5517-8158-491f-8cc9-cca3b1c65f12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:42.018024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ac5517-8158-491f-8cc9-cca3b1c65f12 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:42.030803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 280/537] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:42.040633 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac5517-8158-491f-8cc9-cca3b1c65f12 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:42.163645 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b279721-cfa7-43f7-af50-441d4e28a0a0 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:42.232884 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dc783-087e-4545-9a2a-b950cfbf642a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:42.233294 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ac5517-8158-491f-8cc9-cca3b1c65f12 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:42.233560 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dc783-087e-4545-9a2a-b950cfbf642a None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:42.233847 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dc783-087e-4545-9a2a-b950cfbf642a None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:42.234127 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dc783-087e-4545-9a2a-b950cfbf642a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:42.234963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347dc783-087e-4545-9a2a-b950cfbf642a None admin] RBAC: Adding query filter params (role.id=338a913607974d379aad3249b3d0402d, scope.project.id=320d79ecbc2342af8031103e7308c10d, user.id=33ba9644ca064e95b43650424baef79f) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:42.235279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347dc783-087e-4545-9a2a-b950cfbf642a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:42.236768 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347dc783-087e-4545-9a2a-b950cfbf642a None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:42.248108 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 258/538] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:41 2022] GET /identity/v3/role_assignments?user.id=33ba9644ca064e95b43650424baef79f&scope.project.id=320d79ecbc2342af8031103e7308c10d&role.id=338a913607974d379aad3249b3d0402d => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:42.273861 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:42.289450 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24ec61-3775-4252-b575-495816529be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:42.290290 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24ec61-3775-4252-b575-495816529be5 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:42.290571 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24ec61-3775-4252-b575-495816529be5 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:42.290847 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d24ec61-3775-4252-b575-495816529be5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:42.298617 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24ec61-3775-4252-b575-495816529be5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:42.300145 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d24ec61-3775-4252-b575-495816529be5 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:42.322702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-5d24ec61-3775-4252-b575-495816529be5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:42.322702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:42.322702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:42.322702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:42.322702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:42.322702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:42.322702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:42.322702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:42.322702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:42.322702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:42.322702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:42.322702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:42.322702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:13:42.322702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:13:42.322702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:13:42.323602 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:13:42.323602 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:42.323602 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:42.323602 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:42.323602 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:42.323602 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:42.323602 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:42.323602 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:42.323602 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:42.323602 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:42.323602 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:42.323602 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:42.323602 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:42.323602 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:42.323602 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:42.323602 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:42.323602 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:42.324470 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:13:42.324470 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:13:42.324470 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:13:42.324470 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:13:42.324470 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:13:42.324470 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:13:42.324470 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:42.324470 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:42.324470 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 281/539] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:42.330111 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dc783-087e-4545-9a2a-b950cfbf642a None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:42.357148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:42.468106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dc783-087e-4545-9a2a-b950cfbf642a None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:42.506974 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e141ec-3dfe-4732-9fad-8486a5dc2e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:42.507671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e141ec-3dfe-4732-9fad-8486a5dc2e7e None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:42.507965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e141ec-3dfe-4732-9fad-8486a5dc2e7e None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:42.508245 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e141ec-3dfe-4732-9fad-8486a5dc2e7e None admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:42.509038 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e141ec-3dfe-4732-9fad-8486a5dc2e7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:42.509356 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e141ec-3dfe-4732-9fad-8486a5dc2e7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:42.510809 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e141ec-3dfe-4732-9fad-8486a5dc2e7e None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:42.525410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 259/540] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:13:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:42.531082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24ec61-3775-4252-b575-495816529be5 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:42.625066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6aaab-daff-4f6e-8af2-038efdceb614 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:42.625391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6aaab-daff-4f6e-8af2-038efdceb614 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:42.625644 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd6aaab-daff-4f6e-8af2-038efdceb614 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:42.627529 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 260/541] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:42.634160 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28e197-ed56-4839-855a-8c66a3d26799 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:42.634716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28e197-ed56-4839-855a-8c66a3d26799 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:42.635210 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b28e197-ed56-4839-855a-8c66a3d26799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:42.656503 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-0b28e197-ed56-4839-855a-8c66a3d26799 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:42.658086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-0b28e197-ed56-4839-855a-8c66a3d26799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:42.692634 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d24ec61-3775-4252-b575-495816529be5 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:42.728000 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d2349-e839-489d-a6e8-2eba3b30fe7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:42.728577 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d2349-e839-489d-a6e8-2eba3b30fe7f None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:42.728858 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d2349-e839-489d-a6e8-2eba3b30fe7f None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:42.729133 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559d2349-e839-489d-a6e8-2eba3b30fe7f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:42.730086 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d2349-e839-489d-a6e8-2eba3b30fe7f None admin] RBAC: Adding query filter params (role.id=338a913607974d379aad3249b3d0402d, scope.project.id=320d79ecbc2342af8031103e7308c10d, user.id=222e3db424f0476386bc3432cc0f868e) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:42.730406 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d2349-e839-489d-a6e8-2eba3b30fe7f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:42.731878 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559d2349-e839-489d-a6e8-2eba3b30fe7f None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:42.738131 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 282/542] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:42 2022] GET /identity/v3/role_assignments?user.id=222e3db424f0476386bc3432cc0f868e&scope.project.id=320d79ecbc2342af8031103e7308c10d&role.id=338a913607974d379aad3249b3d0402d => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:42.794279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 261/543] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:13:42.826445 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d2349-e839-489d-a6e8-2eba3b30fe7f None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:42.954510 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:43.036629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559d2349-e839-489d-a6e8-2eba3b30fe7f None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:43.076935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4cd55a-1054-4e13-a9d6-62f8c30f322d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:43.077753 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cd55a-1054-4e13-a9d6-62f8c30f322d None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:43.078045 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cd55a-1054-4e13-a9d6-62f8c30f322d None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:43.078328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4cd55a-1054-4e13-a9d6-62f8c30f322d None admin] PATH_INFO: `/v3/roles/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:43.096622 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4cd55a-1054-4e13-a9d6-62f8c30f322d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:43.104497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-0f4cd55a-1054-4e13-a9d6-62f8c30f322d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:43.104497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:43.104497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:43.104497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:43.104497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:43.104497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:43.104497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:43.104497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:43.104497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:43.104497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:43.104497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:43.104497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:43.104497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:43.104497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:43.104497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:43.104497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:43.105345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:43.105345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:43.105345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:43.105345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:43.105345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:43.105345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:43.105345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:43.105345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:43.105345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:43.105345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:43.105345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:43.105345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:43.105345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:43.105345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:43.105345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:43.105345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:43.106135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:43.106135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:43.106135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:43.106135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:43.106135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:43.106135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:43.106135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:43.106135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:43.106135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:43.106135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:43.106135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:43.106135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:43.106135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 283/544] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 00:13:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:43.114125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28e197-ed56-4839-855a-8c66a3d26799 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:43.119635 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:43.264324 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b28e197-ed56-4839-855a-8c66a3d26799 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:43.322576 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0de38-e93a-4feb-baab-8ae933b7a139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:43.323177 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0de38-e93a-4feb-baab-8ae933b7a139 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:43.323460 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0de38-e93a-4feb-baab-8ae933b7a139 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:43.323775 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd0de38-e93a-4feb-baab-8ae933b7a139 None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:43.324522 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0de38-e93a-4feb-baab-8ae933b7a139 None admin] RBAC: Adding query filter params (name=service) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:43.324834 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0de38-e93a-4feb-baab-8ae933b7a139 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:43.326204 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd0de38-e93a-4feb-baab-8ae933b7a139 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:43.338951 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 262/545] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 00:13:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:43.344380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4cd55a-1054-4e13-a9d6-62f8c30f322d None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:43.517066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4cd55a-1054-4e13-a9d6-62f8c30f322d None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:43.544945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:43.600445 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa7acb-8393-4ada-b4c6-eef5549171b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:43.601588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa7acb-8393-4ada-b4c6-eef5549171b1 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:43.602088 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa7acb-8393-4ada-b4c6-eef5549171b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:43.602568 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aa7acb-8393-4ada-b4c6-eef5549171b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:43.624721 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa7acb-8393-4ada-b4c6-eef5549171b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:43.626532 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aa7acb-8393-4ada-b4c6-eef5549171b1 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:43.654501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-b1aa7acb-8393-4ada-b4c6-eef5549171b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:43.654501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:43.654501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:43.654501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:43.654501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:43.654501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:43.654501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:43.654501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:43.654501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:43.654501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:43.654501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:43.654501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:43.654501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:43.654501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:43.654501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:43.655381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:43.655381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:43.655381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:43.655381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:43.655381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:43.655381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:43.655381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:43.655381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:43.655381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:43.655381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:43.655381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:43.655381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:43.655381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:43.655381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:43.655381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:43.655381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:43.655381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:43.656263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:43.656263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:43.656263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:43.656263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:43.658442 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 284/546] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:43.664909 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0de38-e93a-4feb-baab-8ae933b7a139 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:43.777744 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:43.828124 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd0de38-e93a-4feb-baab-8ae933b7a139 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:43.875200 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d42e15-408d-489f-87d0-90ebe0a89320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:43.875825 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d42e15-408d-489f-87d0-90ebe0a89320 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:43.876109 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d42e15-408d-489f-87d0-90ebe0a89320 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:43.876383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d42e15-408d-489f-87d0-90ebe0a89320 None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:43.877109 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d42e15-408d-489f-87d0-90ebe0a89320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:43.877414 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d42e15-408d-489f-87d0-90ebe0a89320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:43.878841 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d42e15-408d-489f-87d0-90ebe0a89320 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:43.891919 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 263/547] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:43.897589 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa7acb-8393-4ada-b4c6-eef5549171b1 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:44.034128 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aa7acb-8393-4ada-b4c6-eef5549171b1 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:44.056265 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add7cd1-5176-489c-92af-f6c3ea572c39 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:44.056898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add7cd1-5176-489c-92af-f6c3ea572c39 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:44.057371 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add7cd1-5176-489c-92af-f6c3ea572c39 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:44.059154 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 264/548] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:44.064113 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ccdea-a845-4a23-a7d4-ac806a25ce56 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:44.064605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ccdea-a845-4a23-a7d4-ac806a25ce56 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:44.065079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ccdea-a845-4a23-a7d4-ac806a25ce56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:44.074429 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5066e8-5d1e-4553-a39f-7f9d429b577c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:44.075490 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5066e8-5d1e-4553-a39f-7f9d429b577c None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:44.077587 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5066e8-5d1e-4553-a39f-7f9d429b577c None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:44.083112 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5066e8-5d1e-4553-a39f-7f9d429b577c None admin] PATH_INFO: `/v3/users/swift` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:44.095510 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-646ccdea-a845-4a23-a7d4-ac806a25ce56 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:44.096521 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5066e8-5d1e-4553-a39f-7f9d429b577c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:44.098753 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5066e8-5d1e-4553-a39f-7f9d429b577c None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:44.100598 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-646ccdea-a845-4a23-a7d4-ac806a25ce56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:44.124281 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-ba5066e8-5d1e-4553-a39f-7f9d429b577c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:13:44.124281 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:44.124281 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:44.124281 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:44.124281 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:44.124281 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:44.124281 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:44.124281 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:44.124281 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:44.124281 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:44.124281 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:44.124281 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:44.124281 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:13:44.124281 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:13:44.124281 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:13:44.124281 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:13:44.125715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:44.125715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:44.125715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:13:44.125715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:44.125715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:13:44.125715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:44.125715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:44.125715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:44.125715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:44.125715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:44.125715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:44.125715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:44.125715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:44.125715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:44.125715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:44.125715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:44.125715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:44.125715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:44.126783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:44.126783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:44.126783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:13:44.126783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:13:44.126783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:13:44.126783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:13:44.126783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:13:44.126783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:13:44.126783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:13:44.126783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:44.134439 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 285/549] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:13:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:44.145133 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5066e8-5d1e-4553-a39f-7f9d429b577c None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:44.195382 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:44.243017 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 265/550] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:13:44.278586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ccdea-a845-4a23-a7d4-ac806a25ce56 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:44.297511 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5066e8-5d1e-4553-a39f-7f9d429b577c None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:44.346740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3bd31a-f6eb-4260-9f04-1ad603761397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:44.347459 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bd31a-f6eb-4260-9f04-1ad603761397 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:44.347846 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bd31a-f6eb-4260-9f04-1ad603761397 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:44.348141 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3bd31a-f6eb-4260-9f04-1ad603761397 None admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:44.349143 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bd31a-f6eb-4260-9f04-1ad603761397 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:44.349466 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bd31a-f6eb-4260-9f04-1ad603761397 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:44.351051 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3bd31a-f6eb-4260-9f04-1ad603761397 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:44.363235 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:44.393370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 286/551] 10.222.0.44 () {56 vars in 1135 bytes} [Thu Jun 16 00:13:44 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:44.395488 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee73eb-3c15-46b7-8c0e-8b943907834f None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:44.395960 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee73eb-3c15-46b7-8c0e-8b943907834f None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:44.396386 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee73eb-3c15-46b7-8c0e-8b943907834f None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:44.398008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 287/552] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:44.404515 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee73eb-3c15-46b7-8c0e-8b943907834f None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:44.414395 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ccdea-a845-4a23-a7d4-ac806a25ce56 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:44.448870 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0240c-dc68-4fe1-8d3f-bf879240b719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:44.449691 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0240c-dc68-4fe1-8d3f-bf879240b719 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:44.449980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0240c-dc68-4fe1-8d3f-bf879240b719 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:44.450494 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0240c-dc68-4fe1-8d3f-bf879240b719 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:44.463234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d0240c-dc68-4fe1-8d3f-bf879240b719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:44.471586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-b6d0240c-dc68-4fe1-8d3f-bf879240b719 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:44.471586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:44.471586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:44.471586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:44.471586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:44.471586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:44.471586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:44.471586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:44.471586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:44.471586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:44.471586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:44.471586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:44.471586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:44.471586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:44.471586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:44.471586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:44.473279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:44.473279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:44.473279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:44.473279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:44.473279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:44.473279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:44.473279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:44.473279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:44.473279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:44.473279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:44.473279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:44.473279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:44.473279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:44.473279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:44.473279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:44.473279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:44.474179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:44.474179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:44.474179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:44.474179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:44.474179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:44.474179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:44.474179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:44.474179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:44.474179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:44.474179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:44.474179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:44.474179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:44.474814 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 266/553] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 00:13:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:44.480504 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967ac7b-07d7-4a19-b753-920922e4dd40 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:44.480861 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967ac7b-07d7-4a19-b753-920922e4dd40 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:44.481295 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7967ac7b-07d7-4a19-b753-920922e4dd40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:44.499670 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-7967ac7b-07d7-4a19-b753-920922e4dd40 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:44.501245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:44.501362 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-7967ac7b-07d7-4a19-b753-920922e4dd40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:44.522080 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee73eb-3c15-46b7-8c0e-8b943907834f None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:44.559878 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031b817-d3b3-404a-8d8b-34e2d56db47c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:44.560961 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031b817-d3b3-404a-8d8b-34e2d56db47c None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:44.561433 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031b817-d3b3-404a-8d8b-34e2d56db47c None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:44.561909 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e031b817-d3b3-404a-8d8b-34e2d56db47c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:44.579658 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 267/554] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:44.579658 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967ac7b-07d7-4a19-b753-920922e4dd40 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:44.625125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:44.655553 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031b817-d3b3-404a-8d8b-34e2d56db47c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:44.657159 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e031b817-d3b3-404a-8d8b-34e2d56db47c None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:44.684950 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7967ac7b-07d7-4a19-b753-920922e4dd40 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:44.722336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4b452-7375-4853-866d-5da5ac76f613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:44.723446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4b452-7375-4853-866d-5da5ac76f613 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:44.723911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4b452-7375-4853-866d-5da5ac76f613 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:44.724327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f4b452-7375-4853-866d-5da5ac76f613 None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:44.725345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4b452-7375-4853-866d-5da5ac76f613 None admin] RBAC: Adding query filter params (name=service) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:44.725793 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4b452-7375-4853-866d-5da5ac76f613 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:44.727319 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f4b452-7375-4853-866d-5da5ac76f613 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:44.741275 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 268/555] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 00:13:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:44.742455 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4b452-7375-4853-866d-5da5ac76f613 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:44.747991 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:44.762358 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 288/556] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:13:44.763282 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031b817-d3b3-404a-8d8b-34e2d56db47c None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:44.848381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f4b452-7375-4853-866d-5da5ac76f613 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:44.857608 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:44.867132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e031b817-d3b3-404a-8d8b-34e2d56db47c None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:44.885704 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98dee1-bfb3-4453-81e2-027dd95a2429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:44.886736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98dee1-bfb3-4453-81e2-027dd95a2429 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:44.887163 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98dee1-bfb3-4453-81e2-027dd95a2429 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:44.887578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b98dee1-bfb3-4453-81e2-027dd95a2429 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:44.898724 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b98dee1-bfb3-4453-81e2-027dd95a2429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:44.903955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864755a-782a-4129-a81d-d0414a01e638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:44.904758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864755a-782a-4129-a81d-d0414a01e638 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:44.905048 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864755a-782a-4129-a81d-d0414a01e638 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:44.905333 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9864755a-782a-4129-a81d-d0414a01e638 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:44.907358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-6b98dee1-bfb3-4453-81e2-027dd95a2429 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:44.907358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:44.907358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:44.907358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:44.907358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:44.907358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:44.907358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:44.907358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:44.907358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:44.907358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:44.907358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:44.907358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:44.907358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:44.907358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:44.907358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:44.907358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:44.908461 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:44.908461 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:44.908461 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:44.908461 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:44.908461 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:44.908461 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:44.908461 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:44.908461 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:44.908461 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:44.908461 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:44.908461 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:44.908461 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:44.908461 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:44.908461 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:44.908461 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:44.908461 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:44.909268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:44.909268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:44.909268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:44.909268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:44.909268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:44.909268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:44.909268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:44.909268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:44.909268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:44.909268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:44.909268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:44.909268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:44.911937 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 269/557] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 00:13:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:44.912931 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98dee1-bfb3-4453-81e2-027dd95a2429 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:44.921192 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864755a-782a-4129-a81d-d0414a01e638 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:44.922705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9864755a-782a-4129-a81d-d0414a01e638 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:44.941545 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-9864755a-782a-4129-a81d-d0414a01e638 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:44.941545 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:44.941545 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:44.941545 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:44.941545 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:44.941545 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:44.941545 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:44.941545 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:44.941545 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:44.941545 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:44.941545 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:44.941545 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:44.941545 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:44.941545 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:44.941545 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:44.942916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:44.942916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:44.942916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:44.942916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:44.942916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:44.942916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:44.942916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:44.942916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:44.942916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:44.942916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:44.942916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:44.942916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:44.942916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:44.942916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:44.942916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:44.942916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:44.942916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:44.943828 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:44.943828 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:44.943828 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:44.943828 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:44.947416 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 289/558] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:44.948378 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864755a-782a-4129-a81d-d0414a01e638 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:44.992141 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:45.038442 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b98dee1-bfb3-4453-81e2-027dd95a2429 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:45.064119 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9864755a-782a-4129-a81d-d0414a01e638 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:45.081243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74aa3fa-f40a-4675-82c6-d1b3cacc0996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:45.082736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74aa3fa-f40a-4675-82c6-d1b3cacc0996 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.083090 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74aa3fa-f40a-4675-82c6-d1b3cacc0996 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.083444 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74aa3fa-f40a-4675-82c6-d1b3cacc0996 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.094921 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74aa3fa-f40a-4675-82c6-d1b3cacc0996 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:45.096497 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74aa3fa-f40a-4675-82c6-d1b3cacc0996 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:45.100710 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002b3c3-4e43-4638-88a6-f780bdfe0f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:45.101381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002b3c3-4e43-4638-88a6-f780bdfe0f69 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.101668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002b3c3-4e43-4638-88a6-f780bdfe0f69 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.101948 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f002b3c3-4e43-4638-88a6-f780bdfe0f69 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.102694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002b3c3-4e43-4638-88a6-f780bdfe0f69 None admin] RBAC: Adding query filter params (name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:45.103003 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002b3c3-4e43-4638-88a6-f780bdfe0f69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:45.104420 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f002b3c3-4e43-4638-88a6-f780bdfe0f69 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:45.115739 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 290/559] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 00:13:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:45.115739 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002b3c3-4e43-4638-88a6-f780bdfe0f69 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:45.115977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-d74aa3fa-f40a-4675-82c6-d1b3cacc0996 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:45.115977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:45.115977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:45.115977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:45.115977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:45.115977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:45.115977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:45.115977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:45.115977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:45.115977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:45.115977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:45.115977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:45.115977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:45.115977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:45.115977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:45.116869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:45.116869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:45.116869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:45.116869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:45.116869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:45.116869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:45.116869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:45.116869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:45.116869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:45.116869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:45.116869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:45.116869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:45.116869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:45.116869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:45.116869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:45.116869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:45.116869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:45.117747 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:45.117747 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:45.117747 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:45.117747 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:45.117747 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 270/560] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:45.117747 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51da481-0507-4ee0-b8ba-4d64bcdd440b None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.117747 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51da481-0507-4ee0-b8ba-4d64bcdd440b None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.118124 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51da481-0507-4ee0-b8ba-4d64bcdd440b None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.119843 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 271/561] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:45.123829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51da481-0507-4ee0-b8ba-4d64bcdd440b None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:45.146865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:45.224568 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:45.229243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51da481-0507-4ee0-b8ba-4d64bcdd440b None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:45.229858 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f002b3c3-4e43-4638-88a6-f780bdfe0f69 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:45.266759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8a055-6073-4be7-94bf-1f8befe28bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:45.267433 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8a055-6073-4be7-94bf-1f8befe28bf1 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.267732 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8a055-6073-4be7-94bf-1f8befe28bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.268009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d8a055-6073-4be7-94bf-1f8befe28bf1 None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.268617 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf6ad07-22c8-45bf-a275-31d8f2ca8a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:45.268730 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8a055-6073-4be7-94bf-1f8befe28bf1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:45.269030 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8a055-6073-4be7-94bf-1f8befe28bf1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:45.269309 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6ad07-22c8-45bf-a275-31d8f2ca8a06 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.269628 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6ad07-22c8-45bf-a275-31d8f2ca8a06 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.269908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf6ad07-22c8-45bf-a275-31d8f2ca8a06 None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.270565 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d8a055-6073-4be7-94bf-1f8befe28bf1 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:45.270661 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6ad07-22c8-45bf-a275-31d8f2ca8a06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:45.270931 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6ad07-22c8-45bf-a275-31d8f2ca8a06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:45.272458 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf6ad07-22c8-45bf-a275-31d8f2ca8a06 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:45.287240 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 272/562] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:45.287240 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8a055-6073-4be7-94bf-1f8befe28bf1 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:45.290243 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 291/563] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:45.294076 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529fb99-ec9b-4d83-8ac7-942614d79b73 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.294076 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529fb99-ec9b-4d83-8ac7-942614d79b73 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.294076 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0529fb99-ec9b-4d83-8ac7-942614d79b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.309198 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-0529fb99-ec9b-4d83-8ac7-942614d79b73 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:45.310409 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-0529fb99-ec9b-4d83-8ac7-942614d79b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:45.367473 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:45.376788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 292/564] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:45.388891 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529fb99-ec9b-4d83-8ac7-942614d79b73 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:45.399161 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d8a055-6073-4be7-94bf-1f8befe28bf1 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:45.432700 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fff31f-fab4-41e9-8b01-44159418190e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:45.433489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fff31f-fab4-41e9-8b01-44159418190e None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.433777 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fff31f-fab4-41e9-8b01-44159418190e None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.434051 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fff31f-fab4-41e9-8b01-44159418190e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.444049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fff31f-fab4-41e9-8b01-44159418190e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:45.445500 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fff31f-fab4-41e9-8b01-44159418190e None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:45.462522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:45.463542 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-b8fff31f-fab4-41e9-8b01-44159418190e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:45.463542 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:45.463542 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:45.463542 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:45.463542 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:45.463542 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:45.463542 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:45.463542 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:45.463542 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:45.463542 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:45.463542 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:45.463542 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:45.463542 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:45.463542 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:45.463542 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:45.464550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:45.464550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:45.464550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:45.464550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:45.464550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:45.464550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:45.464550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:45.464550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:45.464550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:45.464550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:45.464550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:45.464550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:45.464550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:45.464550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:45.464550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:45.464550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:45.464550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:45.465429 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:45.465429 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:45.465429 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:45.465429 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:45.467745 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 273/565] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:45.469026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65c749-4b8c-45a9-8d99-5122203aa91e None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.469299 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65c749-4b8c-45a9-8d99-5122203aa91e None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.469827 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d65c749-4b8c-45a9-8d99-5122203aa91e None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.471115 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 274/566] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:45.471831 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65c749-4b8c-45a9-8d99-5122203aa91e None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:45.475871 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0529fb99-ec9b-4d83-8ac7-942614d79b73 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:45.509831 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbced1-c365-4002-b2ec-fb7fafb53465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:45.510617 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbced1-c365-4002-b2ec-fb7fafb53465 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.510901 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbced1-c365-4002-b2ec-fb7fafb53465 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.511176 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dbced1-c365-4002-b2ec-fb7fafb53465 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.517887 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbced1-c365-4002-b2ec-fb7fafb53465 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:45.519894 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dbced1-c365-4002-b2ec-fb7fafb53465 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:45.534245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-03dbced1-c365-4002-b2ec-fb7fafb53465 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:45.534245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:45.534245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:45.534245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:45.534245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:45.534245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:45.534245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:45.534245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:45.534245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:45.534245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:45.534245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:45.534245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:45.534245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:13:45.534245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:13:45.534245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:13:45.535212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:13:45.535212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:45.535212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:45.535212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:45.535212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:45.535212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:45.535212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:45.535212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:45.535212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:45.535212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:45.535212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:45.535212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:45.535212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:45.535212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:45.535212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:45.535212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:45.535212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:45.536141 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:13:45.536141 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:13:45.536141 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:13:45.536141 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:13:45.536141 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:13:45.536141 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:13:45.536141 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:45.536141 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:45.540187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 293/567] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:45.540840 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbced1-c365-4002-b2ec-fb7fafb53465 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:45.572260 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d65c749-4b8c-45a9-8d99-5122203aa91e None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:45.600508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:45.606067 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e9512-c417-4bde-bb72-ec081bd82dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:45.606863 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e9512-c417-4bde-bb72-ec081bd82dc0 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.607161 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e9512-c417-4bde-bb72-ec081bd82dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.607438 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5e9512-c417-4bde-bb72-ec081bd82dc0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.615016 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e9512-c417-4bde-bb72-ec081bd82dc0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:45.616489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5e9512-c417-4bde-bb72-ec081bd82dc0 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:45.631072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-8d5e9512-c417-4bde-bb72-ec081bd82dc0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:13:45.631072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:45.631072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:45.631072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:45.631072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:45.631072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:45.631072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:45.631072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:45.631072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:45.631072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:45.631072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:45.631072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:45.631072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:13:45.631072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:13:45.631072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:13:45.631072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:13:45.632040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:45.632040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:45.632040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:13:45.632040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:45.632040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:13:45.632040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:45.632040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:45.632040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:45.632040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:45.632040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:45.632040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:45.632040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:45.632040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:45.632040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:45.632040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:45.632040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:45.632040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:45.632040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:45.632954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:45.632954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:45.632954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:13:45.632954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:13:45.632954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:13:45.632954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:13:45.632954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:13:45.632954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:13:45.632954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:13:45.632954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:45.632954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 275/568] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 16 00:13:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:45.634082 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e9512-c417-4bde-bb72-ec081bd82dc0 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:45.648276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dbced1-c365-4002-b2ec-fb7fafb53465 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:45.682472 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ad5628-064d-438e-93cb-9392e6a21098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:45.683271 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad5628-064d-438e-93cb-9392e6a21098 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.683558 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad5628-064d-438e-93cb-9392e6a21098 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.683864 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ad5628-064d-438e-93cb-9392e6a21098 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.694312 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ad5628-064d-438e-93cb-9392e6a21098 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:45.702043 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-29ad5628-064d-438e-93cb-9392e6a21098 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:45.702043 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:45.702043 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:45.702043 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:45.702043 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:45.702043 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:45.702043 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:45.702043 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:45.702043 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:45.702043 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:45.702043 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:45.702043 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:45.702043 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:45.702043 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:45.702043 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:45.702043 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:45.703011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:45.703011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:45.703011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:45.703011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:45.703011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:45.703011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:45.703011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:45.703011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:45.703011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:45.703011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:45.703011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:45.703011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:45.703011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:45.703011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:45.703011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:45.703011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:45.703888 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:45.703888 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:45.703888 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:45.703888 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:45.703888 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:45.703888 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:45.703888 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:45.703888 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:45.703888 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:45.703888 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:45.703888 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:45.703888 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:45.703888 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 294/569] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 00:13:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:45.705002 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733df54b-6121-458a-89cf-e0631ac5d20e None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.705002 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733df54b-6121-458a-89cf-e0631ac5d20e None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.705002 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733df54b-6121-458a-89cf-e0631ac5d20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.720559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-733df54b-6121-458a-89cf-e0631ac5d20e None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:45.721739 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-733df54b-6121-458a-89cf-e0631ac5d20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:45.724227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:45.733304 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5e9512-c417-4bde-bb72-ec081bd82dc0 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:45.766510 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5ce29-6712-4e83-b024-7bf686d7d78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:45.767160 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5ce29-6712-4e83-b024-7bf686d7d78e None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.767443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5ce29-6712-4e83-b024-7bf686d7d78e None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.767748 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5ce29-6712-4e83-b024-7bf686d7d78e None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.768457 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5ce29-6712-4e83-b024-7bf686d7d78e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:45.768766 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5ce29-6712-4e83-b024-7bf686d7d78e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:45.770663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5ce29-6712-4e83-b024-7bf686d7d78e None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:45.786140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 276/570] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:45.786935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5ce29-6712-4e83-b024-7bf686d7d78e None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:45.791134 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 295/571] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:45.792000 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733df54b-6121-458a-89cf-e0631ac5d20e None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:45.847933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:45.894771 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5ce29-6712-4e83-b024-7bf686d7d78e None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:45.901205 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733df54b-6121-458a-89cf-e0631ac5d20e None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:45.927835 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832737b-afbb-4f0d-9c33-05f6ee661f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:45.928494 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832737b-afbb-4f0d-9c33-05f6ee661f90 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.928781 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832737b-afbb-4f0d-9c33-05f6ee661f90 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.929063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f832737b-afbb-4f0d-9c33-05f6ee661f90 None admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.929840 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832737b-afbb-4f0d-9c33-05f6ee661f90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:45.930156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832737b-afbb-4f0d-9c33-05f6ee661f90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:45.931589 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f832737b-afbb-4f0d-9c33-05f6ee661f90 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:45.934488 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef2c68-ec3d-4a8d-9cd6-2749dec0806f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:45.935156 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef2c68-ec3d-4a8d-9cd6-2749dec0806f None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:45.935439 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef2c68-ec3d-4a8d-9cd6-2749dec0806f None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:45.935756 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef2c68-ec3d-4a8d-9cd6-2749dec0806f None admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:45.936585 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef2c68-ec3d-4a8d-9cd6-2749dec0806f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:45.936897 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef2c68-ec3d-4a8d-9cd6-2749dec0806f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:45.938323 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef2c68-ec3d-4a8d-9cd6-2749dec0806f None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:45.943787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 277/572] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:13:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:45.944578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832737b-afbb-4f0d-9c33-05f6ee661f90 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:45.946858 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:45.958402 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 296/573] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 16 00:13:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:45.959066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef2c68-ec3d-4a8d-9cd6-2749dec0806f None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:46.041773 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f832737b-afbb-4f0d-9c33-05f6ee661f90 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:46.055124 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:46.056664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef2c68-ec3d-4a8d-9cd6-2749dec0806f None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:46.076226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb244d-6c0c-4743-b1fc-c28bde58add6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:46.076882 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb244d-6c0c-4743-b1fc-c28bde58add6 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:46.077162 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb244d-6c0c-4743-b1fc-c28bde58add6 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:46.077436 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb244d-6c0c-4743-b1fc-c28bde58add6 None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:46.078173 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb244d-6c0c-4743-b1fc-c28bde58add6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:46.078480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb244d-6c0c-4743-b1fc-c28bde58add6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:46.079898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb244d-6c0c-4743-b1fc-c28bde58add6 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:46.088439 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 278/574] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 00:13:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:46.089284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb244d-6c0c-4743-b1fc-c28bde58add6 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:46.091321 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0627867-0333-41c9-8c49-9838724dc71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:46.092142 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0627867-0333-41c9-8c49-9838724dc71e None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:46.092426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0627867-0333-41c9-8c49-9838724dc71e None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:46.092703 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0627867-0333-41c9-8c49-9838724dc71e None admin] PATH_INFO: `/v3/users/glance` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:46.099835 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0627867-0333-41c9-8c49-9838724dc71e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:46.101270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0627867-0333-41c9-8c49-9838724dc71e None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:46.116056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-e0627867-0333-41c9-8c49-9838724dc71e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 00:13:46.116056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:46.116056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:46.116056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:46.116056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:46.116056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:46.116056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:46.116056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:46.116056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:46.116056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:46.116056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:46.116056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:46.116056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:13:46.116056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:13:46.116056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:13:46.116056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:13:46.117201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:46.117201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:46.117201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:13:46.117201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:46.117201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:13:46.117201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:46.117201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:46.117201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:46.117201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:46.117201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:46.117201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:46.117201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:46.117201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:46.117201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:46.117201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:46.117201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:46.117201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:46.117201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:46.118505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:46.118505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:46.118505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:13:46.118505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:13:46.118505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:13:46.118505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:13:46.118505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:13:46.118505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:13:46.118505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 00:13:46.118505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:46.118505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 297/575] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:46.118505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0627867-0333-41c9-8c49-9838724dc71e None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:46.171296 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:46.192733 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb244d-6c0c-4743-b1fc-c28bde58add6 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:46.215757 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0627867-0333-41c9-8c49-9838724dc71e None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:46.225611 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c027d08-e6fa-4e55-9444-6290ec2bf117 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:46.226405 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c027d08-e6fa-4e55-9444-6290ec2bf117 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:46.226692 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c027d08-e6fa-4e55-9444-6290ec2bf117 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:46.226966 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c027d08-e6fa-4e55-9444-6290ec2bf117 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:46.236861 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c027d08-e6fa-4e55-9444-6290ec2bf117 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:46.245141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-7c027d08-e6fa-4e55-9444-6290ec2bf117 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:46.245141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:46.245141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:46.245141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:46.245141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:46.245141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:46.245141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:46.245141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:46.245141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:46.245141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:46.245141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:46.245141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:46.245141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:46.245141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:46.245141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:46.245141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:46.246049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:46.246049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:46.246049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:46.246049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:46.246049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:46.246049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:46.246049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:46.246049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:46.246049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:46.246049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:46.246049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:46.246049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:46.246049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:46.246049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:46.246049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:46.246049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:46.246860 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:46.246860 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:46.246860 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:46.246860 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:46.246860 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:46.246860 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:46.246860 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:46.246860 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:46.246860 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:46.246860 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:46.246860 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:46.246860 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:46.246860 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 279/576] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 00:13:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:46.248166 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c027d08-e6fa-4e55-9444-6290ec2bf117 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:46.251083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcce5a-9ab7-4508-b012-7501470aa02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:46.251770 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcce5a-9ab7-4508-b012-7501470aa02d None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:46.252058 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcce5a-9ab7-4508-b012-7501470aa02d None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:46.252339 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fcce5a-9ab7-4508-b012-7501470aa02d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:46.253181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcce5a-9ab7-4508-b012-7501470aa02d None admin] RBAC: Adding query filter params (role.id=338a913607974d379aad3249b3d0402d, scope.project.id=320d79ecbc2342af8031103e7308c10d, user.id=9918c4a8c6a64812b61fc235ab8e7bec) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:46.253499 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcce5a-9ab7-4508-b012-7501470aa02d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:46.254993 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fcce5a-9ab7-4508-b012-7501470aa02d None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:46.261084 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 298/577] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:46 2022] GET /identity/v3/role_assignments?user.id=9918c4a8c6a64812b61fc235ab8e7bec&scope.project.id=320d79ecbc2342af8031103e7308c10d&role.id=338a913607974d379aad3249b3d0402d => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:46.261848 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcce5a-9ab7-4508-b012-7501470aa02d None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:46.289348 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:46.365532 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c027d08-e6fa-4e55-9444-6290ec2bf117 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:46.380851 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fcce5a-9ab7-4508-b012-7501470aa02d None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:46.403330 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea047b1-7a4c-4c46-b17c-626916ea8525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:46.403920 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:46.404348 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea047b1-7a4c-4c46-b17c-626916ea8525 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:46.404701 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea047b1-7a4c-4c46-b17c-626916ea8525 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:46.405066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea047b1-7a4c-4c46-b17c-626916ea8525 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:46.417898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea047b1-7a4c-4c46-b17c-626916ea8525 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:46.419370 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea047b1-7a4c-4c46-b17c-626916ea8525 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:46.420863 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537fc6e-f435-4ae0-8781-33d12526ca58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:46.421667 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537fc6e-f435-4ae0-8781-33d12526ca58 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:46.421958 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537fc6e-f435-4ae0-8781-33d12526ca58 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:46.422235 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7537fc6e-f435-4ae0-8781-33d12526ca58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:46.434497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537fc6e-f435-4ae0-8781-33d12526ca58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:46.436013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7537fc6e-f435-4ae0-8781-33d12526ca58 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:46.437853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-eea047b1-7a4c-4c46-b17c-626916ea8525 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:46.437853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:46.437853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:46.437853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:46.437853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:46.437853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:46.437853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:46.437853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:46.437853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:46.437853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:46.437853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:46.437853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:46.437853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:46.437853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:46.437853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:46.438743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:46.438743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:46.438743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:46.438743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:46.438743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:46.438743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:46.438743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:46.438743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:46.438743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:46.438743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:46.438743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:46.438743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:46.438743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:46.438743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:46.438743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:46.438743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:46.438743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:46.439652 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:46.439652 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:46.439652 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:46.439652 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:46.439652 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 280/578] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:46.439936 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea047b1-7a4c-4c46-b17c-626916ea8525 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:46.459127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-7537fc6e-f435-4ae0-8781-33d12526ca58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:46.459127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:46.459127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:46.459127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:46.459127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:46.459127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:46.459127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:46.459127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:46.459127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:46.459127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:46.459127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:46.459127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:46.459127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:46.459127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:46.459127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:46.460199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:46.460199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:46.460199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:46.460199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:46.460199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:46.460199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:46.460199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:46.460199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:46.460199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:46.460199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:46.460199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:46.460199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:46.460199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:46.460199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:46.460199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:46.460199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:46.460199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:46.465853 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:46.465853 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:46.465853 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:46.465853 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:46.465853 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 299/579] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:46.465853 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537fc6e-f435-4ae0-8781-33d12526ca58 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:46.536032 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:46.551825 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea047b1-7a4c-4c46-b17c-626916ea8525 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:46.575311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7537fc6e-f435-4ae0-8781-33d12526ca58 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:46.586856 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db2691-deb9-4fdb-b12d-1ee712cbbf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:46.587641 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db2691-deb9-4fdb-b12d-1ee712cbbf57 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:46.587940 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db2691-deb9-4fdb-b12d-1ee712cbbf57 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:46.588225 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db2691-deb9-4fdb-b12d-1ee712cbbf57 None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:46.589064 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db2691-deb9-4fdb-b12d-1ee712cbbf57 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:46.589381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db2691-deb9-4fdb-b12d-1ee712cbbf57 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:46.590833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db2691-deb9-4fdb-b12d-1ee712cbbf57 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:46.613336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 281/580] 10.222.0.44 () {56 vars in 1137 bytes} [Thu Jun 16 00:13:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:46.613336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db2691-deb9-4fdb-b12d-1ee712cbbf57 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:46.615598 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e1e04-6935-4488-8f1d-4c1c4735b652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:46.616252 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e1e04-6935-4488-8f1d-4c1c4735b652 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:46.616542 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e1e04-6935-4488-8f1d-4c1c4735b652 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:46.616824 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4e1e04-6935-4488-8f1d-4c1c4735b652 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:46.617583 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e1e04-6935-4488-8f1d-4c1c4735b652 None admin] RBAC: Adding query filter params (name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:46.617898 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e1e04-6935-4488-8f1d-4c1c4735b652 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:46.619277 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4e1e04-6935-4488-8f1d-4c1c4735b652 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:46.633376 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 300/581] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 00:13:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:46.634138 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e1e04-6935-4488-8f1d-4c1c4735b652 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:46.671087 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:46.716134 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db2691-deb9-4fdb-b12d-1ee712cbbf57 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:46.747263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4e1e04-6935-4488-8f1d-4c1c4735b652 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:46.750815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452ba63-2556-405f-9fc8-12aefef6bfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:46.751480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452ba63-2556-405f-9fc8-12aefef6bfa4 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:46.751800 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452ba63-2556-405f-9fc8-12aefef6bfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:46.752079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d452ba63-2556-405f-9fc8-12aefef6bfa4 None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:46.752854 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452ba63-2556-405f-9fc8-12aefef6bfa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:46.753168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452ba63-2556-405f-9fc8-12aefef6bfa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:46.755150 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d452ba63-2556-405f-9fc8-12aefef6bfa4 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:46.767452 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 282/582] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:46.768407 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452ba63-2556-405f-9fc8-12aefef6bfa4 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:46.773755 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:46.792952 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25c8c8-e7c4-4f96-a964-0d0db667737c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:46.793628 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25c8c8-e7c4-4f96-a964-0d0db667737c None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:46.793911 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25c8c8-e7c4-4f96-a964-0d0db667737c None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:46.794187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b25c8c8-e7c4-4f96-a964-0d0db667737c None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:46.795179 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25c8c8-e7c4-4f96-a964-0d0db667737c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:46.795179 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25c8c8-e7c4-4f96-a964-0d0db667737c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:46.797802 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b25c8c8-e7c4-4f96-a964-0d0db667737c None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:46.809497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 301/583] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:46.810215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25c8c8-e7c4-4f96-a964-0d0db667737c None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:46.884794 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d452ba63-2556-405f-9fc8-12aefef6bfa4 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:46.912290 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:46.919416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d3d9c-67a3-42a0-ae9c-d173525835ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:46.920255 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d3d9c-67a3-42a0-ae9c-d173525835ef None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:46.920539 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d3d9c-67a3-42a0-ae9c-d173525835ef None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:46.920706 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b25c8c8-e7c4-4f96-a964-0d0db667737c None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:46.920807 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d3d9c-67a3-42a0-ae9c-d173525835ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:46.931907 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d3d9c-67a3-42a0-ae9c-d173525835ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:46.933380 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d3d9c-67a3-42a0-ae9c-d173525835ef None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:46.951725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-c91d3d9c-67a3-42a0-ae9c-d173525835ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:46.951725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:46.951725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:46.951725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:46.951725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:46.951725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:46.951725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:46.951725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:46.951725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:46.951725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:46.951725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:46.951725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:46.951725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:46.951725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:46.951725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:46.952796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:46.952796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:46.952796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:46.952796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:46.952796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:46.952796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:46.952796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:46.952796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:46.952796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:46.952796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:46.952796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:46.952796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:46.952796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:46.952796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:46.952796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:46.952796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:46.952796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:46.953707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:46.953707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:46.953707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:46.953707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:46.953707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 283/584] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:46.953707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d3d9c-67a3-42a0-ae9c-d173525835ef None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:46.963255 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c871d09-ac4e-4832-b7e1-efbeafe5fb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:46.964091 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c871d09-ac4e-4832-b7e1-efbeafe5fb58 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:46.964379 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c871d09-ac4e-4832-b7e1-efbeafe5fb58 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:46.964657 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c871d09-ac4e-4832-b7e1-efbeafe5fb58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:46.975399 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c871d09-ac4e-4832-b7e1-efbeafe5fb58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:46.977339 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c871d09-ac4e-4832-b7e1-efbeafe5fb58 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:46.996654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-9c871d09-ac4e-4832-b7e1-efbeafe5fb58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:46.996654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:46.996654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:46.996654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:46.996654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:46.996654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:46.996654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:46.996654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:46.996654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:46.996654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:46.996654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:46.996654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:46.996654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:46.996654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:46.996654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:46.997613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:46.997613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:46.997613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:46.997613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:46.997613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:46.997613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:46.997613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:46.997613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:46.997613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:46.997613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:46.997613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:46.997613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:46.997613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:46.997613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:46.997613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:46.997613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:46.997613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:46.999518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:46.999518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:46.999518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:46.999518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:46.999518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 302/585] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:46.999518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c871d09-ac4e-4832-b7e1-efbeafe5fb58 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:47.020277 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:47.067294 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d3d9c-67a3-42a0-ae9c-d173525835ef None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:47.100830 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d502e-1b48-4080-8238-c022e4e1c074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:47.101603 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c871d09-ac4e-4832-b7e1-efbeafe5fb58 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:47.102036 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d502e-1b48-4080-8238-c022e4e1c074 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:47.102036 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d502e-1b48-4080-8238-c022e4e1c074 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:47.102168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d502e-1b48-4080-8238-c022e4e1c074 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:47.109479 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d502e-1b48-4080-8238-c022e4e1c074 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:47.111059 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270d502e-1b48-4080-8238-c022e4e1c074 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:47.126386 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-270d502e-1b48-4080-8238-c022e4e1c074 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:47.126386 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:47.126386 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:47.126386 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:47.126386 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:47.126386 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:47.126386 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:47.126386 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:47.126386 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:47.126386 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:47.126386 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:47.126386 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:47.126386 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:13:47.126386 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:13:47.126386 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:13:47.127303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:13:47.127303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:47.127303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:47.127303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:47.127303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:47.127303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:47.127303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:47.127303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:47.127303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:47.127303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:47.127303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:47.127303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:47.127303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:47.127303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:47.127303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:47.127303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:47.127303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:47.128508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:13:47.128508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:13:47.128508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:13:47.128508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:13:47.128508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:13:47.128508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:13:47.128508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:47.128508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:47.128508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 284/586] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:47.128508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d502e-1b48-4080-8238-c022e4e1c074 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:47.141603 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4e2ed-dc3b-4c09-ab6d-8b7c98d856c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:47.142340 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4e2ed-dc3b-4c09-ab6d-8b7c98d856c4 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:47.142623 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4e2ed-dc3b-4c09-ab6d-8b7c98d856c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:47.142916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a4e2ed-dc3b-4c09-ab6d-8b7c98d856c4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:47.150001 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4e2ed-dc3b-4c09-ab6d-8b7c98d856c4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:47.151454 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a4e2ed-dc3b-4c09-ab6d-8b7c98d856c4 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:47.166398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-b1a4e2ed-dc3b-4c09-ab6d-8b7c98d856c4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:13:47.166398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:47.166398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:47.166398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:47.166398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:47.166398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:47.166398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:47.166398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:47.166398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:47.166398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:47.166398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:47.166398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:47.166398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:13:47.166398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:13:47.166398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:13:47.166398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:13:47.167516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:47.167516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:47.167516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:13:47.167516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:47.167516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:13:47.167516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:47.167516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:47.167516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:47.167516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:47.167516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:47.167516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:47.167516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:47.167516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:47.167516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:47.167516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:47.167516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:47.167516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:47.167516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:47.168742 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:47.168742 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:47.168742 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:13:47.168742 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:13:47.168742 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:13:47.168742 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:13:47.168742 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:13:47.168742 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:13:47.168742 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:13:47.168742 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:47.172260 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 303/587] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:47.173122 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4e2ed-dc3b-4c09-ab6d-8b7c98d856c4 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:47.181601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:47.237215 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d502e-1b48-4080-8238-c022e4e1c074 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:47.254823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:47.273440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a4e2ed-dc3b-4c09-ab6d-8b7c98d856c4 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:47.273719 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ca5b8-62e0-40a5-812a-cf8b8f0b0d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:47.274388 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ca5b8-62e0-40a5-812a-cf8b8f0b0d04 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:47.274672 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ca5b8-62e0-40a5-812a-cf8b8f0b0d04 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:47.275067 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ca5b8-62e0-40a5-812a-cf8b8f0b0d04 None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:47.275932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ca5b8-62e0-40a5-812a-cf8b8f0b0d04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:47.276241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ca5b8-62e0-40a5-812a-cf8b8f0b0d04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:47.277615 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ca5b8-62e0-40a5-812a-cf8b8f0b0d04 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:47.294158 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 285/588] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:47.294158 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ca5b8-62e0-40a5-812a-cf8b8f0b0d04 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:47.313985 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9b12d-e1a6-4ade-a077-a2ece6e72c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:47.314683 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9b12d-e1a6-4ade-a077-a2ece6e72c1f None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:47.314967 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9b12d-e1a6-4ade-a077-a2ece6e72c1f None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:47.315244 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca9b12d-e1a6-4ade-a077-a2ece6e72c1f None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:47.316017 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca9b12d-e1a6-4ade-a077-a2ece6e72c1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:47.316894 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca9b12d-e1a6-4ade-a077-a2ece6e72c1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:47.318312 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca9b12d-e1a6-4ade-a077-a2ece6e72c1f None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:47.336360 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 304/589] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:47.336360 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9b12d-e1a6-4ade-a077-a2ece6e72c1f None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:47.399830 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ca5b8-62e0-40a5-812a-cf8b8f0b0d04 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:47.403806 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:47.438770 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85f986-c005-46ac-bf0f-23041a0851fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:47.438969 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca9b12d-e1a6-4ade-a077-a2ece6e72c1f None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:47.439444 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85f986-c005-46ac-bf0f-23041a0851fc None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:47.439753 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85f986-c005-46ac-bf0f-23041a0851fc None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:47.440033 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d85f986-c005-46ac-bf0f-23041a0851fc None admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:47.442173 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85f986-c005-46ac-bf0f-23041a0851fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:47.442173 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85f986-c005-46ac-bf0f-23041a0851fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:47.443297 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d85f986-c005-46ac-bf0f-23041a0851fc None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:47.461218 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 286/590] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:13:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:47.461218 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85f986-c005-46ac-bf0f-23041a0851fc None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:47.477392 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e87d2-d340-44cf-8e80-ac854c78f23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:47.478065 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e87d2-d340-44cf-8e80-ac854c78f23f None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:47.478353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e87d2-d340-44cf-8e80-ac854c78f23f None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:47.478632 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e87d2-d340-44cf-8e80-ac854c78f23f None admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:47.479469 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e87d2-d340-44cf-8e80-ac854c78f23f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:47.479814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e87d2-d340-44cf-8e80-ac854c78f23f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:47.481243 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e87d2-d340-44cf-8e80-ac854c78f23f None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:47.498170 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 305/591] 10.222.0.44 () {56 vars in 1137 bytes} [Thu Jun 16 00:13:47 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:47.498952 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e87d2-d340-44cf-8e80-ac854c78f23f None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:47.502932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:47.573149 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d85f986-c005-46ac-bf0f-23041a0851fc None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:47.601743 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e87d2-d340-44cf-8e80-ac854c78f23f None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:47.609863 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a82e6-9293-4f05-96ab-c1b7c3fdcf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:47.610915 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a82e6-9293-4f05-96ab-c1b7c3fdcf0d None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:47.611514 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a82e6-9293-4f05-96ab-c1b7c3fdcf0d None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:47.611884 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2a82e6-9293-4f05-96ab-c1b7c3fdcf0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:47.619155 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a82e6-9293-4f05-96ab-c1b7c3fdcf0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:47.620767 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2a82e6-9293-4f05-96ab-c1b7c3fdcf0d None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:47.625747 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:47.636919 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85a5d2-f3fc-4c63-b6be-fd94b90338cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:47.637225 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-ba2a82e6-9293-4f05-96ab-c1b7c3fdcf0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:47.637225 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:47.637225 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:47.637225 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:47.637225 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:47.637225 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:47.637225 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:47.637225 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:47.637225 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:47.637225 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:47.637225 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:47.637225 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:47.637225 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:13:47.637225 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:13:47.637225 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:13:47.638077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:13:47.638077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:47.638077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:47.638077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:47.638077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:47.638077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:47.638077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:47.638077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:47.638077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:47.638077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:47.638077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:47.638077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:47.638077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:47.638077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:47.638077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:47.638077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:47.638077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:47.638969 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:13:47.638969 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:13:47.638969 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:13:47.638969 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:13:47.638969 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:13:47.638969 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:13:47.638969 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:47.638969 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:47.639408 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85a5d2-f3fc-4c63-b6be-fd94b90338cd None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:47.639408 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85a5d2-f3fc-4c63-b6be-fd94b90338cd None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:47.639408 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f85a5d2-f3fc-4c63-b6be-fd94b90338cd None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:47.643344 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 287/592] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:47.644229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a82e6-9293-4f05-96ab-c1b7c3fdcf0d None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:47.647309 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85a5d2-f3fc-4c63-b6be-fd94b90338cd None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:47.648717 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f85a5d2-f3fc-4c63-b6be-fd94b90338cd None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:47.663671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-5f85a5d2-f3fc-4c63-b6be-fd94b90338cd None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 00:13:47.663671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:47.663671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:47.663671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:47.663671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:47.663671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:47.663671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:47.663671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:47.663671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:47.663671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:47.663671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:47.663671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:47.663671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:13:47.663671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:13:47.663671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:13:47.663671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:13:47.669608 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:47.669608 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:47.669608 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:13:47.669608 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:47.669608 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:13:47.669608 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:47.669608 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:47.669608 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:47.669608 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:47.669608 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:47.669608 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:47.669608 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:47.669608 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:47.669608 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:47.669608 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:47.669608 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:47.669608 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:47.669608 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:47.670849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:47.670849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:47.670849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:13:47.670849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:13:47.670849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:13:47.670849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:13:47.670849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:13:47.670849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:13:47.670849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 00:13:47.670849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:47.670849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 306/593] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 00:13:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:47.670849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85a5d2-f3fc-4c63-b6be-fd94b90338cd None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:47.752000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:47.759953 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2a82e6-9293-4f05-96ab-c1b7c3fdcf0d None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:47.773151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f85a5d2-f3fc-4c63-b6be-fd94b90338cd None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:47.801993 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e6f30-71c7-4a5b-9db4-dacb8a8d40d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:47.803206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e6f30-71c7-4a5b-9db4-dacb8a8d40d9 None admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:47.803598 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e6f30-71c7-4a5b-9db4-dacb8a8d40d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:47.803963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7e6f30-71c7-4a5b-9db4-dacb8a8d40d9 None admin] PATH_INFO: `/v3/projects/320d79ecbc2342af8031103e7308c10d/users/40432493f16b4df681daf5a1af87832a/roles/338a913607974d379aad3249b3d0402d` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:47.813541 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04815c-23f9-49fa-949b-c564461c79c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:47.814415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04815c-23f9-49fa-949b-c564461c79c5 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:47.814704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04815c-23f9-49fa-949b-c564461c79c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:47.814980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04815c-23f9-49fa-949b-c564461c79c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:47.820096 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e6f30-71c7-4a5b-9db4-dacb8a8d40d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=320d79ecbc2342af8031103e7308c10d, user_id=40432493f16b4df681daf5a1af87832a, role_id=338a913607974d379aad3249b3d0402d)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:47.821743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7e6f30-71c7-4a5b-9db4-dacb8a8d40d9 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:47.825221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04815c-23f9-49fa-949b-c564461c79c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:47.826691 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04815c-23f9-49fa-949b-c564461c79c5 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:47.843644 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 288/594] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 00:13:47 2022] PUT /identity/v3/projects/320d79ecbc2342af8031103e7308c10d/users/40432493f16b4df681daf5a1af87832a/roles/338a913607974d379aad3249b3d0402d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:13:47.843644 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e6f30-71c7-4a5b-9db4-dacb8a8d40d9 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:47.854488 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-ed04815c-23f9-49fa-949b-c564461c79c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:47.854488 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:47.854488 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:47.854488 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:47.854488 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:47.854488 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:47.854488 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:47.854488 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:47.854488 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:47.854488 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:47.854488 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:47.854488 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:47.854488 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:47.854488 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:47.854488 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:47.855671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:47.855671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:47.855671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:47.855671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:47.855671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:47.855671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:47.855671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:47.855671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:47.855671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:47.855671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:47.855671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:47.855671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:47.855671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:47.855671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:47.855671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:47.855671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:47.855671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:47.856704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:47.856704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:47.856704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:47.856704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:47.857383 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 307/595] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:47.858710 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04815c-23f9-49fa-949b-c564461c79c5 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:47.898544 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:47.979896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04815c-23f9-49fa-949b-c564461c79c5 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:47.981784 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7e6f30-71c7-4a5b-9db4-dacb8a8d40d9 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:48.020622 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804227d-0a36-4c09-95f1-f7fc76733c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:48.021577 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804227d-0a36-4c09-95f1-f7fc76733c83 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:48.021964 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804227d-0a36-4c09-95f1-f7fc76733c83 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:48.022343 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e804227d-0a36-4c09-95f1-f7fc76733c83 None admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:48.023441 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804227d-0a36-4c09-95f1-f7fc76733c83 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:48.023889 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804227d-0a36-4c09-95f1-f7fc76733c83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:48.025538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e804227d-0a36-4c09-95f1-f7fc76733c83 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:48.034094 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fda51f-ce70-4aa5-a235-b904434614a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:48.035540 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fda51f-ce70-4aa5-a235-b904434614a3 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:48.036272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fda51f-ce70-4aa5-a235-b904434614a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:48.036695 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fda51f-ce70-4aa5-a235-b904434614a3 None admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:48.038586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fda51f-ce70-4aa5-a235-b904434614a3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:48.039065 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fda51f-ce70-4aa5-a235-b904434614a3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:48.040683 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fda51f-ce70-4aa5-a235-b904434614a3 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:48.051846 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 308/596] 10.222.0.44 () {56 vars in 1139 bytes} [Thu Jun 16 00:13:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:48.052756 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804227d-0a36-4c09-95f1-f7fc76733c83 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:48.054087 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 289/597] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:13:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:48.057570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fda51f-ce70-4aa5-a235-b904434614a3 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:48.071500 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:48.169601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:48.180255 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e804227d-0a36-4c09-95f1-f7fc76733c83 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:48.185518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fda51f-ce70-4aa5-a235-b904434614a3 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:48.225408 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5af30-eba3-4e6f-a020-baba28ae3545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:48.226615 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5af30-eba3-4e6f-a020-baba28ae3545 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:48.227107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5af30-eba3-4e6f-a020-baba28ae3545 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:48.227688 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a5af30-eba3-4e6f-a020-baba28ae3545 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:48.232242 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c17f9-8a64-49b8-95f3-98d601d2d3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:48.232857 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c17f9-8a64-49b8-95f3-98d601d2d3b9 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:48.233145 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c17f9-8a64-49b8-95f3-98d601d2d3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:48.233426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c17f9-8a64-49b8-95f3-98d601d2d3b9 None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:48.234158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c17f9-8a64-49b8-95f3-98d601d2d3b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:48.234471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c17f9-8a64-49b8-95f3-98d601d2d3b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:48.235870 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8c17f9-8a64-49b8-95f3-98d601d2d3b9 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:48.241541 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5af30-eba3-4e6f-a020-baba28ae3545 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:48.243241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a5af30-eba3-4e6f-a020-baba28ae3545 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:48.251663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 309/598] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:48.251970 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c17f9-8a64-49b8-95f3-98d601d2d3b9 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:48.266762 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-45a5af30-eba3-4e6f-a020-baba28ae3545 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:48.266762 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:48.266762 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:48.266762 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:48.266762 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:48.266762 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:48.266762 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:48.266762 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:48.266762 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:48.266762 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:48.266762 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:48.266762 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:48.266762 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:48.266762 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:48.266762 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:48.267805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:48.267805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:48.267805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:48.267805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:48.267805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:48.267805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:48.267805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:48.267805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:48.267805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:48.267805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:48.267805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:48.267805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:48.267805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:48.267805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:48.267805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:48.267805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:48.267805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:48.268686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:48.268686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:48.268686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:48.268686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:48.268912 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 290/599] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:13:48.270596 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5af30-eba3-4e6f-a020-baba28ae3545 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:48.337213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:48.385653 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c17f9-8a64-49b8-95f3-98d601d2d3b9 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:48.387529 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a5af30-eba3-4e6f-a020-baba28ae3545 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:48.422446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913a557-6fd3-4e8d-b643-88c920852194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:48.422793 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c443d0-9091-4f47-89da-b150210a6f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:48.423240 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913a557-6fd3-4e8d-b643-88c920852194 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:48.423523 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913a557-6fd3-4e8d-b643-88c920852194 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:48.423715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c443d0-9091-4f47-89da-b150210a6f48 None admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:48.423809 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1913a557-6fd3-4e8d-b643-88c920852194 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:48.423984 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c443d0-9091-4f47-89da-b150210a6f48 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:48.424259 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c443d0-9091-4f47-89da-b150210a6f48 None admin] PATH_INFO: `/v3/projects/320d79ecbc2342af8031103e7308c10d/users/faaab5440b7041faa5a6f9ea18c188c4/roles/338a913607974d379aad3249b3d0402d` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:48.431536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913a557-6fd3-4e8d-b643-88c920852194 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:48.433018 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1913a557-6fd3-4e8d-b643-88c920852194 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:48.440086 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c443d0-9091-4f47-89da-b150210a6f48 None admin] RBAC: Authorizing `identity:create_grant(project_id=320d79ecbc2342af8031103e7308c10d, user_id=faaab5440b7041faa5a6f9ea18c188c4, role_id=338a913607974d379aad3249b3d0402d)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:48.441625 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62c443d0-9091-4f47-89da-b150210a6f48 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:48.447270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-1913a557-6fd3-4e8d-b643-88c920852194 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:48.447270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:48.447270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:48.447270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:48.447270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:48.447270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:48.447270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:48.447270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:48.447270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:48.447270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:48.447270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:48.447270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:48.447270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:13:48.447270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:13:48.447270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:13:48.448516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:13:48.448516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:48.448516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:48.448516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:48.448516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:48.448516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:48.448516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:48.448516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:48.448516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:48.448516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:48.448516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:48.448516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:48.448516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:48.448516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:48.448516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:48.448516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:48.448516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:48.449619 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:13:48.449619 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:13:48.449619 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:13:48.449619 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:13:48.449619 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:13:48.449619 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:13:48.449619 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:48.449619 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:48.453658 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 291/600] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:48.454724 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913a557-6fd3-4e8d-b643-88c920852194 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:48.467793 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 310/601] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 00:13:48 2022] PUT /identity/v3/projects/320d79ecbc2342af8031103e7308c10d/users/faaab5440b7041faa5a6f9ea18c188c4/roles/338a913607974d379aad3249b3d0402d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:13:48.467793 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80583ad1-3003-4062-b00b-889bc00fbf63 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:48.467793 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80583ad1-3003-4062-b00b-889bc00fbf63 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:48.467793 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80583ad1-3003-4062-b00b-889bc00fbf63 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:48.467793 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 311/602] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:48.467793 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80583ad1-3003-4062-b00b-889bc00fbf63 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:48.470463 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:48.602406 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1913a557-6fd3-4e8d-b643-88c920852194 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:48.605362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80583ad1-3003-4062-b00b-889bc00fbf63 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:48.625284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:48.650121 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffeb357-7a4f-4a1a-89bd-deb631fb8116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:48.650788 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffeb357-7a4f-4a1a-89bd-deb631fb8116 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:48.651070 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffeb357-7a4f-4a1a-89bd-deb631fb8116 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:48.651341 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffeb357-7a4f-4a1a-89bd-deb631fb8116 None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:48.652112 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffeb357-7a4f-4a1a-89bd-deb631fb8116 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:48.652414 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffeb357-7a4f-4a1a-89bd-deb631fb8116 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:48.653005 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6d4f9-66d2-409b-ac5d-ef49fb04ee65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:48.653674 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6d4f9-66d2-409b-ac5d-ef49fb04ee65 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:48.653840 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffeb357-7a4f-4a1a-89bd-deb631fb8116 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:48.653989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6d4f9-66d2-409b-ac5d-ef49fb04ee65 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:48.654230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6d4f9-66d2-409b-ac5d-ef49fb04ee65 None admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:48.655021 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6d4f9-66d2-409b-ac5d-ef49fb04ee65 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:48.655644 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6d4f9-66d2-409b-ac5d-ef49fb04ee65 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:48.657627 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6d4f9-66d2-409b-ac5d-ef49fb04ee65 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:48.667602 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 292/603] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:48.668902 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469afb4-75a3-47d9-be76-f4de07bd405c None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:48.669191 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469afb4-75a3-47d9-be76-f4de07bd405c None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:48.669469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e469afb4-75a3-47d9-be76-f4de07bd405c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:48.676525 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 312/604] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:13:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:48.677714 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6d4f9-66d2-409b-ac5d-ef49fb04ee65 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:48.690886 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-e469afb4-75a3-47d9-be76-f4de07bd405c None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:48.692473 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e469afb4-75a3-47d9-be76-f4de07bd405c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:48.765248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:48.770030 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 293/605] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:48.772087 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469afb4-75a3-47d9-be76-f4de07bd405c None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:48.823699 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6d4f9-66d2-409b-ac5d-ef49fb04ee65 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:48.861206 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb590a9-84e0-4a2d-8ba1-786abd1ad4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:48.862149 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb590a9-84e0-4a2d-8ba1-786abd1ad4ef None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:48.862524 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb590a9-84e0-4a2d-8ba1-786abd1ad4ef None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:48.862814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb590a9-84e0-4a2d-8ba1-786abd1ad4ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:48.870518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb590a9-84e0-4a2d-8ba1-786abd1ad4ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:48.872230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb590a9-84e0-4a2d-8ba1-786abd1ad4ef None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:48.884500 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e469afb4-75a3-47d9-be76-f4de07bd405c None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:48.889320 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-dcb590a9-84e0-4a2d-8ba1-786abd1ad4ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:48.889320 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:48.889320 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:48.889320 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:48.889320 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:48.889320 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:48.889320 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:48.889320 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:48.889320 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:48.889320 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:48.889320 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:48.889320 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:48.889320 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:13:48.889320 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:13:48.889320 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:13:48.890375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:13:48.890375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:48.890375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:48.890375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:48.890375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:48.890375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:48.890375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:48.890375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:48.890375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:48.890375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:48.890375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:48.890375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:48.890375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:48.890375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:48.890375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:48.890375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:48.890375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:48.891316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:13:48.891316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:13:48.891316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:13:48.891316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:13:48.891316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:13:48.891316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:13:48.891316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:48.891316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:48.892314 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 313/606] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:48.893272 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb590a9-84e0-4a2d-8ba1-786abd1ad4ef None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:48.898430 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:48.926729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485682b-ccc2-4ab0-9891-94f2ba765bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:48.927970 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485682b-ccc2-4ab0-9891-94f2ba765bae None admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:48.928350 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485682b-ccc2-4ab0-9891-94f2ba765bae None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:48.928721 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485682b-ccc2-4ab0-9891-94f2ba765bae None admin] PATH_INFO: `/v3/projects/320d79ecbc2342af8031103e7308c10d/users/33ba9644ca064e95b43650424baef79f/roles/338a913607974d379aad3249b3d0402d` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:48.944345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485682b-ccc2-4ab0-9891-94f2ba765bae None admin] RBAC: Authorizing `identity:create_grant(project_id=320d79ecbc2342af8031103e7308c10d, user_id=33ba9644ca064e95b43650424baef79f, role_id=338a913607974d379aad3249b3d0402d)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:48.946001 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485682b-ccc2-4ab0-9891-94f2ba765bae None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:48.971647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 294/607] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 00:13:48 2022] PUT /identity/v3/projects/320d79ecbc2342af8031103e7308c10d/users/33ba9644ca064e95b43650424baef79f/roles/338a913607974d379aad3249b3d0402d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:13:48.971647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485682b-ccc2-4ab0-9891-94f2ba765bae None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:49.077576 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb590a9-84e0-4a2d-8ba1-786abd1ad4ef None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:49.081692 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485682b-ccc2-4ab0-9891-94f2ba765bae None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:49.121017 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbbb34-bcc7-4ba4-b868-5dfc93f40d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:49.121704 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbbb34-bcc7-4ba4-b868-5dfc93f40d02 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:49.122056 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbbb34-bcc7-4ba4-b868-5dfc93f40d02 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:49.122403 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bbbb34-bcc7-4ba4-b868-5dfc93f40d02 None admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:49.123332 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbbb34-bcc7-4ba4-b868-5dfc93f40d02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:49.123777 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbbb34-bcc7-4ba4-b868-5dfc93f40d02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:49.127636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bbbb34-bcc7-4ba4-b868-5dfc93f40d02 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:49.138931 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 295/608] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:13:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:49.142073 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:49.146876 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbbb34-bcc7-4ba4-b868-5dfc93f40d02 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:49.173995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559b92e-b57c-4f5a-b707-788bf571d49c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:49.174811 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559b92e-b57c-4f5a-b707-788bf571d49c None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:49.175092 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559b92e-b57c-4f5a-b707-788bf571d49c None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:49.175364 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d559b92e-b57c-4f5a-b707-788bf571d49c None admin] PATH_INFO: `/v3/roles/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:49.185187 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:49.202659 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d559b92e-b57c-4f5a-b707-788bf571d49c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:49.215893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-d559b92e-b57c-4f5a-b707-788bf571d49c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:49.215893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:49.215893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:49.215893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:49.215893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:49.215893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:49.215893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:49.215893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:49.215893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:49.215893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:49.215893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:49.215893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:49.215893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:49.215893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:49.215893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:49.215893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:49.216930 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:49.216930 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:49.216930 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:49.216930 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:49.216930 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:49.216930 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:49.216930 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:49.216930 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:49.216930 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:49.216930 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:49.216930 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:49.216930 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:49.216930 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:49.216930 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:49.216930 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:49.216930 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:49.217760 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:49.217760 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:49.217760 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:49.217760 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:49.217760 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:49.217760 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:49.217760 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:49.217760 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:49.217760 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:49.217760 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:49.217760 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:49.217760 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:49.219705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 314/609] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 00:13:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:49.223991 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559b92e-b57c-4f5a-b707-788bf571d49c None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:49.295050 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bbbb34-bcc7-4ba4-b868-5dfc93f40d02 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:49.345317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d559b92e-b57c-4f5a-b707-788bf571d49c None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:49.355579 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb585245-2049-4794-8d6c-2950a8e55d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:49.357116 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb585245-2049-4794-8d6c-2950a8e55d3e None admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:49.357637 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb585245-2049-4794-8d6c-2950a8e55d3e None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:49.358105 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb585245-2049-4794-8d6c-2950a8e55d3e None admin] PATH_INFO: `/v3/projects/320d79ecbc2342af8031103e7308c10d/users/222e3db424f0476386bc3432cc0f868e/roles/338a913607974d379aad3249b3d0402d` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:49.382608 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb585245-2049-4794-8d6c-2950a8e55d3e None admin] RBAC: Authorizing `identity:create_grant(project_id=320d79ecbc2342af8031103e7308c10d, user_id=222e3db424f0476386bc3432cc0f868e, role_id=338a913607974d379aad3249b3d0402d)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:49.385160 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb585245-2049-4794-8d6c-2950a8e55d3e None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:49.408812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 296/610] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 00:13:49 2022] PUT /identity/v3/projects/320d79ecbc2342af8031103e7308c10d/users/222e3db424f0476386bc3432cc0f868e/roles/338a913607974d379aad3249b3d0402d => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:13:49.413942 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c832a79-3ed3-43e3-8da9-2ea101a4cdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:49.414953 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c832a79-3ed3-43e3-8da9-2ea101a4cdd6 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:49.415459 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c832a79-3ed3-43e3-8da9-2ea101a4cdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:49.415976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c832a79-3ed3-43e3-8da9-2ea101a4cdd6 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:49.416994 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c832a79-3ed3-43e3-8da9-2ea101a4cdd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:49.417530 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c832a79-3ed3-43e3-8da9-2ea101a4cdd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:49.419144 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c832a79-3ed3-43e3-8da9-2ea101a4cdd6 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:49.434533 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 315/611] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 00:13:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:49.440300 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb585245-2049-4794-8d6c-2950a8e55d3e None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:49.512187 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:49.550321 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb585245-2049-4794-8d6c-2950a8e55d3e None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:49.588173 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a7110-c657-4633-8b26-6e4c1ffc3ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:49.589370 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a7110-c657-4633-8b26-6e4c1ffc3ffa None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:49.589853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a7110-c657-4633-8b26-6e4c1ffc3ffa None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:49.590323 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a7110-c657-4633-8b26-6e4c1ffc3ffa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:49.602280 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a7110-c657-4633-8b26-6e4c1ffc3ffa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:49.604131 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a7110-c657-4633-8b26-6e4c1ffc3ffa None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:49.623518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-ea6a7110-c657-4633-8b26-6e4c1ffc3ffa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:49.623518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:49.623518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:49.623518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:49.623518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:49.623518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:49.623518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:49.623518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:49.623518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:49.623518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:49.623518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:49.623518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:49.623518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:49.623518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:49.623518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:49.624469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:49.624469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:49.624469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:49.624469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:49.624469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:49.624469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:49.624469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:49.624469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:49.624469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:49.624469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:49.624469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:49.624469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:49.624469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:49.624469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:49.624469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:49.624469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:49.624469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:49.625340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:49.625340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:49.625340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:49.625340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:49.627643 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 297/612] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:49.636803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c832a79-3ed3-43e3-8da9-2ea101a4cdd6 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:49.714421 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:49.780677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c832a79-3ed3-43e3-8da9-2ea101a4cdd6 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:49.821080 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1d209-e341-4bdb-b192-0f1a67205639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:49.822017 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1d209-e341-4bdb-b192-0f1a67205639 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:49.822442 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1d209-e341-4bdb-b192-0f1a67205639 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:49.822875 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc1d209-e341-4bdb-b192-0f1a67205639 None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:49.823773 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1d209-e341-4bdb-b192-0f1a67205639 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:49.824222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1d209-e341-4bdb-b192-0f1a67205639 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:49.825746 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc1d209-e341-4bdb-b192-0f1a67205639 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:49.842880 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 316/613] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:49.846229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a7110-c657-4633-8b26-6e4c1ffc3ffa None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:50.004012 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a7110-c657-4633-8b26-6e4c1ffc3ffa None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:50.034833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:50.053970 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce59a021-c83c-4049-b2d4-7fd175042a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:50.054776 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59a021-c83c-4049-b2d4-7fd175042a5d None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:50.055061 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59a021-c83c-4049-b2d4-7fd175042a5d None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:50.055335 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce59a021-c83c-4049-b2d4-7fd175042a5d None admin] PATH_INFO: `/v3/users/swift` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:50.062734 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59a021-c83c-4049-b2d4-7fd175042a5d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:50.064239 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce59a021-c83c-4049-b2d4-7fd175042a5d None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:50.078849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-ce59a021-c83c-4049-b2d4-7fd175042a5d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:13:50.078849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:50.078849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:50.078849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:50.078849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:50.078849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:50.078849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:50.078849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:50.078849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:50.078849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:50.078849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:50.078849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:50.078849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:13:50.078849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:13:50.078849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:13:50.078849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:13:50.079997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:50.079997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:50.079997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:13:50.079997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:50.079997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:13:50.079997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:50.079997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:50.079997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:50.079997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:50.079997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:50.079997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:50.079997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:50.079997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:50.079997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:50.079997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:50.079997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:50.079997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:50.079997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:50.081252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:50.081252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:50.081252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:13:50.081252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:13:50.081252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:13:50.081252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:13:50.081252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:13:50.081252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:13:50.081252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:13:50.081252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:50.081252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 298/614] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:13:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:50.088310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1d209-e341-4bdb-b192-0f1a67205639 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:50.236371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc1d209-e341-4bdb-b192-0f1a67205639 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:50.237719 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206fc91-819b-4ab0-ac4a-a47a4c63d83f None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:50.238148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206fc91-819b-4ab0-ac4a-a47a4c63d83f None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:50.238499 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d206fc91-819b-4ab0-ac4a-a47a4c63d83f None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:50.240211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 299/615] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:50.245246 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce31708-c475-4861-b9cc-d16492da071c None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:50.245609 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce31708-c475-4861-b9cc-d16492da071c None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:50.245962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce31708-c475-4861-b9cc-d16492da071c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:50.251811 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:50.276681 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-8ce31708-c475-4861-b9cc-d16492da071c None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:50.277808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-8ce31708-c475-4861-b9cc-d16492da071c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:50.281287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150241c6-c924-4861-a4a0-0f2c3c3df9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:50.282172 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150241c6-c924-4861-a4a0-0f2c3c3df9c6 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:50.282656 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150241c6-c924-4861-a4a0-0f2c3c3df9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:50.283082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150241c6-c924-4861-a4a0-0f2c3c3df9c6 None admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:50.284157 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150241c6-c924-4861-a4a0-0f2c3c3df9c6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:50.284648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150241c6-c924-4861-a4a0-0f2c3c3df9c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:50.286759 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150241c6-c924-4861-a4a0-0f2c3c3df9c6 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:50.305956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 317/616] 10.222.0.44 () {56 vars in 1135 bytes} [Thu Jun 16 00:13:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:50.311039 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150241c6-c924-4861-a4a0-0f2c3c3df9c6 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:50.419120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150241c6-c924-4861-a4a0-0f2c3c3df9c6 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:50.470975 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 300/617] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:13:50.473604 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067ac1b-e01d-4ebd-bd0c-4a194faa8624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:50.474578 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067ac1b-e01d-4ebd-bd0c-4a194faa8624 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:50.475015 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067ac1b-e01d-4ebd-bd0c-4a194faa8624 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:50.475466 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2067ac1b-e01d-4ebd-bd0c-4a194faa8624 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:50.486398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067ac1b-e01d-4ebd-bd0c-4a194faa8624 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:50.488161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2067ac1b-e01d-4ebd-bd0c-4a194faa8624 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:50.512789 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce31708-c475-4861-b9cc-d16492da071c None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:50.514290 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-2067ac1b-e01d-4ebd-bd0c-4a194faa8624 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:50.514290 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:50.514290 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:50.514290 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:50.514290 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:50.514290 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:50.514290 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:50.514290 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:50.514290 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:50.514290 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:50.514290 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:50.514290 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:50.514290 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:50.514290 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:50.514290 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:50.515169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:50.515169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:50.515169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:50.515169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:50.515169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:50.515169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:50.515169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:50.515169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:50.515169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:50.515169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:50.515169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:50.515169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:50.515169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:50.515169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:50.515169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:50.515169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:50.515169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:50.516077 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:50.516077 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:50.516077 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:50.516077 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:50.516309 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 318/618] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:13:50.521599 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067ac1b-e01d-4ebd-bd0c-4a194faa8624 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:50.554977 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:50.686313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2067ac1b-e01d-4ebd-bd0c-4a194faa8624 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:50.698042 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce31708-c475-4861-b9cc-d16492da071c None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:50.711928 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:50.748668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46666a6-08e9-46bf-9cbc-215fd22eb542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:50.749340 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46666a6-08e9-46bf-9cbc-215fd22eb542 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:50.749618 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46666a6-08e9-46bf-9cbc-215fd22eb542 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:50.749889 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46666a6-08e9-46bf-9cbc-215fd22eb542 None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:50.750605 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46666a6-08e9-46bf-9cbc-215fd22eb542 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:50.750911 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46666a6-08e9-46bf-9cbc-215fd22eb542 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:50.752294 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46666a6-08e9-46bf-9cbc-215fd22eb542 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:50.759751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c2647-0eed-42f9-8c06-288379d22c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:50.760545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c2647-0eed-42f9-8c06-288379d22c48 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:50.760821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c2647-0eed-42f9-8c06-288379d22c48 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:50.761090 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c2647-0eed-42f9-8c06-288379d22c48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:50.775296 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 319/619] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:50.776554 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46666a6-08e9-46bf-9cbc-215fd22eb542 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:50.789761 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c2647-0eed-42f9-8c06-288379d22c48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:50.799357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-be4c2647-0eed-42f9-8c06-288379d22c48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:50.799357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:50.799357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:50.799357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:50.799357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:50.799357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:50.799357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:50.799357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:50.799357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:50.799357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:50.799357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:50.799357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:50.799357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:50.799357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:50.799357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:50.799357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:50.801018 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:50.801018 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:50.801018 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:50.801018 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:50.801018 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:50.801018 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:50.801018 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:50.801018 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:50.801018 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:50.801018 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:50.801018 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:50.801018 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:50.801018 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:50.801018 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:50.801018 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:50.801018 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:50.802369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:50.802369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:50.802369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:50.802369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:50.802369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:50.802369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:50.802369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:50.802369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:50.802369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:50.802369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:50.802369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:50.802369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:50.803034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 301/620] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 00:13:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:50.808883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c2647-0eed-42f9-8c06-288379d22c48 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:50.920031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:50.960715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46666a6-08e9-46bf-9cbc-215fd22eb542 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:50.985803 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c2647-0eed-42f9-8c06-288379d22c48 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:51.024306 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d9afd-4a13-467b-88a4-8819d1e408b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:51.025130 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d9afd-4a13-467b-88a4-8819d1e408b5 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:51.025410 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d9afd-4a13-467b-88a4-8819d1e408b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:51.025683 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945d9afd-4a13-467b-88a4-8819d1e408b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:51.038241 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d9afd-4a13-467b-88a4-8819d1e408b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:51.039748 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945d9afd-4a13-467b-88a4-8819d1e408b5 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:51.056373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-945d9afd-4a13-467b-88a4-8819d1e408b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:51.056373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:51.056373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:51.056373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:51.056373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:51.056373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:51.056373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:51.056373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:51.056373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:51.056373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:51.056373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:51.056373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:51.056373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:13:51.056373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:13:51.056373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:13:51.057332 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:13:51.057332 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:51.057332 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:51.057332 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:51.057332 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:51.057332 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:51.057332 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:51.057332 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:51.057332 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:51.057332 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:51.057332 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:51.057332 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:51.057332 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:51.057332 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:51.057332 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:51.057332 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:51.057332 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:51.058213 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:13:51.058213 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:13:51.058213 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:13:51.058213 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:13:51.058213 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:13:51.058213 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:13:51.058213 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:51.058213 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:51.062437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 320/621] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:13:51.063554 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d9afd-4a13-467b-88a4-8819d1e408b5 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:51.072379 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3121b125-30c0-4b81-856b-c4a290c97546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:51.073078 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121b125-30c0-4b81-856b-c4a290c97546 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:51.073364 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121b125-30c0-4b81-856b-c4a290c97546 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:51.073645 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3121b125-30c0-4b81-856b-c4a290c97546 None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:51.074405 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121b125-30c0-4b81-856b-c4a290c97546 None admin] RBAC: Adding query filter params (name=service) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:51.074716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121b125-30c0-4b81-856b-c4a290c97546 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:51.076146 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3121b125-30c0-4b81-856b-c4a290c97546 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:51.098090 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 302/622] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 00:13:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:51.099462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18bd78-3d6e-4e20-b43d-450f01ec554a None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:51.103872 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18bd78-3d6e-4e20-b43d-450f01ec554a None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:51.104193 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18bd78-3d6e-4e20-b43d-450f01ec554a None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:51.105682 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 303/623] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:51 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:51.106269 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18bd78-3d6e-4e20-b43d-450f01ec554a None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:51.160553 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:51.187741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945d9afd-4a13-467b-88a4-8819d1e408b5 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:51.216524 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18bd78-3d6e-4e20-b43d-450f01ec554a None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:51.227096 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47fde9-07d5-4a36-a57a-9f7145bbe5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:51.228249 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47fde9-07d5-4a36-a57a-9f7145bbe5e4 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:51.228361 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47fde9-07d5-4a36-a57a-9f7145bbe5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:51.228641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47fde9-07d5-4a36-a57a-9f7145bbe5e4 None admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:51.229491 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47fde9-07d5-4a36-a57a-9f7145bbe5e4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:51.229835 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47fde9-07d5-4a36-a57a-9f7145bbe5e4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:51.231300 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47fde9-07d5-4a36-a57a-9f7145bbe5e4 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:51.234122 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:51.250316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 321/624] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:13:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:51.250316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ae92d-ea52-4bc6-82fe-5c11d7aa7494 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:51.250316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ae92d-ea52-4bc6-82fe-5c11d7aa7494 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:51.250316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20ae92d-ea52-4bc6-82fe-5c11d7aa7494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:51.261529 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece03e80-d481-46c1-a16d-f74dfd89c262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:51.262525 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece03e80-d481-46c1-a16d-f74dfd89c262 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:51.262951 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece03e80-d481-46c1-a16d-f74dfd89c262 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:51.263385 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece03e80-d481-46c1-a16d-f74dfd89c262 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:51.267971 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-a20ae92d-ea52-4bc6-82fe-5c11d7aa7494 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:51.269399 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-a20ae92d-ea52-4bc6-82fe-5c11d7aa7494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:51.274835 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece03e80-d481-46c1-a16d-f74dfd89c262 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:51.276475 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece03e80-d481-46c1-a16d-f74dfd89c262 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:51.294564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-ece03e80-d481-46c1-a16d-f74dfd89c262 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:51.294564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:51.294564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:51.294564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:51.294564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:51.294564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:51.294564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:51.294564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:51.294564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:51.294564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:51.294564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:51.294564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:51.294564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:51.294564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:51.294564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:51.295664 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:51.295664 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:51.295664 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:51.295664 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:51.295664 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:51.295664 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:51.295664 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:51.295664 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:51.295664 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:51.295664 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:51.295664 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:51.295664 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:51.295664 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:51.295664 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:51.295664 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:51.295664 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:51.295664 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:51.296561 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:51.296561 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:51.296561 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:51.296561 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:51.303398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 304/625] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:51.303398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece03e80-d481-46c1-a16d-f74dfd89c262 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:51.347802 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 322/626] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:51.348645 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ae92d-ea52-4bc6-82fe-5c11d7aa7494 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:51.408137 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:51.423904 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece03e80-d481-46c1-a16d-f74dfd89c262 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:51.459638 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9f1b0-ad4d-45dd-aa29-5bf009a8b1ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:51.460877 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9f1b0-ad4d-45dd-aa29-5bf009a8b1ec None admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:51.461348 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9f1b0-ad4d-45dd-aa29-5bf009a8b1ec None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:51.461794 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9f1b0-ad4d-45dd-aa29-5bf009a8b1ec None admin] PATH_INFO: `/v3/projects/320d79ecbc2342af8031103e7308c10d/users/9918c4a8c6a64812b61fc235ab8e7bec/roles/338a913607974d379aad3249b3d0402d` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:51.477465 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9f1b0-ad4d-45dd-aa29-5bf009a8b1ec None admin] RBAC: Authorizing `identity:create_grant(project_id=320d79ecbc2342af8031103e7308c10d, user_id=9918c4a8c6a64812b61fc235ab8e7bec, role_id=338a913607974d379aad3249b3d0402d)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:51.479662 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e9f1b0-ad4d-45dd-aa29-5bf009a8b1ec None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:51.484038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20ae92d-ea52-4bc6-82fe-5c11d7aa7494 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:51.494117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 305/627] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 00:13:51 2022] PUT /identity/v3/projects/320d79ecbc2342af8031103e7308c10d/users/9918c4a8c6a64812b61fc235ab8e7bec/roles/338a913607974d379aad3249b3d0402d => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:13:51.495323 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9f1b0-ad4d-45dd-aa29-5bf009a8b1ec None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:51.547578 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:51.568347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190971f-11c9-4e5d-b8cb-419687272347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:51.570334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190971f-11c9-4e5d-b8cb-419687272347 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:51.572556 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190971f-11c9-4e5d-b8cb-419687272347 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:51.573055 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190971f-11c9-4e5d-b8cb-419687272347 None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:51.574004 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190971f-11c9-4e5d-b8cb-419687272347 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:51.574780 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190971f-11c9-4e5d-b8cb-419687272347 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:51.576978 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190971f-11c9-4e5d-b8cb-419687272347 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:51.614718 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 323/628] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:51.628038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190971f-11c9-4e5d-b8cb-419687272347 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:51.706285 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9f1b0-ad4d-45dd-aa29-5bf009a8b1ec None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:51.756351 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279b1b51-f564-4358-9b55-524ef03b7b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:51.758210 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b1b51-f564-4358-9b55-524ef03b7b90 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:51.758720 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b1b51-f564-4358-9b55-524ef03b7b90 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:51.759283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279b1b51-f564-4358-9b55-524ef03b7b90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:51.759823 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190971f-11c9-4e5d-b8cb-419687272347 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:51.761876 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:51.776087 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279b1b51-f564-4358-9b55-524ef03b7b90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:51.790257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-279b1b51-f564-4358-9b55-524ef03b7b90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:51.790257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:51.790257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:51.790257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:51.790257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:51.790257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:51.790257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:51.790257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:51.790257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:51.790257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:51.790257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:51.790257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:51.790257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:51.790257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:51.790257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:51.790257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:51.791299 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:51.791299 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:51.791299 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:51.791299 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:51.791299 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:51.791299 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:51.791299 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:51.791299 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:51.791299 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:51.791299 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:51.791299 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:51.791299 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:51.791299 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:51.791299 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:51.791299 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:51.791299 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:51.792314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:51.792314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:51.792314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:51.792314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:51.792314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:51.792314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:51.792314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:51.792314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:51.792314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:51.792314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:51.792314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:51.792314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:51.794153 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 306/629] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 00:13:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:51.797750 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65ffc1-3aa9-4e44-985d-0be66f5e0c42 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:51.797750 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65ffc1-3aa9-4e44-985d-0be66f5e0c42 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:51.797750 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c65ffc1-3aa9-4e44-985d-0be66f5e0c42 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:51.797750 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 307/630] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:51.807210 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65ffc1-3aa9-4e44-985d-0be66f5e0c42 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:51.816070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265900e8-9361-4c70-ac09-334b9fb6841a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:51.816894 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265900e8-9361-4c70-ac09-334b9fb6841a None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:51.817187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265900e8-9361-4c70-ac09-334b9fb6841a None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:51.817469 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265900e8-9361-4c70-ac09-334b9fb6841a None admin] PATH_INFO: `/v3/users/nova` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:51.827364 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265900e8-9361-4c70-ac09-334b9fb6841a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:51.829579 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265900e8-9361-4c70-ac09-334b9fb6841a None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:51.848424 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-265900e8-9361-4c70-ac09-334b9fb6841a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:13:51.848424 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:51.848424 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:51.848424 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:51.848424 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:51.848424 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:51.848424 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:51.848424 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:51.848424 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:51.848424 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:51.848424 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:51.848424 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:51.848424 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:13:51.848424 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:13:51.848424 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:13:51.848424 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:13:51.849407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:51.849407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:51.849407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:13:51.849407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:51.849407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:13:51.849407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:51.849407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:51.849407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:51.849407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:51.849407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:51.849407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:51.849407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:51.849407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:51.849407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:51.849407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:51.849407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:51.849407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:51.849407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:51.850380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:51.850380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:51.850380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:13:51.850380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:13:51.850380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:13:51.850380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:13:51.850380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:13:51.850380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:13:51.850380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:13:51.850380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:51.850380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 324/631] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 16 00:13:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:51.851471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c34f8-cd19-4580-922f-f353fc3cdde7 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:51.851577 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c34f8-cd19-4580-922f-f353fc3cdde7 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:51.851825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21c34f8-cd19-4580-922f-f353fc3cdde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:51.872792 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-c21c34f8-cd19-4580-922f-f353fc3cdde7 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:51.874210 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-c21c34f8-cd19-4580-922f-f353fc3cdde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:51.933640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:51.950419 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c65ffc1-3aa9-4e44-985d-0be66f5e0c42 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:51.966229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 325/632] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:51.967430 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c34f8-cd19-4580-922f-f353fc3cdde7 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:51.994454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad2c48-0b12-44c5-acfe-4338171819a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:51.995400 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad2c48-0b12-44c5-acfe-4338171819a4 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:51.995715 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad2c48-0b12-44c5-acfe-4338171819a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:51.995999 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad2c48-0b12-44c5-acfe-4338171819a4 None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:51.996746 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad2c48-0b12-44c5-acfe-4338171819a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:51.997057 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad2c48-0b12-44c5-acfe-4338171819a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:51.998565 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad2c48-0b12-44c5-acfe-4338171819a4 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:52.007913 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 308/633] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 00:13:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:52.008993 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713960e-ae2c-499b-834e-63f7522ad7f9 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:52.009284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713960e-ae2c-499b-834e-63f7522ad7f9 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:52.009562 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b713960e-ae2c-499b-834e-63f7522ad7f9 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:52.010890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 309/634] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:52.014912 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713960e-ae2c-499b-834e-63f7522ad7f9 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:52.074546 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:52.085243 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21c34f8-cd19-4580-922f-f353fc3cdde7 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:52.123542 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b8fcb-e774-4d4f-922d-d1f6e5415087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:52.124177 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b8fcb-e774-4d4f-922d-d1f6e5415087 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:52.124467 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b8fcb-e774-4d4f-922d-d1f6e5415087 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:52.124750 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21b8fcb-e774-4d4f-922d-d1f6e5415087 None admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:52.125569 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b713960e-ae2c-499b-834e-63f7522ad7f9 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:52.125690 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b8fcb-e774-4d4f-922d-d1f6e5415087 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:52.125901 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b8fcb-e774-4d4f-922d-d1f6e5415087 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:52.127343 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21b8fcb-e774-4d4f-922d-d1f6e5415087 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:52.149807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 326/635] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 16 00:13:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:52.149807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b8fcb-e774-4d4f-922d-d1f6e5415087 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:52.162109 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d055f1b-d819-4154-8b1d-f922b89f0d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:52.162900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d055f1b-d819-4154-8b1d-f922b89f0d9b None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:52.163175 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d055f1b-d819-4154-8b1d-f922b89f0d9b None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:52.163453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d055f1b-d819-4154-8b1d-f922b89f0d9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:52.174259 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d055f1b-d819-4154-8b1d-f922b89f0d9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:52.183149 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:52.183270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-7d055f1b-d819-4154-8b1d-f922b89f0d9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:52.183270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:52.183270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:52.183270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:52.183270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:52.183270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:52.183270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:52.183270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:52.183270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:52.183270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:52.183270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:52.183270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:52.183270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:52.183270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:52.183270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:52.183270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:52.184336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:52.184336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:52.184336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:52.184336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:52.184336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:52.184336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:52.184336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:52.184336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:52.184336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:52.184336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:52.184336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:52.184336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:52.184336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:52.184336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:52.184336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:52.184336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:52.185446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:52.185446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:52.185446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:52.185446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:52.185446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:52.185446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:52.185446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:52.185446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:52.185446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:52.185446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:52.185446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:52.185446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:52.185446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 310/636] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 00:13:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:52.186555 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fe36a-8ba8-4319-8b0c-9e8d8ca5ade1 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:52.186555 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fe36a-8ba8-4319-8b0c-9e8d8ca5ade1 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:52.186822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96fe36a-8ba8-4319-8b0c-9e8d8ca5ade1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:52.204579 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-e96fe36a-8ba8-4319-8b0c-9e8d8ca5ade1 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:52.205870 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e96fe36a-8ba8-4319-8b0c-9e8d8ca5ade1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:52.256719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21b8fcb-e774-4d4f-922d-d1f6e5415087 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:52.278006 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 311/637] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:52.278735 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fe36a-8ba8-4319-8b0c-9e8d8ca5ade1 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:52.294066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ae29a-0cf7-4cf1-9291-9b8bb7e84007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:52.295289 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ae29a-0cf7-4cf1-9291-9b8bb7e84007 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:52.295798 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ae29a-0cf7-4cf1-9291-9b8bb7e84007 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:52.296295 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ae29a-0cf7-4cf1-9291-9b8bb7e84007 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:52.307818 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ae29a-0cf7-4cf1-9291-9b8bb7e84007 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:52.309901 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ae29a-0cf7-4cf1-9291-9b8bb7e84007 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:52.327763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-033ae29a-0cf7-4cf1-9291-9b8bb7e84007 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:52.327763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:52.327763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:52.327763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:52.327763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:52.327763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:52.327763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:52.327763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:52.327763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:52.327763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:52.327763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:52.327763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:52.327763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:52.327763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:52.327763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:52.328784 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:52.328784 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:52.328784 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:52.328784 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:52.328784 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:52.328784 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:52.328784 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:52.328784 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:52.328784 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:52.328784 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:52.328784 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:52.328784 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:52.328784 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:52.328784 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:52.328784 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:52.328784 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:52.328784 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:52.329676 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:52.329676 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:52.329676 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:52.329676 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:52.329676 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 327/638] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:52.329969 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ae29a-0cf7-4cf1-9291-9b8bb7e84007 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:52.330506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:52.389672 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96fe36a-8ba8-4319-8b0c-9e8d8ca5ade1 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:52.423006 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071b358-89e7-4b0e-a89a-254287f13b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:52.423672 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071b358-89e7-4b0e-a89a-254287f13b9d None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:52.423956 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071b358-89e7-4b0e-a89a-254287f13b9d None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:52.424323 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e071b358-89e7-4b0e-a89a-254287f13b9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:52.424807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:52.442034 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ae29a-0cf7-4cf1-9291-9b8bb7e84007 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:52.478583 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b14c4-3032-493f-8f8e-e03d8f5c6361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:52.479248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b14c4-3032-493f-8f8e-e03d8f5c6361 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:52.479531 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b14c4-3032-493f-8f8e-e03d8f5c6361 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:52.479831 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193b14c4-3032-493f-8f8e-e03d8f5c6361 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:52.480569 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b14c4-3032-493f-8f8e-e03d8f5c6361 None admin] RBAC: Adding query filter params (name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:52.481100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b14c4-3032-493f-8f8e-e03d8f5c6361 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:52.482234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193b14c4-3032-493f-8f8e-e03d8f5c6361 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:52.494686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 328/639] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 00:13:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:52.494686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b14c4-3032-493f-8f8e-e03d8f5c6361 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:52.499089 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071b358-89e7-4b0e-a89a-254287f13b9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:52.500572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e071b358-89e7-4b0e-a89a-254287f13b9d None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:52.546813 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:52.601878 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193b14c4-3032-493f-8f8e-e03d8f5c6361 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:52.608131 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 312/640] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:13:52.608131 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071b358-89e7-4b0e-a89a-254287f13b9d None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:52.651679 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb9772-a762-4d61-a9f9-ec714eef740b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:52.652417 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb9772-a762-4d61-a9f9-ec714eef740b None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:52.652749 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb9772-a762-4d61-a9f9-ec714eef740b None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:52.653042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb9772-a762-4d61-a9f9-ec714eef740b None admin] PATH_INFO: `/v3/roles/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:52.663863 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb9772-a762-4d61-a9f9-ec714eef740b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:52.672153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-7dfb9772-a762-4d61-a9f9-ec714eef740b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:52.672153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:52.672153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:52.672153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:52.672153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:52.672153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:52.672153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:52.672153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:52.672153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:52.672153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:52.672153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:52.672153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:52.672153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:52.672153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:52.672153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:52.672153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:52.673070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:52.673070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:52.673070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:52.673070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:52.673070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:52.673070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:52.673070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:52.673070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:52.673070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:52.673070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:52.673070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:52.673070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:52.673070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:52.673070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:52.673070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:52.673070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:52.673890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:52.673890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:52.673890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:52.673890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:52.673890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:52.673890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:52.673890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:52.673890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:52.673890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:52.673890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:52.673890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:52.673890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:52.678158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 329/641] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 00:13:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:52.679011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb9772-a762-4d61-a9f9-ec714eef740b None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:52.690010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:52.716468 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e071b358-89e7-4b0e-a89a-254287f13b9d None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:52.753215 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08cec6-e514-481f-97ec-c0da88a4e2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:52.754778 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08cec6-e514-481f-97ec-c0da88a4e2e2 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:52.755263 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08cec6-e514-481f-97ec-c0da88a4e2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:52.755986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08cec6-e514-481f-97ec-c0da88a4e2e2 None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:52.756872 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08cec6-e514-481f-97ec-c0da88a4e2e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:52.757353 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08cec6-e514-481f-97ec-c0da88a4e2e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:52.758941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08cec6-e514-481f-97ec-c0da88a4e2e2 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:52.771918 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 313/642] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:52.772977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08cec6-e514-481f-97ec-c0da88a4e2e2 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:52.782894 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:52.795901 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb9772-a762-4d61-a9f9-ec714eef740b None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:52.834066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fccad-eaa4-4330-892d-637d5082708c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:52.834860 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fccad-eaa4-4330-892d-637d5082708c None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:52.835140 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fccad-eaa4-4330-892d-637d5082708c None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:52.835414 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5fccad-eaa4-4330-892d-637d5082708c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:52.845837 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fccad-eaa4-4330-892d-637d5082708c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:52.847298 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5fccad-eaa4-4330-892d-637d5082708c None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:52.864423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-cd5fccad-eaa4-4330-892d-637d5082708c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:52.864423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:52.864423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:52.864423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:52.864423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:52.864423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:52.864423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:52.864423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:52.864423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:52.864423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:52.864423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:52.864423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:52.864423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:52.864423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:52.864423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:52.865580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:52.865580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:52.865580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:52.865580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:52.865580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:52.865580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:52.865580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:52.865580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:52.865580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:52.865580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:52.865580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:52.865580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:52.865580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:52.865580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:52.865580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:52.865580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:52.865580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:52.866517 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:52.866517 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:52.866517 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:52.866517 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:52.866517 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 330/643] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:52.866809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fccad-eaa4-4330-892d-637d5082708c None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:52.892327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08cec6-e514-481f-97ec-c0da88a4e2e2 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:52.924667 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cde306-40b7-4f9a-beb6-d5c626d4bd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:52.925405 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cde306-40b7-4f9a-beb6-d5c626d4bd2a None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:52.926193 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cde306-40b7-4f9a-beb6-d5c626d4bd2a None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:52.926466 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cde306-40b7-4f9a-beb6-d5c626d4bd2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:52.934073 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:52.938468 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cde306-40b7-4f9a-beb6-d5c626d4bd2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:52.939940 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cde306-40b7-4f9a-beb6-d5c626d4bd2a None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:52.956446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-31cde306-40b7-4f9a-beb6-d5c626d4bd2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:52.956446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:52.956446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:52.956446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:52.956446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:52.956446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:52.956446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:52.956446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:52.956446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:52.956446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:52.956446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:52.956446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:52.956446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:52.956446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:52.956446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:52.958072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:52.958072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:52.958072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:52.958072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:52.958072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:52.958072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:52.958072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:52.958072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:52.958072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:52.958072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:52.958072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:52.958072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:52.958072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:52.958072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:52.958072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:52.958072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:52.958072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:52.959062 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:52.959062 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:52.959062 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:52.959062 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:52.959062 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 314/644] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:52.959428 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cde306-40b7-4f9a-beb6-d5c626d4bd2a None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:52.986964 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5fccad-eaa4-4330-892d-637d5082708c None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:53.019873 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:53.023780 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974b6b2-480a-4129-ad4a-d8eea70e1240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:53.024457 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974b6b2-480a-4129-ad4a-d8eea70e1240 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:53.024748 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974b6b2-480a-4129-ad4a-d8eea70e1240 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:53.025031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c974b6b2-480a-4129-ad4a-d8eea70e1240 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:53.025783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974b6b2-480a-4129-ad4a-d8eea70e1240 None admin] RBAC: Adding query filter params (name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:53.026096 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974b6b2-480a-4129-ad4a-d8eea70e1240 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:53.027464 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c974b6b2-480a-4129-ad4a-d8eea70e1240 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:53.036585 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 331/645] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 00:13:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:53.037384 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974b6b2-480a-4129-ad4a-d8eea70e1240 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:53.069327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cde306-40b7-4f9a-beb6-d5c626d4bd2a None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:53.106451 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04788051-b984-43c4-a660-526700434e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:53.107247 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04788051-b984-43c4-a660-526700434e3e None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:53.107529 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04788051-b984-43c4-a660-526700434e3e None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:53.108238 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04788051-b984-43c4-a660-526700434e3e None admin] PATH_INFO: `/v3/users/glance` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:53.116820 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04788051-b984-43c4-a660-526700434e3e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:53.118702 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04788051-b984-43c4-a660-526700434e3e None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:53.134495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-04788051-b984-43c4-a660-526700434e3e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 16 00:13:53.134495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:53.134495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:53.134495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:53.134495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:53.134495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:53.134495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:53.134495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:53.134495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:53.134495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:53.134495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:53.134495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:53.134495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:13:53.134495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:13:53.134495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:13:53.134495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:13:53.135480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:53.135480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:53.135480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:13:53.135480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:53.135480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:13:53.135480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:53.135480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:53.135480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:53.135480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:53.135480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:53.135480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:53.135480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:53.135480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:53.135480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:53.135480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:53.135480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:53.135480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:53.135480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:53.136518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:53.136518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:53.136518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:13:53.136518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:13:53.136518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:13:53.136518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:13:53.136518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:13:53.136518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:13:53.136518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 16 00:13:53.136518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:53.136518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 315/646] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:52 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:53.137131 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04788051-b984-43c4-a660-526700434e3e None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:53.148235 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c974b6b2-480a-4129-ad4a-d8eea70e1240 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:53.174753 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:53.188113 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af99ee1-7b5d-4117-a5ac-fc0e686d1a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:53.188890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af99ee1-7b5d-4117-a5ac-fc0e686d1a3b None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:53.189171 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af99ee1-7b5d-4117-a5ac-fc0e686d1a3b None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:53.189447 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af99ee1-7b5d-4117-a5ac-fc0e686d1a3b None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:53.190171 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af99ee1-7b5d-4117-a5ac-fc0e686d1a3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:53.190477 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af99ee1-7b5d-4117-a5ac-fc0e686d1a3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:53.192529 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af99ee1-7b5d-4117-a5ac-fc0e686d1a3b None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:53.205120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 332/647] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:53.205918 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af99ee1-7b5d-4117-a5ac-fc0e686d1a3b None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:53.251891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04788051-b984-43c4-a660-526700434e3e None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:53.268994 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:53.286947 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5a2dd-7217-4b47-82f4-aa2433e4386e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:53.287627 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5a2dd-7217-4b47-82f4-aa2433e4386e None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:53.287913 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5a2dd-7217-4b47-82f4-aa2433e4386e None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:53.288188 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c5a2dd-7217-4b47-82f4-aa2433e4386e None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:53.288903 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5a2dd-7217-4b47-82f4-aa2433e4386e None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:53.289212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5a2dd-7217-4b47-82f4-aa2433e4386e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:53.290577 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c5a2dd-7217-4b47-82f4-aa2433e4386e None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:53.303758 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 316/648] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:53.304704 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5a2dd-7217-4b47-82f4-aa2433e4386e None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:53.320971 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af99ee1-7b5d-4117-a5ac-fc0e686d1a3b None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:53.357585 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f05ea-6b17-4926-be2b-bd93db4370c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:53.358391 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f05ea-6b17-4926-be2b-bd93db4370c4 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:53.358676 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f05ea-6b17-4926-be2b-bd93db4370c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:53.358955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f05ea-6b17-4926-be2b-bd93db4370c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:53.370081 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f05ea-6b17-4926-be2b-bd93db4370c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:53.371526 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f05ea-6b17-4926-be2b-bd93db4370c4 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:53.390841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-d10f05ea-6b17-4926-be2b-bd93db4370c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:53.390841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:53.390841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:53.390841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:53.390841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:53.390841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:53.390841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:53.390841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:53.390841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:53.390841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:53.390841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:53.390841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:53.390841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:53.390841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:53.390841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:53.391972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:53.391972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:53.391972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:53.391972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:53.391972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:53.391972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:53.391972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:53.391972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:53.391972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:53.391972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:53.391972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:53.391972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:53.391972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:53.391972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:53.391972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:53.391972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:53.391972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:53.393166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:53.393166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:53.393166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:53.393166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:53.396651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 333/649] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:53.397340 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f05ea-6b17-4926-be2b-bd93db4370c4 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:53.412970 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c5a2dd-7217-4b47-82f4-aa2433e4386e None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:53.432734 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:53.449381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c256bb-8a73-4fd9-9c9b-bebe970a5fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:53.450058 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c256bb-8a73-4fd9-9c9b-bebe970a5fed None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:53.450346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c256bb-8a73-4fd9-9c9b-bebe970a5fed None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:53.450612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c256bb-8a73-4fd9-9c9b-bebe970a5fed None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:53.451444 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c256bb-8a73-4fd9-9c9b-bebe970a5fed None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:53.451785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c256bb-8a73-4fd9-9c9b-bebe970a5fed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:53.453218 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c256bb-8a73-4fd9-9c9b-bebe970a5fed None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:53.476635 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 317/650] 10.222.0.44 () {56 vars in 1137 bytes} [Thu Jun 16 00:13:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:53.476635 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c256bb-8a73-4fd9-9c9b-bebe970a5fed None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:53.501607 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f05ea-6b17-4926-be2b-bd93db4370c4 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:53.511684 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:53.537423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ffdbd-4536-40ee-b960-e1d4416bb1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:53.538229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ffdbd-4536-40ee-b960-e1d4416bb1c9 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:53.538520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ffdbd-4536-40ee-b960-e1d4416bb1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:53.538801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842ffdbd-4536-40ee-b960-e1d4416bb1c9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:53.546152 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ffdbd-4536-40ee-b960-e1d4416bb1c9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:53.547593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842ffdbd-4536-40ee-b960-e1d4416bb1c9 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:53.562648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-842ffdbd-4536-40ee-b960-e1d4416bb1c9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:13:53.562648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:53.562648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:53.562648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:53.562648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:53.562648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:53.562648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:53.562648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:53.562648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:53.562648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:53.562648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:53.562648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:53.562648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:13:53.562648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:13:53.562648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:13:53.562648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:13:53.563672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:53.563672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:53.563672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:13:53.563672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:53.563672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:13:53.563672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:53.563672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:53.563672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:53.563672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:53.563672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:53.563672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:53.563672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:53.563672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:53.563672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:53.563672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:53.563672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:53.563672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:53.563672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:53.564643 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:53.564643 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:53.564643 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:13:53.564643 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:13:53.564643 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:13:53.564643 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:13:53.564643 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:13:53.564643 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:13:53.564643 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:13:53.564643 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:53.564643 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 334/651] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:53.565930 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ffdbd-4536-40ee-b960-e1d4416bb1c9 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:53.586578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c256bb-8a73-4fd9-9c9b-bebe970a5fed None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:53.627224 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5ffa5-9c68-434b-b256-9a118b1e4de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:53.628070 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5ffa5-9c68-434b-b256-9a118b1e4de5 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:53.628354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5ffa5-9c68-434b-b256-9a118b1e4de5 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:53.628668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5ffa5-9c68-434b-b256-9a118b1e4de5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:53.636870 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5ffa5-9c68-434b-b256-9a118b1e4de5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:53.638339 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5ffa5-9c68-434b-b256-9a118b1e4de5 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:53.652857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-a1e5ffa5-9c68-434b-b256-9a118b1e4de5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:53.652857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:53.652857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:53.652857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:53.652857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:53.652857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:53.652857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:53.652857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:53.652857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:53.652857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:53.652857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:53.652857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:53.652857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:13:53.652857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:13:53.652857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:13:53.653774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:13:53.653774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:53.653774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:53.653774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:53.653774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:53.653774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:53.653774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:53.653774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:53.653774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:53.653774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:53.653774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:53.653774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:53.653774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:53.653774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:53.653774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:53.653774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:53.653774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:53.654726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:13:53.654726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:13:53.654726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:13:53.654726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:13:53.654726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:13:53.654726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:13:53.654726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:53.654726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:53.654726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 318/652] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:53.655896 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5ffa5-9c68-434b-b256-9a118b1e4de5 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:53.669893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:53.678658 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842ffdbd-4536-40ee-b960-e1d4416bb1c9 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:53.712079 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f672146-430c-45d9-aa39-b2cd07f3b061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:53.712736 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f672146-430c-45d9-aa39-b2cd07f3b061 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:53.713018 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f672146-430c-45d9-aa39-b2cd07f3b061 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:53.713295 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f672146-430c-45d9-aa39-b2cd07f3b061 None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:53.714018 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f672146-430c-45d9-aa39-b2cd07f3b061 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:53.714325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f672146-430c-45d9-aa39-b2cd07f3b061 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:53.715703 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f672146-430c-45d9-aa39-b2cd07f3b061 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:53.727173 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 335/653] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:53.727979 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f672146-430c-45d9-aa39-b2cd07f3b061 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:53.751117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:53.758389 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5ffa5-9c68-434b-b256-9a118b1e4de5 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:53.793194 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab0b582-a09d-4039-ba57-0b2ff4655e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:53.793846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0b582-a09d-4039-ba57-0b2ff4655e18 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:53.794129 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0b582-a09d-4039-ba57-0b2ff4655e18 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:53.794406 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab0b582-a09d-4039-ba57-0b2ff4655e18 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:53.831357 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f672146-430c-45d9-aa39-b2cd07f3b061 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:53.861765 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0b582-a09d-4039-ba57-0b2ff4655e18 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:53.863245 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab0b582-a09d-4039-ba57-0b2ff4655e18 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:53.864685 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fda27-2d31-4dd7-a0b9-d919f772bb1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:53.865356 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fda27-2d31-4dd7-a0b9-d919f772bb1d None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:53.865642 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fda27-2d31-4dd7-a0b9-d919f772bb1d None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:53.865926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277fda27-2d31-4dd7-a0b9-d919f772bb1d None admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:53.866757 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277fda27-2d31-4dd7-a0b9-d919f772bb1d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:53.867071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277fda27-2d31-4dd7-a0b9-d919f772bb1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:53.868514 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277fda27-2d31-4dd7-a0b9-d919f772bb1d None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:53.885337 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 336/654] 10.222.0.44 () {56 vars in 1137 bytes} [Thu Jun 16 00:13:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:53.886128 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fda27-2d31-4dd7-a0b9-d919f772bb1d None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:53.900217 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:53.958346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:53.965460 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 319/655] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:13:53.966750 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16c1ff-de8c-42fb-bf25-a3443524641c None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:53.967066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16c1ff-de8c-42fb-bf25-a3443524641c None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:53.967315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16c1ff-de8c-42fb-bf25-a3443524641c None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:53.971646 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 320/656] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:53.971646 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16c1ff-de8c-42fb-bf25-a3443524641c None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:53.988779 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277fda27-2d31-4dd7-a0b9-d919f772bb1d None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:54.022955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeeb112-844a-4065-8a11-3f66b4e41cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:54.023628 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeeb112-844a-4065-8a11-3f66b4e41cf8 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:54.023921 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeeb112-844a-4065-8a11-3f66b4e41cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:54.024194 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aeeb112-844a-4065-8a11-3f66b4e41cf8 None admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:54.024969 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeeb112-844a-4065-8a11-3f66b4e41cf8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:54.025278 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeeb112-844a-4065-8a11-3f66b4e41cf8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:54.026696 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aeeb112-844a-4065-8a11-3f66b4e41cf8 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:54.037865 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 337/657] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:13:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:54.038661 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeeb112-844a-4065-8a11-3f66b4e41cf8 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:54.069274 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16c1ff-de8c-42fb-bf25-a3443524641c None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:54.104123 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043ee67-33ef-463d-864d-df619a4c7284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:54.104927 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043ee67-33ef-463d-864d-df619a4c7284 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:54.105210 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043ee67-33ef-463d-864d-df619a4c7284 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:54.105483 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043ee67-33ef-463d-864d-df619a4c7284 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:54.106285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:54.112767 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043ee67-33ef-463d-864d-df619a4c7284 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:54.114241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043ee67-33ef-463d-864d-df619a4c7284 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:54.128982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-2043ee67-33ef-463d-864d-df619a4c7284 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 00:13:54.128982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:54.128982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:54.128982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:54.128982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:54.128982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:54.128982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:54.128982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:54.128982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:54.128982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:54.128982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:54.128982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:54.128982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:13:54.128982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:13:54.128982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:13:54.128982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:13:54.130026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:54.130026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:54.130026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:13:54.130026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:54.130026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:13:54.130026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:54.130026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:54.130026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:54.130026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:54.130026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:54.130026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:54.130026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:54.130026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:54.130026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:54.130026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:54.130026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:54.130026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:54.130026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:54.131226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:54.131226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:54.131226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:13:54.131226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:13:54.131226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:13:54.131226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:13:54.131226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:13:54.131226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:13:54.131226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 16 00:13:54.131226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:54.131226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 321/658] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 00:13:53 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:54.131226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043ee67-33ef-463d-864d-df619a4c7284 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:54.140977 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aeeb112-844a-4065-8a11-3f66b4e41cf8 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:54.173822 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26d699-a923-4e49-a299-df3bf6769d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:54.174470 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26d699-a923-4e49-a299-df3bf6769d3c None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:54.174761 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26d699-a923-4e49-a299-df3bf6769d3c None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:54.175039 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26d699-a923-4e49-a299-df3bf6769d3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:54.184897 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:54.228664 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043ee67-33ef-463d-864d-df619a4c7284 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:54.241475 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26d699-a923-4e49-a299-df3bf6769d3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:54.242940 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26d699-a923-4e49-a299-df3bf6769d3c None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:54.261554 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293c375b-ba97-475c-a424-195f3ad6a1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:54.262335 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c375b-ba97-475c-a424-195f3ad6a1e6 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:54.262618 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c375b-ba97-475c-a424-195f3ad6a1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:54.262895 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293c375b-ba97-475c-a424-195f3ad6a1e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:54.273221 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c375b-ba97-475c-a424-195f3ad6a1e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:54.274648 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293c375b-ba97-475c-a424-195f3ad6a1e6 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:54.292290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-293c375b-ba97-475c-a424-195f3ad6a1e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:54.292290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:54.292290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:54.292290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:54.292290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:54.292290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:54.292290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:54.292290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:54.292290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:54.292290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:54.292290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:54.292290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:54.292290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:54.292290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:54.292290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:54.293214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:54.293214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:54.293214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:54.293214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:54.293214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:54.293214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:54.293214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:54.293214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:54.293214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:54.293214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:54.293214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:54.293214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:54.293214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:54.293214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:54.293214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:54.293214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:54.293214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:54.294098 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:54.294098 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:54.294098 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:54.294098 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:54.294098 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 322/659] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:54.294663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2cc87-e2fd-4d58-bbc5-3c6236e86bb4 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:54.294932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2cc87-e2fd-4d58-bbc5-3c6236e86bb4 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:54.295156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2cc87-e2fd-4d58-bbc5-3c6236e86bb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:54.311540 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-a8f2cc87-e2fd-4d58-bbc5-3c6236e86bb4 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:54.312751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a8f2cc87-e2fd-4d58-bbc5-3c6236e86bb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:54.314347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:54.345307 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 338/660] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:13:54.346136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26d699-a923-4e49-a299-df3bf6769d3c None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:54.377932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 323/661] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:54.378809 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2cc87-e2fd-4d58-bbc5-3c6236e86bb4 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:54.430294 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:54.444318 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26d699-a923-4e49-a299-df3bf6769d3c None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:54.478053 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9f805-49d2-4973-b39f-557ec4f12c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:54.478767 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9f805-49d2-4973-b39f-557ec4f12c0c None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:54.479006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9f805-49d2-4973-b39f-557ec4f12c0c None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:54.479287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b9f805-49d2-4973-b39f-557ec4f12c0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:54.480152 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9f805-49d2-4973-b39f-557ec4f12c0c None admin] RBAC: Adding query filter params (role.id=338a913607974d379aad3249b3d0402d, scope.project.id=320d79ecbc2342af8031103e7308c10d, user.id=40432493f16b4df681daf5a1af87832a) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:54.480483 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9f805-49d2-4973-b39f-557ec4f12c0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:54.481900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b9f805-49d2-4973-b39f-557ec4f12c0c None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:54.487584 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 339/662] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:54 2022] GET /identity/v3/role_assignments?user.id=40432493f16b4df681daf5a1af87832a&scope.project.id=320d79ecbc2342af8031103e7308c10d&role.id=338a913607974d379aad3249b3d0402d => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:54.488381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9f805-49d2-4973-b39f-557ec4f12c0c None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:54.488627 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2cc87-e2fd-4d58-bbc5-3c6236e86bb4 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:54.529455 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de18b5-b2a1-40b9-a3f3-e9676d6f1a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:54.530185 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de18b5-b2a1-40b9-a3f3-e9676d6f1a6a None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:54.530692 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de18b5-b2a1-40b9-a3f3-e9676d6f1a6a None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:54.530969 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6de18b5-b2a1-40b9-a3f3-e9676d6f1a6a None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:54.533988 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de18b5-b2a1-40b9-a3f3-e9676d6f1a6a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:54.534591 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de18b5-b2a1-40b9-a3f3-e9676d6f1a6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:54.536917 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:54.538584 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6de18b5-b2a1-40b9-a3f3-e9676d6f1a6a None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:54.558869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 324/663] 10.222.0.44 () {56 vars in 1139 bytes} [Thu Jun 16 00:13:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:54.559772 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de18b5-b2a1-40b9-a3f3-e9676d6f1a6a None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:54.616461 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b9f805-49d2-4973-b39f-557ec4f12c0c None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:54.654234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c07692-eec6-4188-953a-b658619a5645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:54.654951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c07692-eec6-4188-953a-b658619a5645 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:54.655247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c07692-eec6-4188-953a-b658619a5645 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:54.655528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c07692-eec6-4188-953a-b658619a5645 None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:54.656302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c07692-eec6-4188-953a-b658619a5645 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:54.656621 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c07692-eec6-4188-953a-b658619a5645 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:54.659216 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c07692-eec6-4188-953a-b658619a5645 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:54.668149 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:54.671267 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 340/664] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:54.672249 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c07692-eec6-4188-953a-b658619a5645 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:54.676034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6de18b5-b2a1-40b9-a3f3-e9676d6f1a6a None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:54.721010 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8844ff-672d-491d-b998-747a8dba71c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:54.721814 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8844ff-672d-491d-b998-747a8dba71c4 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:54.722091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8844ff-672d-491d-b998-747a8dba71c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:54.722976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8844ff-672d-491d-b998-747a8dba71c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:54.736170 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8844ff-672d-491d-b998-747a8dba71c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:54.737932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8844ff-672d-491d-b998-747a8dba71c4 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:54.756322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-2e8844ff-672d-491d-b998-747a8dba71c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:54.756322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:54.756322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:54.756322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:54.756322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:54.756322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:54.756322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:54.756322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:54.756322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:54.756322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:54.756322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:54.756322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:54.756322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:54.756322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:54.756322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:54.757256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:54.757256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:54.757256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:54.757256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:54.757256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:54.757256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:54.757256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:54.757256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:54.757256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:54.757256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:54.757256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:54.757256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:54.757256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:54.757256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:54.757256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:54.757256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:54.757256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:54.758833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:54.758833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:54.758833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:54.758833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:54.758833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 325/665] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:54.758833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8844ff-672d-491d-b998-747a8dba71c4 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:54.786553 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:54.792450 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c07692-eec6-4188-953a-b658619a5645 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:54.832648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2bb73-2f1b-47ae-acfa-40bfadcc5b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:54.833452 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2bb73-2f1b-47ae-acfa-40bfadcc5b07 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:54.833737 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2bb73-2f1b-47ae-acfa-40bfadcc5b07 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:54.834011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba2bb73-2f1b-47ae-acfa-40bfadcc5b07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:54.844782 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba2bb73-2f1b-47ae-acfa-40bfadcc5b07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:54.853127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-6ba2bb73-2f1b-47ae-acfa-40bfadcc5b07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:54.853127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:54.853127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:54.853127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:54.853127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:54.853127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:54.853127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:54.853127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:54.853127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:54.853127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:54.853127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:54.853127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:54.853127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:54.853127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:54.853127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:54.853127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:54.854053 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:54.854053 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:54.854053 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:54.854053 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:54.854053 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:54.854053 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:54.854053 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:54.854053 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:54.854053 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:54.854053 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:54.854053 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:54.854053 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:54.854053 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:54.854053 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:54.854053 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:54.854053 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:54.854910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:54.854910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:54.854910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:54.854910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:54.854910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:54.854910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:54.854910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:54.854910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:54.854910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:54.854910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:54.854910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:13:54.854910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:54.854910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 341/666] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 00:13:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:54.855659 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2bb73-2f1b-47ae-acfa-40bfadcc5b07 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:54.871720 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8844ff-672d-491d-b998-747a8dba71c4 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:54.907936 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c384b-72e9-4a98-b120-5526e4fe3933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:54.908603 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c384b-72e9-4a98-b120-5526e4fe3933 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:54.908887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c384b-72e9-4a98-b120-5526e4fe3933 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:54.909164 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945c384b-72e9-4a98-b120-5526e4fe3933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:54.928846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:54.963393 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba2bb73-2f1b-47ae-acfa-40bfadcc5b07 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:54.982320 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c384b-72e9-4a98-b120-5526e4fe3933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:54.983817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945c384b-72e9-4a98-b120-5526e4fe3933 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:55.000060 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9cd811-af0e-4e02-9045-bd723df8629d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:55.000969 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cd811-af0e-4e02-9045-bd723df8629d None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:55.001397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cd811-af0e-4e02-9045-bd723df8629d None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:55.001744 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9cd811-af0e-4e02-9045-bd723df8629d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:55.009946 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9cd811-af0e-4e02-9045-bd723df8629d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:55.011774 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9cd811-af0e-4e02-9045-bd723df8629d None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:55.026426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-3c9cd811-af0e-4e02-9045-bd723df8629d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:55.026426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:55.026426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:55.026426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:55.026426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:55.026426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:55.026426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:55.026426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:55.026426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:55.026426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:55.026426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:55.026426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:55.026426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:13:55.026426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:13:55.026426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:13:55.027348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:13:55.027348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:55.027348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:55.027348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:55.027348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:55.027348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:55.027348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:55.027348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:55.027348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:55.027348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:55.027348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:55.027348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:55.027348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:55.027348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:55.027348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:55.027348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:55.027348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:55.028287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:13:55.028287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:13:55.028287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:13:55.028287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:13:55.028287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:13:55.028287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:13:55.028287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:55.028287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:55.028287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 342/667] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:55.028767 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9cd811-af0e-4e02-9045-bd723df8629d None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:55.049000 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:55.091735 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 326/668] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:13:55.092579 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c384b-72e9-4a98-b120-5526e4fe3933 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:55.139527 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9cd811-af0e-4e02-9045-bd723df8629d None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:55.142581 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:55.177109 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7448a-0c95-4772-98f0-bdc5b1ba731c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:55.177924 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7448a-0c95-4772-98f0-bdc5b1ba731c None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:55.178214 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7448a-0c95-4772-98f0-bdc5b1ba731c None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:55.178491 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf7448a-0c95-4772-98f0-bdc5b1ba731c None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:55.179219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7448a-0c95-4772-98f0-bdc5b1ba731c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:55.179530 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7448a-0c95-4772-98f0-bdc5b1ba731c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:55.180924 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf7448a-0c95-4772-98f0-bdc5b1ba731c None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:55.196844 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 343/669] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:55.196844 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7448a-0c95-4772-98f0-bdc5b1ba731c None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:55.199582 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945c384b-72e9-4a98-b120-5526e4fe3933 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:55.235571 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c8465-e73c-4c13-8eb1-0a90de50ac40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:55.236386 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c8465-e73c-4c13-8eb1-0a90de50ac40 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:55.236674 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c8465-e73c-4c13-8eb1-0a90de50ac40 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:55.236954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c8465-e73c-4c13-8eb1-0a90de50ac40 None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:55.237701 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c8465-e73c-4c13-8eb1-0a90de50ac40 None admin] RBAC: Adding query filter params (name=service) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:55.238643 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c8465-e73c-4c13-8eb1-0a90de50ac40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:55.240158 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c8465-e73c-4c13-8eb1-0a90de50ac40 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:55.249030 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 327/670] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 00:13:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:55.249853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c8465-e73c-4c13-8eb1-0a90de50ac40 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:55.280853 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:55.305373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf7448a-0c95-4772-98f0-bdc5b1ba731c None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:55.341124 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028f598-a52f-423c-942a-5dbbafb6e087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:55.341953 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028f598-a52f-423c-942a-5dbbafb6e087 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:55.342318 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028f598-a52f-423c-942a-5dbbafb6e087 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:55.342677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3028f598-a52f-423c-942a-5dbbafb6e087 None admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:55.343542 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028f598-a52f-423c-942a-5dbbafb6e087 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:55.343900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028f598-a52f-423c-942a-5dbbafb6e087 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:55.345340 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3028f598-a52f-423c-942a-5dbbafb6e087 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:55.357976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 344/671] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:13:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:55.358804 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028f598-a52f-423c-942a-5dbbafb6e087 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:55.365458 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c8465-e73c-4c13-8eb1-0a90de50ac40 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:55.376868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:55.401920 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0d43c-2c5e-467c-a0e0-b2e1ac9f338d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:55.402708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0d43c-2c5e-467c-a0e0-b2e1ac9f338d None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:55.402994 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0d43c-2c5e-467c-a0e0-b2e1ac9f338d None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:55.403267 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a0d43c-2c5e-467c-a0e0-b2e1ac9f338d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:55.413733 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0d43c-2c5e-467c-a0e0-b2e1ac9f338d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:55.415193 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a0d43c-2c5e-467c-a0e0-b2e1ac9f338d None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:55.432673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-37a0d43c-2c5e-467c-a0e0-b2e1ac9f338d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:55.432673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:55.432673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:55.432673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:55.432673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:55.432673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:55.432673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:55.432673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:55.432673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:55.432673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:55.432673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:55.432673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:55.432673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:55.432673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:55.432673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:55.433572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:55.433572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:55.433572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:55.433572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:55.433572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:55.433572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:55.433572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:55.433572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:55.433572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:55.433572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:55.433572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:55.433572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:55.433572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:55.433572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:55.433572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:55.433572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:55.433572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:55.434450 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:55.434450 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:55.434450 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:55.434450 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:55.434450 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 328/672] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:55.434734 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0d43c-2c5e-467c-a0e0-b2e1ac9f338d None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:55.477873 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3028f598-a52f-423c-942a-5dbbafb6e087 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:55.515661 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07112ad-a699-4dde-8cee-63ed3de8aed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:55.516828 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07112ad-a699-4dde-8cee-63ed3de8aed4 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:55.517259 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07112ad-a699-4dde-8cee-63ed3de8aed4 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:55.517682 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07112ad-a699-4dde-8cee-63ed3de8aed4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:55.521412 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:55.526497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07112ad-a699-4dde-8cee-63ed3de8aed4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:55.528450 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07112ad-a699-4dde-8cee-63ed3de8aed4 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:55.540241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a0d43c-2c5e-467c-a0e0-b2e1ac9f338d None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:55.543042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-f07112ad-a699-4dde-8cee-63ed3de8aed4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:55.543042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:55.543042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:55.543042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:55.543042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:55.543042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:55.543042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:55.543042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:55.543042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:55.543042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:55.543042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:55.543042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:55.543042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:13:55.543042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:13:55.543042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:13:55.543973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:13:55.543973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:55.543973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:55.543973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:55.543973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:55.543973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:55.543973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:55.543973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:55.543973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:55.543973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:55.543973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:55.543973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:55.543973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:55.543973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:55.543973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:55.543973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:55.543973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:55.544890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:13:55.544890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:13:55.544890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:13:55.544890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:13:55.544890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:13:55.544890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:13:55.544890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:55.544890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:55.544890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 345/673] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:55.544890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07112ad-a699-4dde-8cee-63ed3de8aed4 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:55.581007 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9030df0-414a-465e-8379-ab5d2f7dac89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:55.582358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9030df0-414a-465e-8379-ab5d2f7dac89 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:55.582640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9030df0-414a-465e-8379-ab5d2f7dac89 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:55.582909 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9030df0-414a-465e-8379-ab5d2f7dac89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:55.593497 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9030df0-414a-465e-8379-ab5d2f7dac89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:55.594930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9030df0-414a-465e-8379-ab5d2f7dac89 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:55.612099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-f9030df0-414a-465e-8379-ab5d2f7dac89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:55.612099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:55.612099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:55.612099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:55.612099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:55.612099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:55.612099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:55.612099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:55.612099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:55.612099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:55.612099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:55.612099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:55.612099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:55.612099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:55.612099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:55.612995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:55.612995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:55.612995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:55.612995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:55.612995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:55.612995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:55.612995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:55.612995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:55.612995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:55.612995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:55.612995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:55.612995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:55.612995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:55.612995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:55.612995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:55.612995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:55.612995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:55.613887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:55.613887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:55.613887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:55.613887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:55.613887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 329/674] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:55.614160 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9030df0-414a-465e-8379-ab5d2f7dac89 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:55.636291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:55.657075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07112ad-a699-4dde-8cee-63ed3de8aed4 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:55.696628 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da205f0f-45c7-4a10-b169-dceba873e693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:55.697294 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da205f0f-45c7-4a10-b169-dceba873e693 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:55.697577 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da205f0f-45c7-4a10-b169-dceba873e693 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:55.697854 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da205f0f-45c7-4a10-b169-dceba873e693 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:55.698691 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da205f0f-45c7-4a10-b169-dceba873e693 None admin] RBAC: Adding query filter params (role.id=338a913607974d379aad3249b3d0402d, scope.project.id=320d79ecbc2342af8031103e7308c10d, user.id=faaab5440b7041faa5a6f9ea18c188c4) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:55.699005 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da205f0f-45c7-4a10-b169-dceba873e693 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:55.700475 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da205f0f-45c7-4a10-b169-dceba873e693 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:55.706595 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 346/675] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:55 2022] GET /identity/v3/role_assignments?user.id=faaab5440b7041faa5a6f9ea18c188c4&scope.project.id=320d79ecbc2342af8031103e7308c10d&role.id=338a913607974d379aad3249b3d0402d => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:55.707423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da205f0f-45c7-4a10-b169-dceba873e693 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:55.741497 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9030df0-414a-465e-8379-ab5d2f7dac89 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:55.786480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8c423-3404-4ece-a478-95ce6610042c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:55.787159 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8c423-3404-4ece-a478-95ce6610042c None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:55.787443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8c423-3404-4ece-a478-95ce6610042c None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:55.787767 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e8c423-3404-4ece-a478-95ce6610042c None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:55.788531 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8c423-3404-4ece-a478-95ce6610042c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:55.788943 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8c423-3404-4ece-a478-95ce6610042c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:55.790405 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e8c423-3404-4ece-a478-95ce6610042c None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:55.805722 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 330/676] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:55.806668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8c423-3404-4ece-a478-95ce6610042c None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:55.808244 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:55.870382 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da205f0f-45c7-4a10-b169-dceba873e693 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:55.896917 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:55.912589 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e595a-0bc7-4fe0-a470-00499b536de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:55.913529 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e595a-0bc7-4fe0-a470-00499b536de7 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:55.913816 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e595a-0bc7-4fe0-a470-00499b536de7 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:55.914095 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98e595a-0bc7-4fe0-a470-00499b536de7 None admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:55.914887 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e595a-0bc7-4fe0-a470-00499b536de7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:55.915300 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e595a-0bc7-4fe0-a470-00499b536de7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:55.916873 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98e595a-0bc7-4fe0-a470-00499b536de7 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:55.925107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e8c423-3404-4ece-a478-95ce6610042c None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:55.930634 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 347/677] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:13:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:55.931492 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e595a-0bc7-4fe0-a470-00499b536de7 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:55.967290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e21434-e04c-438a-8331-08d2b557a9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:55.968421 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e21434-e04c-438a-8331-08d2b557a9ac None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:55.968704 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e21434-e04c-438a-8331-08d2b557a9ac None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:55.968982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e21434-e04c-438a-8331-08d2b557a9ac None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:55.969697 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e21434-e04c-438a-8331-08d2b557a9ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:55.970003 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e21434-e04c-438a-8331-08d2b557a9ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:55.971384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e21434-e04c-438a-8331-08d2b557a9ac None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:55.983307 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 331/678] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:55.984257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e21434-e04c-438a-8331-08d2b557a9ac None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:56.056984 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98e595a-0bc7-4fe0-a470-00499b536de7 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:56.088004 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:56.102235 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf4431-3fb4-4f3a-9ee8-984eea8394d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:56.102980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e21434-e04c-438a-8331-08d2b557a9ac None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:56.103573 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf4431-3fb4-4f3a-9ee8-984eea8394d1 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:56.104098 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf4431-3fb4-4f3a-9ee8-984eea8394d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:56.104796 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf4431-3fb4-4f3a-9ee8-984eea8394d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:56.114381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf4431-3fb4-4f3a-9ee8-984eea8394d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:56.116873 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cf4431-3fb4-4f3a-9ee8-984eea8394d1 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:56.136476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-54cf4431-3fb4-4f3a-9ee8-984eea8394d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:56.136476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:56.136476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:56.136476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:56.136476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:56.136476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:56.136476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:56.136476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:56.136476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:56.136476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:56.136476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:56.136476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:56.136476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:13:56.136476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:13:56.136476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:13:56.137397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:13:56.137397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:56.137397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:56.137397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:56.137397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:56.137397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:56.137397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:56.137397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:56.137397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:56.137397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:56.137397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:56.137397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:56.137397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:56.137397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:56.137397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:56.137397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:56.137397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:56.138286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:13:56.138286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:13:56.138286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:13:56.138286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:13:56.138286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:13:56.138286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:13:56.138286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:56.138286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:56.140792 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 348/679] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:56.141816 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf4431-3fb4-4f3a-9ee8-984eea8394d1 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:56.149232 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b1784-b4e2-4c9f-9c37-1979965a128d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:56.150000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b1784-b4e2-4c9f-9c37-1979965a128d None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:56.150349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b1784-b4e2-4c9f-9c37-1979965a128d None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:56.150700 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9b1784-b4e2-4c9f-9c37-1979965a128d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:56.151643 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b1784-b4e2-4c9f-9c37-1979965a128d None admin] RBAC: Adding query filter params (role.id=338a913607974d379aad3249b3d0402d, scope.project.id=320d79ecbc2342af8031103e7308c10d, user.id=33ba9644ca064e95b43650424baef79f) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:56.152060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b1784-b4e2-4c9f-9c37-1979965a128d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:56.154066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9b1784-b4e2-4c9f-9c37-1979965a128d None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:56.156752 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:56.164215 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 332/680] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:55 2022] GET /identity/v3/role_assignments?user.id=33ba9644ca064e95b43650424baef79f&scope.project.id=320d79ecbc2342af8031103e7308c10d&role.id=338a913607974d379aad3249b3d0402d => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:56.165217 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b1784-b4e2-4c9f-9c37-1979965a128d None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:56.332803 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9b1784-b4e2-4c9f-9c37-1979965a128d None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:56.350160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf4431-3fb4-4f3a-9ee8-984eea8394d1 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:56.400547 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65860116-81a1-4227-b525-cf18be2f2ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:56.401209 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65860116-81a1-4227-b525-cf18be2f2ca7 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:56.401488 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65860116-81a1-4227-b525-cf18be2f2ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:56.401759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65860116-81a1-4227-b525-cf18be2f2ca7 None admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:56.402541 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65860116-81a1-4227-b525-cf18be2f2ca7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:56.402855 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65860116-81a1-4227-b525-cf18be2f2ca7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:56.404335 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65860116-81a1-4227-b525-cf18be2f2ca7 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:56.412130 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3078b-2e01-4272-b08c-72635444ef53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:56.413166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3078b-2e01-4272-b08c-72635444ef53 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:56.414831 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3078b-2e01-4272-b08c-72635444ef53 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:56.415431 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3078b-2e01-4272-b08c-72635444ef53 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:56.418715 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 333/681] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:13:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:56.423984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65860116-81a1-4227-b525-cf18be2f2ca7 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:56.425356 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3078b-2e01-4272-b08c-72635444ef53 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:56.427239 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3078b-2e01-4272-b08c-72635444ef53 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:56.447187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-39a3078b-2e01-4272-b08c-72635444ef53 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:13:56.447187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:56.447187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:56.447187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:56.447187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:56.447187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:56.447187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:56.447187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:56.447187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:56.447187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:56.447187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:56.447187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:56.447187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:13:56.447187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:13:56.447187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:13:56.447187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:13:56.448502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:56.448502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:56.448502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:13:56.448502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:56.448502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:13:56.448502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:56.448502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:56.448502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:56.448502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:56.448502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:56.448502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:56.448502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:56.448502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:56.448502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:56.448502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:56.448502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:56.448502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:56.448502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:56.449707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:56.449707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:56.449707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:13:56.449707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:13:56.449707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:13:56.449707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:13:56.449707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:13:56.449707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:13:56.449707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:13:56.449707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:56.452469 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 349/682] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:13:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:56.457794 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3078b-2e01-4272-b08c-72635444ef53 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:56.506428 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:56.507862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:56.563697 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65860116-81a1-4227-b525-cf18be2f2ca7 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:56.577756 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3078b-2e01-4272-b08c-72635444ef53 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:56.607123 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37cd53-28ee-4fd9-8358-93e87cce0ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:56.608472 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37cd53-28ee-4fd9-8358-93e87cce0ad0 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:56.609023 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37cd53-28ee-4fd9-8358-93e87cce0ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:56.609457 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac37cd53-28ee-4fd9-8358-93e87cce0ad0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:56.610603 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37cd53-28ee-4fd9-8358-93e87cce0ad0 None admin] RBAC: Adding query filter params (role.id=338a913607974d379aad3249b3d0402d, scope.project.id=320d79ecbc2342af8031103e7308c10d, user.id=222e3db424f0476386bc3432cc0f868e) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:56.611376 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37cd53-28ee-4fd9-8358-93e87cce0ad0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:56.614058 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac37cd53-28ee-4fd9-8358-93e87cce0ad0 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:56.616520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4156fb39-dd15-459c-8c0f-acadc7f2bcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:56.617265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156fb39-dd15-459c-8c0f-acadc7f2bcbc None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:56.617646 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156fb39-dd15-459c-8c0f-acadc7f2bcbc None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:56.618436 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4156fb39-dd15-459c-8c0f-acadc7f2bcbc None admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:56.619092 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156fb39-dd15-459c-8c0f-acadc7f2bcbc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:56.619503 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156fb39-dd15-459c-8c0f-acadc7f2bcbc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:56.621976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4156fb39-dd15-459c-8c0f-acadc7f2bcbc None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:56.622347 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 334/683] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:56 2022] GET /identity/v3/role_assignments?user.id=222e3db424f0476386bc3432cc0f868e&scope.project.id=320d79ecbc2342af8031103e7308c10d&role.id=338a913607974d379aad3249b3d0402d => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:56.647885 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 350/684] 10.222.0.44 () {56 vars in 1135 bytes} [Thu Jun 16 00:13:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:56.653236 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37cd53-28ee-4fd9-8358-93e87cce0ad0 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:56.750555 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdde150-8454-43dc-be06-9224794dbd0d None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:56.750878 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdde150-8454-43dc-be06-9224794dbd0d None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:56.751121 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdde150-8454-43dc-be06-9224794dbd0d None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:56.753420 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 351/685] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:13:56.760257 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde6a36-f525-4dda-a85a-259ab4c0f79d None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:56.760883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde6a36-f525-4dda-a85a-259ab4c0f79d None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:56.761363 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fde6a36-f525-4dda-a85a-259ab4c0f79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:56.778726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac37cd53-28ee-4fd9-8358-93e87cce0ad0 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:56.800862 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-1fde6a36-f525-4dda-a85a-259ab4c0f79d None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:56.802104 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-1fde6a36-f525-4dda-a85a-259ab4c0f79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:56.807971 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:56.826845 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95211b02-d703-4f19-9596-40ccdfafa436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:56.827511 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95211b02-d703-4f19-9596-40ccdfafa436 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:56.827820 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95211b02-d703-4f19-9596-40ccdfafa436 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:56.828096 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95211b02-d703-4f19-9596-40ccdfafa436 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:56.911732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 352/686] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:13:56.931313 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95211b02-d703-4f19-9596-40ccdfafa436 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:56.932827 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95211b02-d703-4f19-9596-40ccdfafa436 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:56.946556 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde6a36-f525-4dda-a85a-259ab4c0f79d None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:57.000878 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:57.052620 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 335/687] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:13:57.060594 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95211b02-d703-4f19-9596-40ccdfafa436 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:57.103446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:57.156952 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fde6a36-f525-4dda-a85a-259ab4c0f79d None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:57.217917 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a720c1b-8ac2-4469-80d5-0cbd1a673df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:57.218729 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a720c1b-8ac2-4469-80d5-0cbd1a673df2 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:57.219016 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a720c1b-8ac2-4469-80d5-0cbd1a673df2 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:57.219293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a720c1b-8ac2-4469-80d5-0cbd1a673df2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:57.233675 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95211b02-d703-4f19-9596-40ccdfafa436 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:57.245200 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a720c1b-8ac2-4469-80d5-0cbd1a673df2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:13:57.255409 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-1a720c1b-8ac2-4469-80d5-0cbd1a673df2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:57.255409 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:57.255409 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:57.255409 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:57.255409 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:57.255409 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:57.255409 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:57.255409 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:57.255409 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:57.255409 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:57.255409 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:57.255409 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:57.255409 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:13:57.255409 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:13:57.255409 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:13:57.255409 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:13:57.256629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:13:57.256629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:13:57.256629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:13:57.256629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:13:57.256629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:57.256629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:57.256629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:57.256629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:57.256629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:57.256629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:57.256629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:57.256629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:57.256629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:57.256629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:57.256629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:57.256629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:57.257455 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:57.257455 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:57.257455 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:57.257455 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:57.257455 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:13:57.257455 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:13:57.257455 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:13:57.257455 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:13:57.257455 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:13:57.257455 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:13:57.257455 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:13:57.257455 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:57.257455 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 353/688] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:13:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:57.264555 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a720c1b-8ac2-4469-80d5-0cbd1a673df2 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:57.306607 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4f70f-f7e9-4a91-ab74-cd3ca98d3810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:57.307407 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4f70f-f7e9-4a91-ab74-cd3ca98d3810 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:57.307734 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4f70f-f7e9-4a91-ab74-cd3ca98d3810 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:57.308014 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4f70f-f7e9-4a91-ab74-cd3ca98d3810 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:57.319532 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4f70f-f7e9-4a91-ab74-cd3ca98d3810 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:57.321171 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4f70f-f7e9-4a91-ab74-cd3ca98d3810 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:57.341935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-55d4f70f-f7e9-4a91-ab74-cd3ca98d3810 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:57.341935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:57.341935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:57.341935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:57.341935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:57.341935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:57.341935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:57.341935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:57.341935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:57.341935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:57.341935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:57.341935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:57.341935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:57.341935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:57.341935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:57.342891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:57.342891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:57.342891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:57.342891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:57.342891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:57.342891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:57.342891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:57.342891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:57.342891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:57.342891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:57.342891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:57.342891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:57.342891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:57.342891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:57.342891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:57.342891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:57.342891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:57.343802 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:57.343802 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:57.343802 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:57.343802 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:57.348196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 336/689] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:57.354809 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4f70f-f7e9-4a91-ab74-cd3ca98d3810 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:57.442462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:57.446821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:57.462953 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a720c1b-8ac2-4469-80d5-0cbd1a673df2 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:57.503813 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0ea2f-a8b8-429a-9d40-ee8835511a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:57.504831 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0ea2f-a8b8-429a-9d40-ee8835511a6e None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:57.506263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0ea2f-a8b8-429a-9d40-ee8835511a6e None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:57.506962 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0ea2f-a8b8-429a-9d40-ee8835511a6e None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:57.509056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0ea2f-a8b8-429a-9d40-ee8835511a6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:57.510473 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0ea2f-a8b8-429a-9d40-ee8835511a6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:57.512097 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0ea2f-a8b8-429a-9d40-ee8835511a6e None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:57.514897 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4f70f-f7e9-4a91-ab74-cd3ca98d3810 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:57.525481 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 354/690] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:13:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:57.532501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0ea2f-a8b8-429a-9d40-ee8835511a6e None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:57.576043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0d499-94fd-45a7-9fa6-a79635aadcbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:57.576736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0d499-94fd-45a7-9fa6-a79635aadcbd None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:57.576995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0d499-94fd-45a7-9fa6-a79635aadcbd None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:57.577272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad0d499-94fd-45a7-9fa6-a79635aadcbd None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:57.578049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0d499-94fd-45a7-9fa6-a79635aadcbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:57.578363 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0d499-94fd-45a7-9fa6-a79635aadcbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:57.580570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad0d499-94fd-45a7-9fa6-a79635aadcbd None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:57.605318 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 337/691] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:57.613962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0d499-94fd-45a7-9fa6-a79635aadcbd None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:57.727641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0ea2f-a8b8-429a-9d40-ee8835511a6e None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:57.747766 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad0d499-94fd-45a7-9fa6-a79635aadcbd None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:57.792493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed61f61-13fa-460f-ba47-612ee25187df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:57.793233 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed61f61-13fa-460f-ba47-612ee25187df None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:57.793517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed61f61-13fa-460f-ba47-612ee25187df None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:57.793796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed61f61-13fa-460f-ba47-612ee25187df None admin] PATH_INFO: `/v3/projects/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:57.803348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f777c50-f7d8-4dc8-85d4-958616e66199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:57.803928 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:57.804197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f777c50-f7d8-4dc8-85d4-958616e66199 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:57.804484 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f777c50-f7d8-4dc8-85d4-958616e66199 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:57.804765 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f777c50-f7d8-4dc8-85d4-958616e66199 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:57.816804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed61f61-13fa-460f-ba47-612ee25187df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:57.818296 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed61f61-13fa-460f-ba47-612ee25187df None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:57.824505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f777c50-f7d8-4dc8-85d4-958616e66199 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:57.826222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f777c50-f7d8-4dc8-85d4-958616e66199 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:57.836372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-0ed61f61-13fa-460f-ba47-612ee25187df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:57.836372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:57.836372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:57.836372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:57.836372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:57.836372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:57.836372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:57.836372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:57.836372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:57.836372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:57.836372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:57.836372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:57.836372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:13:57.836372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:13:57.836372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:13:57.837384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:13:57.837384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:57.837384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:57.837384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:57.837384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:57.837384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:57.837384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:57.837384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:57.837384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:57.837384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:57.837384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:57.837384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:57.837384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:57.837384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:57.837384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:57.837384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:57.837384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:57.838272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:13:57.838272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:13:57.838272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:13:57.838272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:13:57.838272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:13:57.838272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:13:57.838272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:57.838272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:57.838272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 338/692] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:57.847638 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed61f61-13fa-460f-ba47-612ee25187df None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:57.863636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-3f777c50-f7d8-4dc8-85d4-958616e66199 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:57.863636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:57.863636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:57.863636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:57.863636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:57.863636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:57.863636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:57.863636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:57.863636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:57.863636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:57.863636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:57.863636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:57.863636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:57.863636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:57.863636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:57.864727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:57.864727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:57.864727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:57.864727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:57.864727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:57.864727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:57.864727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:57.864727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:57.864727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:57.864727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:57.864727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:57.864727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:57.864727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:57.864727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:57.864727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:57.864727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:57.864727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:57.865627 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:57.865627 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:57.865627 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:57.865627 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:57.867465 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 355/693] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:57.878333 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f777c50-f7d8-4dc8-85d4-958616e66199 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:57.885656 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:57.952260 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed61f61-13fa-460f-ba47-612ee25187df None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:58.008586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d21eda-fb9a-42c0-bcdd-48ad2631516b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:58.009266 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d21eda-fb9a-42c0-bcdd-48ad2631516b None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:58.009550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d21eda-fb9a-42c0-bcdd-48ad2631516b None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:58.009834 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d21eda-fb9a-42c0-bcdd-48ad2631516b None admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:58.010607 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d21eda-fb9a-42c0-bcdd-48ad2631516b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:58.010921 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d21eda-fb9a-42c0-bcdd-48ad2631516b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:58.012571 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d21eda-fb9a-42c0-bcdd-48ad2631516b None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:58.021150 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f777c50-f7d8-4dc8-85d4-958616e66199 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:58.039638 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 339/694] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:13:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:58.039638 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d21eda-fb9a-42c0-bcdd-48ad2631516b None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:58.088479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147c70c-6da5-49ff-ae9b-791c461d76ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:58.089432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147c70c-6da5-49ff-ae9b-791c461d76ae None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:58.089863 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147c70c-6da5-49ff-ae9b-791c461d76ae None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:58.090314 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a147c70c-6da5-49ff-ae9b-791c461d76ae None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:58.091226 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147c70c-6da5-49ff-ae9b-791c461d76ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:58.091715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147c70c-6da5-49ff-ae9b-791c461d76ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:58.093269 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a147c70c-6da5-49ff-ae9b-791c461d76ae None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:58.106522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 356/695] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:58.106741 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:58.116713 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147c70c-6da5-49ff-ae9b-791c461d76ae None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:58.158827 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d21eda-fb9a-42c0-bcdd-48ad2631516b None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:58.193596 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff91ca0e-28b2-44d1-b8f5-db1edb36c55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:58.194285 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91ca0e-28b2-44d1-b8f5-db1edb36c55e None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:58.194614 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91ca0e-28b2-44d1-b8f5-db1edb36c55e None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:58.194897 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff91ca0e-28b2-44d1-b8f5-db1edb36c55e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:58.195761 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91ca0e-28b2-44d1-b8f5-db1edb36c55e None admin] RBAC: Adding query filter params (role.id=338a913607974d379aad3249b3d0402d, scope.project.id=320d79ecbc2342af8031103e7308c10d, user.id=9918c4a8c6a64812b61fc235ab8e7bec) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:58.196140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91ca0e-28b2-44d1-b8f5-db1edb36c55e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:58.197709 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff91ca0e-28b2-44d1-b8f5-db1edb36c55e None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:58.204243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 340/696] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:13:58 2022] GET /identity/v3/role_assignments?user.id=9918c4a8c6a64812b61fc235ab8e7bec&scope.project.id=320d79ecbc2342af8031103e7308c10d&role.id=338a913607974d379aad3249b3d0402d => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:58.205523 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89f48c-87ff-47ab-9bb3-3130cefbac77 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:58.207421 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:58.212044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89f48c-87ff-47ab-9bb3-3130cefbac77 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:58.212353 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af89f48c-87ff-47ab-9bb3-3130cefbac77 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:58.214126 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 341/697] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:58 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:58.219381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d50a70-b38d-4018-9326-e563ef362ad5 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:58.219709 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d50a70-b38d-4018-9326-e563ef362ad5 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:58.219991 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d50a70-b38d-4018-9326-e563ef362ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:58.241968 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a147c70c-6da5-49ff-ae9b-791c461d76ae None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:58.260951 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-d5d50a70-b38d-4018-9326-e563ef362ad5 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:58.262212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d5d50a70-b38d-4018-9326-e563ef362ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:58.280384 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc4998-62a3-4c25-853f-85fc4f568eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:58.281417 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc4998-62a3-4c25-853f-85fc4f568eab None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:58.281797 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc4998-62a3-4c25-853f-85fc4f568eab None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:58.282172 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc4998-62a3-4c25-853f-85fc4f568eab None admin] PATH_INFO: `/v3/users/nova` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:58.291056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc4998-62a3-4c25-853f-85fc4f568eab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:58.292769 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc4998-62a3-4c25-853f-85fc4f568eab None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:58.310377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-f8fc4998-62a3-4c25-853f-85fc4f568eab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:13:58.310377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:58.310377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:58.310377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:58.310377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:58.310377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:58.310377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:58.310377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:58.310377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:58.310377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:58.310377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:58.310377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:58.310377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:13:58.310377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:13:58.310377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:13:58.310377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:13:58.311479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:58.311479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:58.311479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:13:58.311479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:58.311479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:13:58.311479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:13:58.311479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:58.311479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:58.311479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:58.311479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:58.311479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:58.311479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:58.311479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:58.311479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:58.311479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:58.311479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:58.311479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:58.311479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:58.312645 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:58.312645 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:58.312645 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:13:58.312645 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:13:58.312645 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:13:58.312645 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:13:58.312645 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:13:58.312645 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:13:58.312645 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:13:58.312645 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:58.312645 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 357/698] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 16 00:13:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:58.321169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc4998-62a3-4c25-853f-85fc4f568eab None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:58.371928 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 342/699] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:58.396614 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d50a70-b38d-4018-9326-e563ef362ad5 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:58.482158 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:58.512397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc4998-62a3-4c25-853f-85fc4f568eab None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:58.539305 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d50a70-b38d-4018-9326-e563ef362ad5 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:58.544022 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:58.554898 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e436d-cf3c-4f45-87ec-4d174fc48329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:58.555950 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e436d-cf3c-4f45-87ec-4d174fc48329 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:58.556242 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e436d-cf3c-4f45-87ec-4d174fc48329 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:58.556524 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e436d-cf3c-4f45-87ec-4d174fc48329 None admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:58.557499 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e436d-cf3c-4f45-87ec-4d174fc48329 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:58.557878 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e436d-cf3c-4f45-87ec-4d174fc48329 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:58.559399 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054e436d-cf3c-4f45-87ec-4d174fc48329 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:58.578837 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec4fb5-86ec-40d4-bbad-da14735e8af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:58.579656 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec4fb5-86ec-40d4-bbad-da14735e8af5 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:58.579945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec4fb5-86ec-40d4-bbad-da14735e8af5 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:58.580214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ec4fb5-86ec-40d4-bbad-da14735e8af5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:58.581614 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 358/700] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 16 00:13:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:58.587446 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e436d-cf3c-4f45-87ec-4d174fc48329 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:58.592346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec4fb5-86ec-40d4-bbad-da14735e8af5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:58.593826 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ec4fb5-86ec-40d4-bbad-da14735e8af5 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:58.613132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-24ec4fb5-86ec-40d4-bbad-da14735e8af5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:58.613132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:58.613132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:58.613132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:58.613132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:58.613132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:58.613132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:58.613132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:58.613132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:58.613132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:58.613132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:58.613132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:58.613132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:58.613132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:58.613132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:58.614060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:58.614060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:58.614060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:58.614060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:58.614060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:58.614060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:58.614060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:58.614060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:58.614060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:58.614060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:58.614060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:58.614060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:58.614060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:58.614060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:58.614060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:58.614060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:58.614060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:58.614947 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:58.614947 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:58.614947 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:58.614947 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:58.615761 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 343/701] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:13:58.620947 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec4fb5-86ec-40d4-bbad-da14735e8af5 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:58.700500 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e436d-cf3c-4f45-87ec-4d174fc48329 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:58.743683 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bbf197-dce4-4c44-9ca3-2c37b562dd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:58.744345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbf197-dce4-4c44-9ca3-2c37b562dd76 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:58.744628 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbf197-dce4-4c44-9ca3-2c37b562dd76 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:58.744905 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bbf197-dce4-4c44-9ca3-2c37b562dd76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:58.745813 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:58.748899 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ec4fb5-86ec-40d4-bbad-da14735e8af5 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:58.806911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1587b-a9eb-459c-9f70-a6cedbd4b7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:58.808313 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1587b-a9eb-459c-9f70-a6cedbd4b7e6 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:58.809229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1587b-a9eb-459c-9f70-a6cedbd4b7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:58.809667 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1587b-a9eb-459c-9f70-a6cedbd4b7e6 None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:58.810579 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1587b-a9eb-459c-9f70-a6cedbd4b7e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:58.811359 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1587b-a9eb-459c-9f70-a6cedbd4b7e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:58.813554 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1587b-a9eb-459c-9f70-a6cedbd4b7e6 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:58.820021 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:58.831088 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 344/702] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:58.838225 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1587b-a9eb-459c-9f70-a6cedbd4b7e6 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:58.839208 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbf197-dce4-4c44-9ca3-2c37b562dd76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:58.840648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bbf197-dce4-4c44-9ca3-2c37b562dd76 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:58.954243 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 359/703] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:13:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:13:58.956062 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f0280-1bb6-40a1-93a9-957837ab259c None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:58.956358 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f0280-1bb6-40a1-93a9-957837ab259c None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:58.956778 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8f0280-1bb6-40a1-93a9-957837ab259c None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:58.958764 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 360/704] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:58.961030 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f0280-1bb6-40a1-93a9-957837ab259c None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:58.970719 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1587b-a9eb-459c-9f70-a6cedbd4b7e6 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:59.014580 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d4e00c-e2a4-4013-93ff-e88d0cfe09d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:59.015352 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4e00c-e2a4-4013-93ff-e88d0cfe09d0 None admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:59.016255 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4e00c-e2a4-4013-93ff-e88d0cfe09d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:59.016540 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d4e00c-e2a4-4013-93ff-e88d0cfe09d0 None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:59.017254 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4e00c-e2a4-4013-93ff-e88d0cfe09d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:59.020210 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d4e00c-e2a4-4013-93ff-e88d0cfe09d0 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:59.046856 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 345/705] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 00:13:58 2022] POST /identity/v3/users => generated 254 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:13:59.048163 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d55ded-31b1-4682-895a-17c67e76dfa5 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:59.048454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d55ded-31b1-4682-895a-17c67e76dfa5 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:59.048732 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d55ded-31b1-4682-895a-17c67e76dfa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:59.071956 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-a5d55ded-31b1-4682-895a-17c67e76dfa5 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:59.073238 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a5d55ded-31b1-4682-895a-17c67e76dfa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:59.084543 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:59.089007 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:59.136292 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8f0280-1bb6-40a1-93a9-957837ab259c None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:59.174727 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 346/706] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:59.199676 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819cdb3-8a4e-43e4-9d91-209e586e2001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:59.200506 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819cdb3-8a4e-43e4-9d91-209e586e2001 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:59.200786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819cdb3-8a4e-43e4-9d91-209e586e2001 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:59.201059 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3819cdb3-8a4e-43e4-9d91-209e586e2001 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:59.213186 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819cdb3-8a4e-43e4-9d91-209e586e2001 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:59.214679 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3819cdb3-8a4e-43e4-9d91-209e586e2001 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:59.219254 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d55ded-31b1-4682-895a-17c67e76dfa5 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:59.261707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-3819cdb3-8a4e-43e4-9d91-209e586e2001 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:59.261707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:59.261707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:59.261707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:59.261707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:59.261707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:59.261707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:59.261707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:59.261707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:59.261707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:59.261707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:59.261707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:59.261707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:13:59.261707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:13:59.261707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:13:59.263935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:13:59.263935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:59.263935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:59.263935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:59.263935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:59.263935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:59.263935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:59.263935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:59.263935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:59.263935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:59.263935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:59.263935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:59.263935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:59.263935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:59.263935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:59.263935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:59.263935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:59.266040 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:13:59.266040 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:13:59.266040 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:13:59.266040 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:59.266040 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 361/707] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:59.272721 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819cdb3-8a4e-43e4-9d91-209e586e2001 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:59.361816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d55ded-31b1-4682-895a-17c67e76dfa5 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:59.389465 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3819cdb3-8a4e-43e4-9d91-209e586e2001 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:59.410774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e2a35-47b1-43f4-9a5d-e9a638e5eacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:59.411561 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e2a35-47b1-43f4-9a5d-e9a638e5eacd None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:59.411885 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e2a35-47b1-43f4-9a5d-e9a638e5eacd None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:59.412159 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1e2a35-47b1-43f4-9a5d-e9a638e5eacd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:59.412820 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e2a35-47b1-43f4-9a5d-e9a638e5eacd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:59.414207 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1e2a35-47b1-43f4-9a5d-e9a638e5eacd None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:59.429898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-fe1e2a35-47b1-43f4-9a5d-e9a638e5eacd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:13:59.429898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:59.429898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:13:59.429898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:13:59.429898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:13:59.429898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:13:59.429898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:13:59.429898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:13:59.429898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:13:59.429898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:59.429898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:13:59.429898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:59.429898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:59.429898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:59.429898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:59.429898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:59.430986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:59.430986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:59.430986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:59.430986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:59.430986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:59.430986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:59.430986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:59.430986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:13:59.430986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:13:59.430986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:13:59.430986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:13:59.430986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:59.430986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:59.430986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:59.430986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:59.430986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:59.431932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:59.431932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:59.431932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:59.431932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:59.431932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:59.431932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:59.431932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:59.431932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:59.431932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:59.431932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:59.431932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:59.431932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:13:59.431932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:13:59.431932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:13:59.431932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:13:59.431932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 347/708] 10.222.0.44 () {56 vars in 1129 bytes} [Thu Jun 16 00:13:59 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:13:59.433560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:59.437984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e2a35-47b1-43f4-9a5d-e9a638e5eacd None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:59.440904 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d180bf-0bca-40d5-88ae-f1f61490c335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:59.442435 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d180bf-0bca-40d5-88ae-f1f61490c335 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:59.444270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d180bf-0bca-40d5-88ae-f1f61490c335 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:59.444804 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d180bf-0bca-40d5-88ae-f1f61490c335 None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:59.445777 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d180bf-0bca-40d5-88ae-f1f61490c335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:59.446280 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d180bf-0bca-40d5-88ae-f1f61490c335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:59.447922 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d180bf-0bca-40d5-88ae-f1f61490c335 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:59.454988 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:59.464965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 362/709] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:59.471418 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d180bf-0bca-40d5-88ae-f1f61490c335 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:59.569991 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1e2a35-47b1-43f4-9a5d-e9a638e5eacd None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:59.590649 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d180bf-0bca-40d5-88ae-f1f61490c335 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:59.615269 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a048bc1-83d9-4c0e-becd-f9a38a7b89dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:59.615969 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a048bc1-83d9-4c0e-becd-f9a38a7b89dc None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:59.616502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a048bc1-83d9-4c0e-becd-f9a38a7b89dc None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:59.616803 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a048bc1-83d9-4c0e-becd-f9a38a7b89dc None admin] PATH_INFO: `/v3/services` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:59.617902 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a048bc1-83d9-4c0e-becd-f9a38a7b89dc None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:59.618227 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a048bc1-83d9-4c0e-becd-f9a38a7b89dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:59.619905 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a048bc1-83d9-4c0e-becd-f9a38a7b89dc None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:59.626515 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 348/710] 10.222.0.44 () {56 vars in 1124 bytes} [Thu Jun 16 00:13:59 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:13:59.627680 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2dba4-5200-4fb4-8b12-4fb0edb3a818 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:59.627959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2dba4-5200-4fb4-8b12-4fb0edb3a818 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:59.628237 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2dba4-5200-4fb4-8b12-4fb0edb3a818 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:59.629737 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 349/711] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:13:59.630472 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca7d1e9-7099-4e37-8059-2e339a990ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:59.631773 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7d1e9-7099-4e37-8059-2e339a990ade None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:59.632243 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7d1e9-7099-4e37-8059-2e339a990ade None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:59.632717 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca7d1e9-7099-4e37-8059-2e339a990ade None admin] PATH_INFO: `/v3/projects/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:59.634572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2dba4-5200-4fb4-8b12-4fb0edb3a818 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:59.640642 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7d1e9-7099-4e37-8059-2e339a990ade None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:59.642393 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca7d1e9-7099-4e37-8059-2e339a990ade None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:59.658065 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-7ca7d1e9-7099-4e37-8059-2e339a990ade None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:59.658065 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:13:59.658065 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:13:59.658065 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:13:59.658065 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:13:59.658065 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:13:59.658065 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:13:59.658065 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:13:59.658065 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:13:59.658065 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:13:59.658065 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:13:59.658065 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:13:59.658065 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:13:59.658065 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:13:59.658065 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:13:59.658995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:13:59.658995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:13:59.658995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:13:59.658995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:13:59.658995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:13:59.658995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:13:59.658995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:13:59.658995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:13:59.658995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:13:59.658995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:13:59.658995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:13:59.658995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:13:59.658995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:13:59.658995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:13:59.658995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:13:59.658995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:13:59.658995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:13:59.660475 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:13:59.660475 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:13:59.660475 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:13:59.660475 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:13:59.660475 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:13:59.660475 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:13:59.660475 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:13:59.660475 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:13:59.662633 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 363/712] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:13:59.668171 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3358f09-6d86-4695-8a37-3ee3e6dbb8ad None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:59.668625 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3358f09-6d86-4695-8a37-3ee3e6dbb8ad None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:59.669081 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3358f09-6d86-4695-8a37-3ee3e6dbb8ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:59.687652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-a3358f09-6d86-4695-8a37-3ee3e6dbb8ad None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:13:59.689084 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-a3358f09-6d86-4695-8a37-3ee3e6dbb8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:13:59.726637 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:59.741248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:13:59.763341 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 364/713] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:13:59.764578 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3358f09-6d86-4695-8a37-3ee3e6dbb8ad None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:59.768381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2dba4-5200-4fb4-8b12-4fb0edb3a818 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:59.831995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8177682-f5fe-445f-9fd6-eba8079e9fc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:59.833344 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8177682-f5fe-445f-9fd6-eba8079e9fc9 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:59.833877 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8177682-f5fe-445f-9fd6-eba8079e9fc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:59.834413 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8177682-f5fe-445f-9fd6-eba8079e9fc9 None admin] PATH_INFO: `/v3/services` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:59.835157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8177682-f5fe-445f-9fd6-eba8079e9fc9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:59.839639 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8177682-f5fe-445f-9fd6-eba8079e9fc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:59.839639 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8177682-f5fe-445f-9fd6-eba8079e9fc9 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:13:59.846864 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 350/714] 10.222.0.44 () {56 vars in 1124 bytes} [Thu Jun 16 00:13:59 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:13:59.848245 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8177682-f5fe-445f-9fd6-eba8079e9fc9 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:13:59.898018 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3358f09-6d86-4695-8a37-3ee3e6dbb8ad None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:13:59.983472 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66e627-7052-452f-9f6c-d14ae9c11905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:13:59.984099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66e627-7052-452f-9f6c-d14ae9c11905 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:13:59.984385 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66e627-7052-452f-9f6c-d14ae9c11905 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:13:59.984668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66e627-7052-452f-9f6c-d14ae9c11905 None admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:13:59.985473 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66e627-7052-452f-9f6c-d14ae9c11905 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:13:59.985791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66e627-7052-452f-9f6c-d14ae9c11905 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:13:59.987256 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66e627-7052-452f-9f6c-d14ae9c11905 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:00.017758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 365/715] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:13:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:00.020407 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8177682-f5fe-445f-9fd6-eba8079e9fc9 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:00.024656 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66e627-7052-452f-9f6c-d14ae9c11905 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:00.073771 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428920d2-7087-4b43-9899-897beed008ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:00.074220 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428920d2-7087-4b43-9899-897beed008ed None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:00.074503 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428920d2-7087-4b43-9899-897beed008ed None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:00.074780 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428920d2-7087-4b43-9899-897beed008ed None admin] PATH_INFO: `/v3/services/network` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:00.075436 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428920d2-7087-4b43-9899-897beed008ed None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:00.076883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428920d2-7087-4b43-9899-897beed008ed None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:00.089904 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:00.092125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-428920d2-7087-4b43-9899-897beed008ed None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:14:00.092125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:00.092125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:14:00.092125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:14:00.092125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:14:00.092125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:14:00.092125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:14:00.092125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:00.092125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:14:00.092125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:00.092125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:14:00.092125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:00.092125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:00.092125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:00.092125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:00.092125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:00.092125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:00.093278 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:00.093278 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:00.093278 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:00.093278 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:00.093278 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:00.093278 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:00.093278 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:14:00.093278 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:14:00.093278 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:14:00.093278 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:14:00.093278 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:00.093278 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:00.093278 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:00.093278 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:00.093278 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:00.093278 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:00.094147 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:00.094147 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:00.094147 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:00.094147 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:00.094147 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:00.094147 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:00.094147 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:00.094147 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:00.094147 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:00.094147 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:00.094147 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:14:00.094147 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:00.094147 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:14:00.094147 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:00.094147 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 351/716] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:13:59 2022] GET /identity/v3/services/network => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:00.100009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428920d2-7087-4b43-9899-897beed008ed None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:00.103001 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:00.167863 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66e627-7052-452f-9f6c-d14ae9c11905 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:00.206350 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea6c19-4c09-426d-8972-148ce974281e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:00.207418 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea6c19-4c09-426d-8972-148ce974281e None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:00.207958 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea6c19-4c09-426d-8972-148ce974281e None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:00.208474 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ea6c19-4c09-426d-8972-148ce974281e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:00.209499 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea6c19-4c09-426d-8972-148ce974281e None admin] RBAC: Adding query filter params (role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab, scope.project.id=320d79ecbc2342af8031103e7308c10d, user.id=40432493f16b4df681daf5a1af87832a) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:00.210438 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea6c19-4c09-426d-8972-148ce974281e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:00.212101 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ea6c19-4c09-426d-8972-148ce974281e None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:00.218764 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 366/717] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:00 2022] GET /identity/v3/role_assignments?user.id=40432493f16b4df681daf5a1af87832a&scope.project.id=320d79ecbc2342af8031103e7308c10d&role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:00.268163 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428920d2-7087-4b43-9899-897beed008ed None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:00.310349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3a2d5c-cd05-4f37-b92b-e952eb92ab3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:00.311028 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a2d5c-cd05-4f37-b92b-e952eb92ab3d None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:00.311313 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a2d5c-cd05-4f37-b92b-e952eb92ab3d None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:00.311592 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3a2d5c-cd05-4f37-b92b-e952eb92ab3d None admin] PATH_INFO: `/v3/services` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:00.312331 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a2d5c-cd05-4f37-b92b-e952eb92ab3d None admin] RBAC: Adding query filter params (name=network) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:00.312641 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a2d5c-cd05-4f37-b92b-e952eb92ab3d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:00.314030 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3a2d5c-cd05-4f37-b92b-e952eb92ab3d None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:00.318904 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 352/718] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 16 00:14:00 2022] GET /identity/v3/services?name=network => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:00.324624 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea6c19-4c09-426d-8972-148ce974281e None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:00.431091 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ea6c19-4c09-426d-8972-148ce974281e None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:00.438930 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:00.486667 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6a6ef7-2a1c-4d1a-859d-6cfe2aafad74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:00.486667 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a6ef7-2a1c-4d1a-859d-6cfe2aafad74 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:00.486667 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a6ef7-2a1c-4d1a-859d-6cfe2aafad74 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:00.486667 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6a6ef7-2a1c-4d1a-859d-6cfe2aafad74 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:00.487128 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a6ef7-2a1c-4d1a-859d-6cfe2aafad74 None admin] RBAC: Adding query filter params (type=network) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:00.487128 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a6ef7-2a1c-4d1a-859d-6cfe2aafad74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:00.487128 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6a6ef7-2a1c-4d1a-859d-6cfe2aafad74 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:00.492171 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 367/719] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 16 00:14:00 2022] GET /identity/v3/services?type=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:00.998492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0070a-6029-4821-818e-a04cb2b81b01 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:00.999517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0070a-6029-4821-818e-a04cb2b81b01 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:01.000056 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a0070a-6029-4821-818e-a04cb2b81b01 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:01.001896 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 353/720] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:01.007135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483bba7-ea98-4aa0-bca3-c8688fe2c7b9 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:01.007952 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483bba7-ea98-4aa0-bca3-c8688fe2c7b9 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:01.008439 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7483bba7-ea98-4aa0-bca3-c8688fe2c7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:01.031254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-7483bba7-ea98-4aa0-bca3-c8688fe2c7b9 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:01.032779 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-7483bba7-ea98-4aa0-bca3-c8688fe2c7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:01.130358 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 368/721] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:14:01.173210 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0070a-6029-4821-818e-a04cb2b81b01 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:01.268635 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:01.324978 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a0070a-6029-4821-818e-a04cb2b81b01 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:01.376573 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ffc6c-b669-467d-bfe7-b31e3cef6ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:01.377587 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ffc6c-b669-467d-bfe7-b31e3cef6ce6 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:01.377874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ffc6c-b669-467d-bfe7-b31e3cef6ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:01.378152 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ffc6c-b669-467d-bfe7-b31e3cef6ce6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:01.393707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ffc6c-b669-467d-bfe7-b31e3cef6ce6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:01.402000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-974ffc6c-b669-467d-bfe7-b31e3cef6ce6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:01.402000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:01.402000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:01.402000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:01.402000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:01.402000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:01.402000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:01.402000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:01.402000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:01.402000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:01.402000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:01.402000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:01.402000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:01.402000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:01.402000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:01.402000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:01.402923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:01.402923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:01.402923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:01.402923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:01.402923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:01.402923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:01.402923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:01.402923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:01.402923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:01.402923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:01.402923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:01.402923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:01.402923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:01.402923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:01.402923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:01.402923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:01.403822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:01.403822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:01.403822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:01.403822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:01.403822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:01.403822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:01.403822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:01.403822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:01.403822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:01.403822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:01.403822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:01.403822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:01.408064 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 354/722] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:14:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:01.414088 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483bba7-ea98-4aa0-bca3-c8688fe2c7b9 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:01.567895 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7483bba7-ea98-4aa0-bca3-c8688fe2c7b9 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:01.571941 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:01.629948 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e5dda7-bbb5-4cfe-b1fb-27d92d1e71c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:01.630879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5dda7-bbb5-4cfe-b1fb-27d92d1e71c2 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:01.631161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5dda7-bbb5-4cfe-b1fb-27d92d1e71c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:01.631434 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e5dda7-bbb5-4cfe-b1fb-27d92d1e71c2 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:01.632213 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5dda7-bbb5-4cfe-b1fb-27d92d1e71c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:01.632520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5dda7-bbb5-4cfe-b1fb-27d92d1e71c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:01.633889 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e5dda7-bbb5-4cfe-b1fb-27d92d1e71c2 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:01.643461 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 369/723] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:01.649033 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ffc6c-b669-467d-bfe7-b31e3cef6ce6 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:01.810549 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ffc6c-b669-467d-bfe7-b31e3cef6ce6 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:01.854090 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:01.862153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ca140-6cf9-4780-afb7-02ccfc937a8a None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:01.862443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ca140-6cf9-4780-afb7-02ccfc937a8a None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:01.863236 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745ca140-6cf9-4780-afb7-02ccfc937a8a None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:01.865152 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 370/724] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:01.869839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8599a-dee4-4b38-801b-78c757213029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:01.870317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec2e9a-3eef-4fe8-9c87-f5c0c6e39b1d None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:01.870608 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec2e9a-3eef-4fe8-9c87-f5c0c6e39b1d None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:01.870712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8599a-dee4-4b38-801b-78c757213029 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:01.870887 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec2e9a-3eef-4fe8-9c87-f5c0c6e39b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:01.870999 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8599a-dee4-4b38-801b-78c757213029 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:01.871189 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e8599a-dee4-4b38-801b-78c757213029 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:01.887342 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8599a-dee4-4b38-801b-78c757213029 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:01.889117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e8599a-dee4-4b38-801b-78c757213029 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:01.893802 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-10ec2e9a-3eef-4fe8-9c87-f5c0c6e39b1d None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:01.895766 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-10ec2e9a-3eef-4fe8-9c87-f5c0c6e39b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:01.922088 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-e6e8599a-dee4-4b38-801b-78c757213029 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:01.922088 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:01.922088 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:01.922088 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:01.922088 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:01.922088 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:01.922088 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:01.922088 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:01.922088 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:01.922088 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:01.922088 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:01.922088 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:01.922088 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:01.922088 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:01.922088 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:01.923037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:01.923037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:01.923037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:01.923037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:01.923037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:01.923037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:01.923037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:01.923037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:01.923037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:01.923037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:01.923037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:01.923037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:01.923037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:01.923037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:01.923037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:01.923037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:01.923037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:01.924329 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:01.924329 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:01.924329 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:01.924329 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:01.929156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 355/725] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:01.936862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8599a-dee4-4b38-801b-78c757213029 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:02.042012 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 371/726] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 16 00:14:02.061055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e8599a-dee4-4b38-801b-78c757213029 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:02.091573 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec2e9a-3eef-4fe8-9c87-f5c0c6e39b1d None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:02.095693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e468893-8bac-44d9-a654-8047637ff52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:02.096363 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e468893-8bac-44d9-a654-8047637ff52a None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:02.096645 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e468893-8bac-44d9-a654-8047637ff52a None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:02.096922 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e468893-8bac-44d9-a654-8047637ff52a None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:02.097710 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e468893-8bac-44d9-a654-8047637ff52a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:02.098020 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e468893-8bac-44d9-a654-8047637ff52a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:02.099407 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e468893-8bac-44d9-a654-8047637ff52a None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:02.113553 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 356/727] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:02.118827 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e468893-8bac-44d9-a654-8047637ff52a None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:02.161568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:02.222789 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e468893-8bac-44d9-a654-8047637ff52a None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:02.258095 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e688785-ad29-41ca-a729-a005d51b3e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:02.258894 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e688785-ad29-41ca-a729-a005d51b3e9e None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:02.259176 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e688785-ad29-41ca-a729-a005d51b3e9e None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:02.259448 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e688785-ad29-41ca-a729-a005d51b3e9e None admin] PATH_INFO: `/v3/users/swift` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:02.265687 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:02.266979 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e688785-ad29-41ca-a729-a005d51b3e9e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:02.268461 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e688785-ad29-41ca-a729-a005d51b3e9e None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:02.276606 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec2e9a-3eef-4fe8-9c87-f5c0c6e39b1d None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:02.283490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-2e688785-ad29-41ca-a729-a005d51b3e9e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:14:02.283490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:02.283490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:02.283490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:02.283490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:02.283490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:02.283490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:02.283490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:02.283490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:02.283490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:02.283490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:02.283490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:02.283490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:14:02.283490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:14:02.283490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:14:02.283490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:14:02.286213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:02.286213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:02.286213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:14:02.286213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:02.286213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:14:02.286213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:02.286213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:02.286213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:02.286213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:02.286213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:02.286213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:02.286213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:02.286213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:02.286213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:02.286213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:02.286213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:02.286213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:02.286213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:02.288485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:02.288485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:02.288485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:14:02.288485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:14:02.288485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:14:02.288485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:14:02.288485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:14:02.288485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:14:02.288485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:14:02.288485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:02.288485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 357/728] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:14:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:02.292751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e688785-ad29-41ca-a729-a005d51b3e9e None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:02.337351 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72f06f-cc85-40a6-a2b2-75d70ec7e2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:02.338308 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72f06f-cc85-40a6-a2b2-75d70ec7e2f5 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:02.338598 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72f06f-cc85-40a6-a2b2-75d70ec7e2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:02.338874 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a72f06f-cc85-40a6-a2b2-75d70ec7e2f5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:02.362260 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a72f06f-cc85-40a6-a2b2-75d70ec7e2f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:02.379879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-6a72f06f-cc85-40a6-a2b2-75d70ec7e2f5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:02.379879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:02.379879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:02.379879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:02.379879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:02.379879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:02.379879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:02.379879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:02.379879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:02.379879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:02.379879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:02.379879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:02.379879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:02.379879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:02.379879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:02.379879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:02.382270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:02.382270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:02.382270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:02.382270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:02.382270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:02.382270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:02.382270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:02.382270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:02.382270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:02.382270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:02.382270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:02.382270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:02.382270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:02.382270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:02.382270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:02.382270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:02.384293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:02.384293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:02.384293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:02.384293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:02.384293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:02.384293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:02.384293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:02.384293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:02.384293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:02.384293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:02.384293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:02.384293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:02.384293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 372/729] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 00:14:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:02.390359 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:02.391695 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72f06f-cc85-40a6-a2b2-75d70ec7e2f5 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:02.393556 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e688785-ad29-41ca-a729-a005d51b3e9e None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:02.452991 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f85cb-bd68-437c-8b38-2e8cf3f50403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:02.453661 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f85cb-bd68-437c-8b38-2e8cf3f50403 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:02.453941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f85cb-bd68-437c-8b38-2e8cf3f50403 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:02.454213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6f85cb-bd68-437c-8b38-2e8cf3f50403 None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:02.457275 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f85cb-bd68-437c-8b38-2e8cf3f50403 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:02.457590 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f85cb-bd68-437c-8b38-2e8cf3f50403 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:02.459044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6f85cb-bd68-437c-8b38-2e8cf3f50403 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:02.499819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 358/730] 10.222.0.44 () {56 vars in 1135 bytes} [Thu Jun 16 00:14:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:02.501366 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f85cb-bd68-437c-8b38-2e8cf3f50403 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:02.605324 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a72f06f-cc85-40a6-a2b2-75d70ec7e2f5 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:02.611649 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6f85cb-bd68-437c-8b38-2e8cf3f50403 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:02.662521 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c419e6e-e4e9-413f-a25d-0dc5b5af1828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:02.663174 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c419e6e-e4e9-413f-a25d-0dc5b5af1828 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:02.663456 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c419e6e-e4e9-413f-a25d-0dc5b5af1828 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:02.664452 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c419e6e-e4e9-413f-a25d-0dc5b5af1828 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:02.677048 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e8d7e6-39c1-48cc-bb29-235321484067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:02.678030 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8d7e6-39c1-48cc-bb29-235321484067 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:02.678519 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8d7e6-39c1-48cc-bb29-235321484067 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:02.679019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e8d7e6-39c1-48cc-bb29-235321484067 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:02.680002 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8d7e6-39c1-48cc-bb29-235321484067 None admin] RBAC: Adding query filter params (name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:02.680515 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8d7e6-39c1-48cc-bb29-235321484067 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:02.682117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e8d7e6-39c1-48cc-bb29-235321484067 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:02.697189 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 373/731] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 00:14:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:02.697730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b6b6c-9755-465e-8d80-c053428e15b2 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:02.697837 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b6b6c-9755-465e-8d80-c053428e15b2 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:02.698086 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61b6b6c-9755-465e-8d80-c053428e15b2 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:02.699591 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 374/732] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:02.702133 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b6b6c-9755-465e-8d80-c053428e15b2 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:02.703988 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:02.728126 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:02.755322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c419e6e-e4e9-413f-a25d-0dc5b5af1828 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:02.756987 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c419e6e-e4e9-413f-a25d-0dc5b5af1828 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:02.839176 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61b6b6c-9755-465e-8d80-c053428e15b2 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:02.861974 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 359/733] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 16 00:14:02.863875 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717708c8-a713-4f41-9fd2-1812203daa6e None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:02.864168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717708c8-a713-4f41-9fd2-1812203daa6e None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:02.864444 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717708c8-a713-4f41-9fd2-1812203daa6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:02.879246 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868bd7e-22a6-4e2c-992f-8bcaaffd2a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:02.880417 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868bd7e-22a6-4e2c-992f-8bcaaffd2a88 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:02.881177 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868bd7e-22a6-4e2c-992f-8bcaaffd2a88 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:02.881678 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-717708c8-a713-4f41-9fd2-1812203daa6e None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:02.881805 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868bd7e-22a6-4e2c-992f-8bcaaffd2a88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:02.882849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-717708c8-a713-4f41-9fd2-1812203daa6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:02.893597 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868bd7e-22a6-4e2c-992f-8bcaaffd2a88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:02.895322 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868bd7e-22a6-4e2c-992f-8bcaaffd2a88 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:02.913099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-c868bd7e-22a6-4e2c-992f-8bcaaffd2a88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:02.913099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:02.913099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:02.913099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:02.913099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:02.913099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:02.913099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:02.913099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:02.913099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:02.913099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:02.913099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:02.913099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:02.913099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:02.913099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:02.913099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:02.914006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:02.914006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:02.914006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:02.914006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:02.914006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:02.914006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:02.914006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:02.914006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:02.914006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:02.914006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:02.914006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:02.914006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:02.914006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:02.914006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:02.914006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:02.914006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:02.914006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:02.920105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:02.920105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:02.920105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:02.920105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:02.920105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 375/734] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:02.920105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40868e97-cc25-462b-9f68-80b265cf6f6e None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:02.920105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40868e97-cc25-462b-9f68-80b265cf6f6e None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:02.920105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40868e97-cc25-462b-9f68-80b265cf6f6e None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:02.920105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 376/735] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:02.920614 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40868e97-cc25-462b-9f68-80b265cf6f6e None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:02.943179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:02.968189 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 360/736] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:02.968189 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717708c8-a713-4f41-9fd2-1812203daa6e None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:02.999192 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:03.038279 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40868e97-cc25-462b-9f68-80b265cf6f6e None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:03.073258 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6c6dd8-0046-4031-b500-d6e85fa51d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:03.074056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c6dd8-0046-4031-b500-d6e85fa51d47 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:03.074343 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c6dd8-0046-4031-b500-d6e85fa51d47 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:03.074625 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6c6dd8-0046-4031-b500-d6e85fa51d47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:03.082584 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717708c8-a713-4f41-9fd2-1812203daa6e None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:03.085678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c6dd8-0046-4031-b500-d6e85fa51d47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:03.087130 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6c6dd8-0046-4031-b500-d6e85fa51d47 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:03.104939 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-1b6c6dd8-0046-4031-b500-d6e85fa51d47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:03.104939 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:03.104939 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:03.104939 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:03.104939 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:03.104939 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:03.104939 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:03.104939 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:03.104939 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:03.104939 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:03.104939 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:03.104939 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:03.104939 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:03.104939 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:03.104939 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:03.105821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:03.105821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:03.105821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:03.105821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:03.105821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:03.105821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:03.105821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:03.105821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:03.105821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:03.105821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:03.105821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:03.105821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:03.105821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:03.105821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:03.105821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:03.105821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:03.105821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:03.106716 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:03.106716 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:03.106716 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:03.106716 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:03.106716 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 377/737] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:03.107407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3311a05-db47-4c3c-87be-f58d6eede8dd None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:03.107723 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3311a05-db47-4c3c-87be-f58d6eede8dd None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:03.108006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3311a05-db47-4c3c-87be-f58d6eede8dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:03.124260 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-b3311a05-db47-4c3c-87be-f58d6eede8dd None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:03.125445 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-b3311a05-db47-4c3c-87be-f58d6eede8dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:03.127693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344bbb0-438f-4a56-9a0b-d1907923c75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:03.129802 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344bbb0-438f-4a56-9a0b-d1907923c75a None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:03.130262 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344bbb0-438f-4a56-9a0b-d1907923c75a None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:03.130962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4344bbb0-438f-4a56-9a0b-d1907923c75a None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:03.131881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344bbb0-438f-4a56-9a0b-d1907923c75a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:03.132381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344bbb0-438f-4a56-9a0b-d1907923c75a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:03.134314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4344bbb0-438f-4a56-9a0b-d1907923c75a None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:03.149347 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 361/738] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:03.150896 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344bbb0-438f-4a56-9a0b-d1907923c75a None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:03.199789 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 378/739] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:03.199789 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3311a05-db47-4c3c-87be-f58d6eede8dd None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:03.219432 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:03.249778 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:03.280173 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4344bbb0-438f-4a56-9a0b-d1907923c75a None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:03.308396 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3311a05-db47-4c3c-87be-f58d6eede8dd None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:03.319872 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e6d4c-84ef-4331-82e8-e0396426b31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:03.320893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e6d4c-84ef-4331-82e8-e0396426b31b None admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:03.321179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e6d4c-84ef-4331-82e8-e0396426b31b None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:03.321459 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e6d4c-84ef-4331-82e8-e0396426b31b None admin] PATH_INFO: `/v3/services` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:03.322205 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e6d4c-84ef-4331-82e8-e0396426b31b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:03.323679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e6d4c-84ef-4331-82e8-e0396426b31b None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:03.343654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 362/740] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 00:14:03 2022] POST /identity/v3/services => generated 251 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:03.343654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e6d4c-84ef-4331-82e8-e0396426b31b None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:03.368918 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba268d1-e70d-4203-a29a-db0b164ddd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:03.369617 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba268d1-e70d-4203-a29a-db0b164ddd33 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:03.369904 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba268d1-e70d-4203-a29a-db0b164ddd33 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:03.370182 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba268d1-e70d-4203-a29a-db0b164ddd33 None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:03.370928 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba268d1-e70d-4203-a29a-db0b164ddd33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:03.371245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba268d1-e70d-4203-a29a-db0b164ddd33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:03.372705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba268d1-e70d-4203-a29a-db0b164ddd33 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:03.390878 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 379/741] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:03.390878 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba268d1-e70d-4203-a29a-db0b164ddd33 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:03.467393 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e6d4c-84ef-4331-82e8-e0396426b31b None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:03.475236 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:03.503964 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba268d1-e70d-4203-a29a-db0b164ddd33 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:03.506747 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:03.508665 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdab704-6a0a-45a4-bdde-475c94279e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:03.509481 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdab704-6a0a-45a4-bdde-475c94279e20 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:03.509765 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdab704-6a0a-45a4-bdde-475c94279e20 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:03.510046 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdab704-6a0a-45a4-bdde-475c94279e20 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:03.519928 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdab704-6a0a-45a4-bdde-475c94279e20 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:03.521397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdab704-6a0a-45a4-bdde-475c94279e20 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:03.542168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-9fdab704-6a0a-45a4-bdde-475c94279e20 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:14:03.542168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:03.542168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:03.542168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:03.542168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:03.542168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:03.542168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:03.542168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:03.542168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:03.542168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:03.542168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:03.542168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:03.542168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:14:03.542168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:14:03.542168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:14:03.542168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:14:03.543338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:03.543338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:03.543338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:14:03.543338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:03.543338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:14:03.543338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:03.543338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:03.543338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:03.543338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:03.543338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:03.543338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:03.543338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:03.543338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:03.543338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:03.543338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:03.543338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:03.543338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:03.543338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:03.544383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:03.544383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:03.544383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:14:03.544383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:14:03.544383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:14:03.544383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:14:03.544383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:14:03.544383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:14:03.544383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:14:03.544383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:03.544383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 363/742] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 16 00:14:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:03.544991 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c14e6-1bdd-41cd-9d5f-3a17724399f0 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:03.545489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c14e6-1bdd-41cd-9d5f-3a17724399f0 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:03.545489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025c14e6-1bdd-41cd-9d5f-3a17724399f0 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:03.547760 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 364/743] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:03.549058 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c14e6-1bdd-41cd-9d5f-3a17724399f0 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:03.549469 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e86449-721c-4c6a-935c-f5d8b79b88dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:03.550822 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e86449-721c-4c6a-935c-f5d8b79b88dd None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:03.551115 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e86449-721c-4c6a-935c-f5d8b79b88dd None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:03.551393 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e86449-721c-4c6a-935c-f5d8b79b88dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:03.562703 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e86449-721c-4c6a-935c-f5d8b79b88dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:03.570619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-49e86449-721c-4c6a-935c-f5d8b79b88dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:03.570619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:03.570619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:03.570619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:03.570619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:03.570619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:03.570619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:03.570619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:03.570619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:03.570619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:03.570619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:03.570619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:03.570619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:03.570619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:03.570619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:03.570619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:03.571559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:03.571559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:03.571559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:03.571559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:03.571559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:03.571559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:03.571559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:03.571559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:03.571559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:03.571559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:03.571559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:03.571559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:03.571559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:03.571559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:03.571559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:03.571559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:03.572688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:03.572688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:03.572688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:03.572688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:03.572688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:03.572688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:03.572688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:03.572688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:03.572688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:03.572688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:03.572688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:03.572688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:03.572688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 380/744] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:14:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:03.573393 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e86449-721c-4c6a-935c-f5d8b79b88dd None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:03.660280 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025c14e6-1bdd-41cd-9d5f-3a17724399f0 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:03.678509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e86449-721c-4c6a-935c-f5d8b79b88dd None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:03.695461 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de65d18-2acf-4f38-a74d-8fc5bb4e48d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:03.696530 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de65d18-2acf-4f38-a74d-8fc5bb4e48d1 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:03.696898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de65d18-2acf-4f38-a74d-8fc5bb4e48d1 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:03.697179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de65d18-2acf-4f38-a74d-8fc5bb4e48d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:03.703876 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de65d18-2acf-4f38-a74d-8fc5bb4e48d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:03.705343 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de65d18-2acf-4f38-a74d-8fc5bb4e48d1 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:03.716359 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbdd5e-03e1-4a43-b2fb-c959d9488637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:03.717305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbdd5e-03e1-4a43-b2fb-c959d9488637 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:03.717789 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbdd5e-03e1-4a43-b2fb-c959d9488637 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:03.718261 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbdd5e-03e1-4a43-b2fb-c959d9488637 None admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:03.718778 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-1de65d18-2acf-4f38-a74d-8fc5bb4e48d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:03.718778 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:03.718778 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:03.718778 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:03.718778 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:03.718778 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:03.718778 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:03.718778 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:03.718778 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:03.718778 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:03.718778 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:03.718778 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:03.718778 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:14:03.718778 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:14:03.718778 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:14:03.719654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:14:03.719654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:03.719654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:03.719654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:03.719654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:03.719654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:03.719654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:03.719654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:03.719654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:03.719654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:03.719654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:03.719654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:03.719654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:03.719654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:03.719654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:03.719654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:03.719654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:03.726107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:14:03.726107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:14:03.726107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:14:03.726107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:14:03.726107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:14:03.726107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:14:03.726107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:03.726107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:03.726107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 365/745] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:03.726595 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbdd5e-03e1-4a43-b2fb-c959d9488637 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:03.726595 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbdd5e-03e1-4a43-b2fb-c959d9488637 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:03.726753 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3b336-94d8-4e33-ae23-416f37f6fa1d None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:03.726753 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3b336-94d8-4e33-ae23-416f37f6fa1d None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:03.726753 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f3b336-94d8-4e33-ae23-416f37f6fa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:03.726940 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbdd5e-03e1-4a43-b2fb-c959d9488637 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:03.740154 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-67f3b336-94d8-4e33-ae23-416f37f6fa1d None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:03.741496 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-67f3b336-94d8-4e33-ae23-416f37f6fa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:03.742607 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 381/746] 10.222.0.44 () {56 vars in 1149 bytes} [Thu Jun 16 00:14:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:03.747589 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbdd5e-03e1-4a43-b2fb-c959d9488637 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:03.763899 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:03.772939 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:03.823712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 366/747] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:03 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 16 00:14:03.823712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3b336-94d8-4e33-ae23-416f37f6fa1d None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:03.875601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbdd5e-03e1-4a43-b2fb-c959d9488637 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:03.913954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442241f-558b-4b3e-895c-bc41a98c909b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:03.914636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442241f-558b-4b3e-895c-bc41a98c909b None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:03.914924 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442241f-558b-4b3e-895c-bc41a98c909b None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:03.915204 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442241f-558b-4b3e-895c-bc41a98c909b None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:03.915990 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442241f-558b-4b3e-895c-bc41a98c909b None admin] RBAC: Adding query filter params (name=admin) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:03.916306 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442241f-558b-4b3e-895c-bc41a98c909b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:03.917695 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6442241f-558b-4b3e-895c-bc41a98c909b None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:03.926942 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 382/748] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:03.927771 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442241f-558b-4b3e-895c-bc41a98c909b None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:03.935683 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f3b336-94d8-4e33-ae23-416f37f6fa1d None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:03.972639 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913ad63-26d6-4189-830a-58df96986b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:03.973303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913ad63-26d6-4189-830a-58df96986b5d None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:03.973589 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913ad63-26d6-4189-830a-58df96986b5d None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:03.973862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913ad63-26d6-4189-830a-58df96986b5d None admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:03.974644 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913ad63-26d6-4189-830a-58df96986b5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:03.974954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913ad63-26d6-4189-830a-58df96986b5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:03.976414 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913ad63-26d6-4189-830a-58df96986b5d None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:03.988361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 367/749] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:14:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:03.988956 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913ad63-26d6-4189-830a-58df96986b5d None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:04.009111 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:04.024534 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:04.041693 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442241f-558b-4b3e-895c-bc41a98c909b None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:04.079702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6afa6-f3b6-487f-90bf-e014af418084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:04.081184 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6afa6-f3b6-487f-90bf-e014af418084 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:04.081605 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6afa6-f3b6-487f-90bf-e014af418084 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:04.081896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea6afa6-f3b6-487f-90bf-e014af418084 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:04.095942 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913ad63-26d6-4189-830a-58df96986b5d None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:04.130187 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f61f3-92da-43f8-af79-c05f63ff9f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:04.131108 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f61f3-92da-43f8-af79-c05f63ff9f2b None admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:04.131391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f61f3-92da-43f8-af79-c05f63ff9f2b None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:04.131702 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f61f3-92da-43f8-af79-c05f63ff9f2b None admin] PATH_INFO: `/v3/services` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:04.132414 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f61f3-92da-43f8-af79-c05f63ff9f2b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:04.133784 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60f61f3-92da-43f8-af79-c05f63ff9f2b None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:04.147262 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 368/750] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 00:14:03 2022] POST /identity/v3/services => generated 240 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:04.148092 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f61f3-92da-43f8-af79-c05f63ff9f2b None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:04.171723 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea6afa6-f3b6-487f-90bf-e014af418084 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:04.174334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea6afa6-f3b6-487f-90bf-e014af418084 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:04.253525 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:04.290675 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60f61f3-92da-43f8-af79-c05f63ff9f2b None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:04.300546 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:04.324099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 383/751] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:03 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 16 00:14:04.325253 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6afa6-f3b6-487f-90bf-e014af418084 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:04.334879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef212778-b962-4d9b-a1c3-c673d6b1e8db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:04.335743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef212778-b962-4d9b-a1c3-c673d6b1e8db None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:04.336095 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef212778-b962-4d9b-a1c3-c673d6b1e8db None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:04.336370 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef212778-b962-4d9b-a1c3-c673d6b1e8db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:04.349954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef212778-b962-4d9b-a1c3-c673d6b1e8db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:04.351422 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef212778-b962-4d9b-a1c3-c673d6b1e8db None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:04.371663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-ef212778-b962-4d9b-a1c3-c673d6b1e8db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:04.371663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:04.371663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:04.371663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:04.371663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:04.371663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:04.371663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:04.371663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:04.371663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:04.371663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:04.371663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:04.371663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:04.371663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:04.371663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:04.371663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:04.372568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:04.372568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:04.372568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:04.372568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:04.372568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:04.372568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:04.372568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:04.372568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:04.372568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:04.372568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:04.372568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:04.372568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:04.372568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:04.372568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:04.372568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:04.372568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:04.372568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:04.373447 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:04.373447 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:04.373447 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:04.373447 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:04.373673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 369/752] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:04.374431 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef212778-b962-4d9b-a1c3-c673d6b1e8db None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:04.442053 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea6afa6-f3b6-487f-90bf-e014af418084 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:04.483049 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41dc35-5c0c-444a-a84b-59123f1af34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:04.483743 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41dc35-5c0c-444a-a84b-59123f1af34c None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:04.484025 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41dc35-5c0c-444a-a84b-59123f1af34c None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:04.484403 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a41dc35-5c0c-444a-a84b-59123f1af34c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:04.485244 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41dc35-5c0c-444a-a84b-59123f1af34c None admin] RBAC: Adding query filter params (role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab, scope.project.id=320d79ecbc2342af8031103e7308c10d, user.id=9918c4a8c6a64812b61fc235ab8e7bec) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:04.485562 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41dc35-5c0c-444a-a84b-59123f1af34c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:04.487115 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a41dc35-5c0c-444a-a84b-59123f1af34c None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:04.495257 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 384/753] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:04 2022] GET /identity/v3/role_assignments?user.id=9918c4a8c6a64812b61fc235ab8e7bec&scope.project.id=320d79ecbc2342af8031103e7308c10d&role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:04.496321 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41dc35-5c0c-444a-a84b-59123f1af34c None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:04.516836 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef212778-b962-4d9b-a1c3-c673d6b1e8db None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:04.548591 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:04.561368 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4a388-9eb3-4235-82db-8359e7105d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:04.564069 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4a388-9eb3-4235-82db-8359e7105d46 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:04.564357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4a388-9eb3-4235-82db-8359e7105d46 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:04.564734 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b4a388-9eb3-4235-82db-8359e7105d46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:04.573752 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:04.590938 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4a388-9eb3-4235-82db-8359e7105d46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:04.593197 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b4a388-9eb3-4235-82db-8359e7105d46 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:04.622449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-27b4a388-9eb3-4235-82db-8359e7105d46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:04.622449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:04.622449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:04.622449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:04.622449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:04.622449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:04.622449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:04.622449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:04.622449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:04.622449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:04.622449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:04.622449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:04.622449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:04.622449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:04.622449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:04.623391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:04.623391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:04.623391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:04.623391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:04.623391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:04.623391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:04.623391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:04.623391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:04.623391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:04.623391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:04.623391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:04.623391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:04.623391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:04.623391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:04.623391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:04.623391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:04.623391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:04.624315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:04.624315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:04.624315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:04.624315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:04.633780 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 370/754] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:04.639427 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4a388-9eb3-4235-82db-8359e7105d46 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:04.687508 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a41dc35-5c0c-444a-a84b-59123f1af34c None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:04.735575 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9b63e-2a08-4045-a18b-63cfbd0b0e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:04.736326 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9b63e-2a08-4045-a18b-63cfbd0b0e7b None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:04.736615 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9b63e-2a08-4045-a18b-63cfbd0b0e7b None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:04.736998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd9b63e-2a08-4045-a18b-63cfbd0b0e7b None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:04.737795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9b63e-2a08-4045-a18b-63cfbd0b0e7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:04.738107 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9b63e-2a08-4045-a18b-63cfbd0b0e7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:04.739584 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd9b63e-2a08-4045-a18b-63cfbd0b0e7b None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:04.755221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 385/755] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:04.761131 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9b63e-2a08-4045-a18b-63cfbd0b0e7b None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:04.771405 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b4a388-9eb3-4235-82db-8359e7105d46 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:04.815990 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab15f7-2b46-4cd3-be2d-7fe4a2e9ccb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:04.816665 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab15f7-2b46-4cd3-be2d-7fe4a2e9ccb2 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:04.816952 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab15f7-2b46-4cd3-be2d-7fe4a2e9ccb2 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:04.817229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eab15f7-2b46-4cd3-be2d-7fe4a2e9ccb2 None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:04.818009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab15f7-2b46-4cd3-be2d-7fe4a2e9ccb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:04.818260 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab15f7-2b46-4cd3-be2d-7fe4a2e9ccb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:04.819646 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eab15f7-2b46-4cd3-be2d-7fe4a2e9ccb2 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:04.833331 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 371/756] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:04.838851 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab15f7-2b46-4cd3-be2d-7fe4a2e9ccb2 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:04.901463 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:04.968273 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd9b63e-2a08-4045-a18b-63cfbd0b0e7b None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:04.985921 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:05.021730 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eab15f7-2b46-4cd3-be2d-7fe4a2e9ccb2 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:05.037965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbadbde-0396-41ca-98b1-aa5e999403c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:05.038778 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbadbde-0396-41ca-98b1-aa5e999403c2 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:05.039163 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbadbde-0396-41ca-98b1-aa5e999403c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:05.039448 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbadbde-0396-41ca-98b1-aa5e999403c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:05.052028 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbadbde-0396-41ca-98b1-aa5e999403c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:05.053501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbadbde-0396-41ca-98b1-aa5e999403c2 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:05.078704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-2dbadbde-0396-41ca-98b1-aa5e999403c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:14:05.078704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:05.078704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:05.078704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:05.078704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:05.078704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:05.078704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:05.078704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:05.078704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:05.078704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:05.078704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:05.078704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:05.078704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:14:05.078704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:14:05.078704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:14:05.078704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:14:05.080230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:05.080230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:05.080230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:14:05.080230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:05.080230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:14:05.080230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:05.080230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:05.080230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:05.080230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:05.080230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:05.080230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:05.080230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:05.080230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:05.080230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:05.080230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:05.080230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:05.080230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:05.080230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:05.081174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:05.081174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:05.081174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:14:05.081174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:14:05.081174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:14:05.081174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:14:05.081174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:14:05.081174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:14:05.081174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:14:05.081174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:05.089755 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7790d5-cddb-4f61-89e5-16ef54e57972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:05.090566 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7790d5-cddb-4f61-89e5-16ef54e57972 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:05.090900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7790d5-cddb-4f61-89e5-16ef54e57972 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:05.091183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7790d5-cddb-4f61-89e5-16ef54e57972 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:05.091761 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 386/757] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 16 00:14:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:05.099874 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbadbde-0396-41ca-98b1-aa5e999403c2 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:05.104501 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7790d5-cddb-4f61-89e5-16ef54e57972 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:05.110230 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7790d5-cddb-4f61-89e5-16ef54e57972 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:05.129766 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-5b7790d5-cddb-4f61-89e5-16ef54e57972 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:05.129766 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:05.129766 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:05.129766 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:05.129766 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:05.129766 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:05.129766 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:05.129766 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:05.129766 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:05.129766 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:05.129766 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:05.129766 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:05.129766 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:14:05.129766 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:14:05.129766 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:14:05.131965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:14:05.131965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:05.131965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:05.131965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:05.131965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:05.131965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:05.131965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:05.131965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:05.131965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:05.131965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:05.131965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:05.131965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:05.131965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:05.131965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:05.131965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:05.131965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:05.131965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:05.133079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:14:05.133079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:14:05.133079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:14:05.133079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:14:05.133079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:14:05.133079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:14:05.133079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:05.133079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:05.133079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 372/758] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:05.144738 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7790d5-cddb-4f61-89e5-16ef54e57972 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:05.213775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbadbde-0396-41ca-98b1-aa5e999403c2 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:05.249058 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c2904-1d17-483a-a11f-a24bce61c656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:05.249737 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c2904-1d17-483a-a11f-a24bce61c656 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:05.250023 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c2904-1d17-483a-a11f-a24bce61c656 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:05.250303 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c2904-1d17-483a-a11f-a24bce61c656 None admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:05.251147 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c2904-1d17-483a-a11f-a24bce61c656 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:05.251460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c2904-1d17-483a-a11f-a24bce61c656 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:05.252927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c2904-1d17-483a-a11f-a24bce61c656 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:05.271082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 387/759] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 16 00:14:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:05.276564 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c2904-1d17-483a-a11f-a24bce61c656 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:05.298071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:05.304304 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:05.305550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7790d5-cddb-4f61-89e5-16ef54e57972 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:05.360418 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066bc389-38ae-4c79-8e3d-4767896a6259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:05.361549 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066bc389-38ae-4c79-8e3d-4767896a6259 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:05.362026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066bc389-38ae-4c79-8e3d-4767896a6259 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:05.362612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066bc389-38ae-4c79-8e3d-4767896a6259 None admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:05.363761 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066bc389-38ae-4c79-8e3d-4767896a6259 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:05.364260 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066bc389-38ae-4c79-8e3d-4767896a6259 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:05.365965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066bc389-38ae-4c79-8e3d-4767896a6259 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:05.380045 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c2904-1d17-483a-a11f-a24bce61c656 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:05.389929 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 373/760] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:14:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:05.397327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066bc389-38ae-4c79-8e3d-4767896a6259 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:05.426954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ddc030-6078-4114-b640-18c6b4e364d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:05.427791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddc030-6078-4114-b640-18c6b4e364d4 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:05.429077 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddc030-6078-4114-b640-18c6b4e364d4 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:05.429356 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ddc030-6078-4114-b640-18c6b4e364d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:05.449920 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ddc030-6078-4114-b640-18c6b4e364d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:05.451408 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ddc030-6078-4114-b640-18c6b4e364d4 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:05.484318 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-13ddc030-6078-4114-b640-18c6b4e364d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:05.484318 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:05.484318 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:05.484318 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:05.484318 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:05.484318 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:05.484318 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:05.484318 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:05.484318 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:05.484318 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:05.484318 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:05.484318 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:05.484318 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:05.484318 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:05.484318 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:05.485248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:05.485248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:05.485248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:05.485248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:05.485248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:05.485248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:05.485248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:05.485248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:05.485248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:05.485248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:05.485248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:05.485248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:05.485248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:05.485248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:05.485248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:05.485248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:05.485248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:05.491201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:05.491201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:05.491201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:05.491201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:05.491201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 388/761] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:05.496642 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ddc030-6078-4114-b640-18c6b4e364d4 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:05.574918 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066bc389-38ae-4c79-8e3d-4767896a6259 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:05.632014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:05.661509 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f0152e-533c-416b-a02b-371b8d6d4dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:05.661829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ddc030-6078-4114-b640-18c6b4e364d4 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:05.662689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0152e-533c-416b-a02b-371b8d6d4dca None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:05.663465 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0152e-533c-416b-a02b-371b8d6d4dca None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:05.664831 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f0152e-533c-416b-a02b-371b8d6d4dca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:05.665884 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0152e-533c-416b-a02b-371b8d6d4dca None admin] RBAC: Adding query filter params (role.id=338a913607974d379aad3249b3d0402d, scope.project.id=320d79ecbc2342af8031103e7308c10d, user.id=39bbc5ff02d24f40b796bd2245a7431a) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:05.666423 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0152e-533c-416b-a02b-371b8d6d4dca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:05.668154 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f0152e-533c-416b-a02b-371b8d6d4dca None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:05.677142 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 374/762] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:05 2022] GET /identity/v3/role_assignments?user.id=39bbc5ff02d24f40b796bd2245a7431a&scope.project.id=320d79ecbc2342af8031103e7308c10d&role.id=338a913607974d379aad3249b3d0402d => generated 259 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:05.679538 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa0fcb-8c8d-4f49-b70f-a9a93dbf501f None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:05.680074 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa0fcb-8c8d-4f49-b70f-a9a93dbf501f None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:05.680835 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa0fcb-8c8d-4f49-b70f-a9a93dbf501f None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:05.687764 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 375/763] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:05.690330 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd466c9-fbcc-438e-a1be-4cf34048a8f2 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:05.691284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd466c9-fbcc-438e-a1be-4cf34048a8f2 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:05.692291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd466c9-fbcc-438e-a1be-4cf34048a8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:05.704343 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea19db-0dcc-4d64-9354-39eb51dc4265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:05.705106 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea19db-0dcc-4d64-9354-39eb51dc4265 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:05.705393 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea19db-0dcc-4d64-9354-39eb51dc4265 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:05.705673 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea19db-0dcc-4d64-9354-39eb51dc4265 None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:05.706965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea19db-0dcc-4d64-9354-39eb51dc4265 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:05.707280 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea19db-0dcc-4d64-9354-39eb51dc4265 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:05.708804 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea19db-0dcc-4d64-9354-39eb51dc4265 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:05.715687 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-7fd466c9-fbcc-438e-a1be-4cf34048a8f2 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:05.717827 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-7fd466c9-fbcc-438e-a1be-4cf34048a8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:05.728729 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 389/764] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:05.730554 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea19db-0dcc-4d64-9354-39eb51dc4265 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:05.740130 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:05.814529 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 376/765] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:05 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:14:05.846887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd466c9-fbcc-438e-a1be-4cf34048a8f2 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:05.868436 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea19db-0dcc-4d64-9354-39eb51dc4265 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:05.912693 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c858bc-d4fe-4e6d-8acf-f06243bfebe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:05.914794 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c858bc-d4fe-4e6d-8acf-f06243bfebe9 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:05.915091 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c858bc-d4fe-4e6d-8acf-f06243bfebe9 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:05.915378 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c858bc-d4fe-4e6d-8acf-f06243bfebe9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:05.935194 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c858bc-d4fe-4e6d-8acf-f06243bfebe9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:05.936749 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c858bc-d4fe-4e6d-8acf-f06243bfebe9 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:05.943946 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:05.968788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-79c858bc-d4fe-4e6d-8acf-f06243bfebe9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:05.968788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:05.968788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:05.968788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:05.968788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:05.968788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:05.968788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:05.968788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:05.968788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:05.968788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:05.968788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:05.968788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:05.968788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:14:05.968788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:14:05.968788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:14:05.969740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:14:05.969740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:05.969740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:05.969740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:05.969740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:05.969740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:05.969740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:05.969740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:05.969740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:05.969740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:05.969740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:05.969740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:05.969740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:05.969740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:05.969740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:05.969740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:05.969740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:05.970627 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:14:05.970627 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:14:05.970627 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:14:05.970627 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:14:05.970627 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:14:05.970627 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:14:05.970627 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:05.970627 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:05.973324 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 390/766] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:05.976386 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c858bc-d4fe-4e6d-8acf-f06243bfebe9 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:06.025880 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd466c9-fbcc-438e-a1be-4cf34048a8f2 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:06.062566 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d840a6-5d46-4cc8-a886-399b20f7e9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:06.063756 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d840a6-5d46-4cc8-a886-399b20f7e9c5 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:06.064805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d840a6-5d46-4cc8-a886-399b20f7e9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:06.065087 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d840a6-5d46-4cc8-a886-399b20f7e9c5 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:06.067811 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d840a6-5d46-4cc8-a886-399b20f7e9c5 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:06.071074 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d840a6-5d46-4cc8-a886-399b20f7e9c5 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:06.096631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-a4d840a6-5d46-4cc8-a886-399b20f7e9c5 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:14:06.096631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:06.096631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:14:06.096631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:14:06.096631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:14:06.096631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:14:06.096631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:14:06.096631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:06.096631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:14:06.096631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:06.096631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:14:06.096631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:06.096631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:06.096631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:06.096631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:06.096631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:06.098167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:06.098167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:06.098167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:06.098167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:06.098167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:06.098167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:06.098167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:06.098167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:14:06.098167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:14:06.098167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:14:06.098167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:14:06.098167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:06.098167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:06.098167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:06.098167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:06.098167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:06.098983 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:06.098983 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:06.098983 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:06.098983 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:06.098983 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:06.098983 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:06.098983 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:06.098983 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:06.098983 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:06.098983 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:06.098983 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:06.098983 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:14:06.098983 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:06.098983 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:14:06.098983 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:06.103415 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 377/767] 10.222.0.44 () {56 vars in 1129 bytes} [Thu Jun 16 00:14:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:06.108349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d840a6-5d46-4cc8-a886-399b20f7e9c5 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:06.144028 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:06.167787 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c858bc-d4fe-4e6d-8acf-f06243bfebe9 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:06.214621 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40010f24-7b6b-46f6-9e5d-dba8d0e09fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:06.215301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40010f24-7b6b-46f6-9e5d-dba8d0e09fc4 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:06.215586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40010f24-7b6b-46f6-9e5d-dba8d0e09fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:06.217417 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40010f24-7b6b-46f6-9e5d-dba8d0e09fc4 None admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:06.218223 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40010f24-7b6b-46f6-9e5d-dba8d0e09fc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:06.218538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40010f24-7b6b-46f6-9e5d-dba8d0e09fc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:06.224570 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40010f24-7b6b-46f6-9e5d-dba8d0e09fc4 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:06.247912 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 391/768] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:14:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:06.251148 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40010f24-7b6b-46f6-9e5d-dba8d0e09fc4 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:06.311807 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d840a6-5d46-4cc8-a886-399b20f7e9c5 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:06.367971 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:06.379184 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baee3cb-6b15-4494-9748-0e2c1ca38a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:06.379885 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baee3cb-6b15-4494-9748-0e2c1ca38a95 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:06.380235 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baee3cb-6b15-4494-9748-0e2c1ca38a95 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:06.380445 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5baee3cb-6b15-4494-9748-0e2c1ca38a95 None admin] PATH_INFO: `/v3/services` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:06.381419 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baee3cb-6b15-4494-9748-0e2c1ca38a95 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:06.381725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baee3cb-6b15-4494-9748-0e2c1ca38a95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:06.383109 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5baee3cb-6b15-4494-9748-0e2c1ca38a95 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:06.397255 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 378/769] 10.222.0.44 () {56 vars in 1124 bytes} [Thu Jun 16 00:14:06 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:06.401522 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baee3cb-6b15-4494-9748-0e2c1ca38a95 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:06.442946 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40010f24-7b6b-46f6-9e5d-dba8d0e09fc4 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:06.516241 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f6e75-87d5-4b49-9b75-d972967c416d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:06.517190 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f6e75-87d5-4b49-9b75-d972967c416d None admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:06.517476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f6e75-87d5-4b49-9b75-d972967c416d None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:06.517754 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f6e75-87d5-4b49-9b75-d972967c416d None admin] PATH_INFO: `/v3/projects/320d79ecbc2342af8031103e7308c10d/users/40432493f16b4df681daf5a1af87832a/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:06.521151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f6e75-87d5-4b49-9b75-d972967c416d None admin] RBAC: Authorizing `identity:create_grant(project_id=320d79ecbc2342af8031103e7308c10d, user_id=40432493f16b4df681daf5a1af87832a, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:06.522615 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f6e75-87d5-4b49-9b75-d972967c416d None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:06.547984 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 392/770] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 00:14:06 2022] PUT /identity/v3/projects/320d79ecbc2342af8031103e7308c10d/users/40432493f16b4df681daf5a1af87832a/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:14:06.559081 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:06.596438 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5baee3cb-6b15-4494-9748-0e2c1ca38a95 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:06.661584 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d60aeb-f49d-4a35-964f-eafaa094a9f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:06.662648 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d60aeb-f49d-4a35-964f-eafaa094a9f6 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:06.663136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d60aeb-f49d-4a35-964f-eafaa094a9f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:06.663630 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d60aeb-f49d-4a35-964f-eafaa094a9f6 None admin] PATH_INFO: `/v3/services` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:06.664549 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d60aeb-f49d-4a35-964f-eafaa094a9f6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:06.665083 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d60aeb-f49d-4a35-964f-eafaa094a9f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:06.666680 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d60aeb-f49d-4a35-964f-eafaa094a9f6 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:06.676981 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 379/771] 10.222.0.44 () {56 vars in 1124 bytes} [Thu Jun 16 00:14:06 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:06.682990 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f6e75-87d5-4b49-9b75-d972967c416d None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:06.808070 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528992f-1be5-4d2f-99f9-747156db5000 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:06.808653 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528992f-1be5-4d2f-99f9-747156db5000 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:06.809265 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1528992f-1be5-4d2f-99f9-747156db5000 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:06.810699 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 380/772] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:06.818136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cdf60-e5be-4676-b874-98fbe95dc566 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:06.818415 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cdf60-e5be-4676-b874-98fbe95dc566 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:06.818690 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278cdf60-e5be-4676-b874-98fbe95dc566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:06.831553 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f6e75-87d5-4b49-9b75-d972967c416d None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:06.840554 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-278cdf60-e5be-4676-b874-98fbe95dc566 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:06.841841 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-278cdf60-e5be-4676-b874-98fbe95dc566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:06.850266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:06.871593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ed1a3-94b7-4b27-90aa-47b1b7b2e3d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:06.872397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ed1a3-94b7-4b27-90aa-47b1b7b2e3d2 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:06.872686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ed1a3-94b7-4b27-90aa-47b1b7b2e3d2 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:06.872966 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ed1a3-94b7-4b27-90aa-47b1b7b2e3d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:06.873760 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ed1a3-94b7-4b27-90aa-47b1b7b2e3d2 None admin] RBAC: Adding query filter params (interface=public, service_id=16ab63cb673841b0adf653d0e1f1517f, region_id=RegionOne) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:06.874074 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ed1a3-94b7-4b27-90aa-47b1b7b2e3d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:06.875448 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521ed1a3-94b7-4b27-90aa-47b1b7b2e3d2 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:06.887042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 393/773] 10.222.0.44 () {56 vars in 1251 bytes} [Thu Jun 16 00:14:06 2022] GET /identity/v3/endpoints?service_id=16ab63cb673841b0adf653d0e1f1517f&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:06.892129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ed1a3-94b7-4b27-90aa-47b1b7b2e3d2 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:06.969202 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 381/774] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:14:07.013505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ed1a3-94b7-4b27-90aa-47b1b7b2e3d2 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:07.025092 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278cdf60-e5be-4676-b874-98fbe95dc566 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:07.049064 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170d7de4-4d8b-4be8-8d7e-ad93483b0a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:07.049744 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d7de4-4d8b-4be8-8d7e-ad93483b0a0d None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:07.050096 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d7de4-4d8b-4be8-8d7e-ad93483b0a0d None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:07.050382 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170d7de4-4d8b-4be8-8d7e-ad93483b0a0d None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:07.051074 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d7de4-4d8b-4be8-8d7e-ad93483b0a0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:07.052648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170d7de4-4d8b-4be8-8d7e-ad93483b0a0d None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:07.058590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 394/775] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 16 00:14:06 2022] GET /identity/v3/services => generated 772 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:07.150008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28261a59-6c20-4fcb-9a8f-d17f31aaf927 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:07.150314 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28261a59-6c20-4fcb-9a8f-d17f31aaf927 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:07.150481 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28261a59-6c20-4fcb-9a8f-d17f31aaf927 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:07.152270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 395/776] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:07.160155 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044a948-cc1c-450a-872b-781e83160fda None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:07.160469 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044a948-cc1c-450a-872b-781e83160fda None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:07.160718 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a044a948-cc1c-450a-872b-781e83160fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:07.173716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:07.196847 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-a044a948-cc1c-450a-872b-781e83160fda None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:07.199316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-a044a948-cc1c-450a-872b-781e83160fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:07.239294 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278cdf60-e5be-4676-b874-98fbe95dc566 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:07.284867 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:07.298346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb17123-5415-48ed-996a-3c8e37869653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:07.299143 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb17123-5415-48ed-996a-3c8e37869653 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:07.299422 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb17123-5415-48ed-996a-3c8e37869653 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:07.299718 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb17123-5415-48ed-996a-3c8e37869653 None admin] PATH_INFO: `/v3/services/network` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:07.300916 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb17123-5415-48ed-996a-3c8e37869653 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:07.302763 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb17123-5415-48ed-996a-3c8e37869653 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:07.317414 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 396/777] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:07.318019 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-9eb17123-5415-48ed-996a-3c8e37869653 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:14:07.318019 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:07.318019 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:14:07.318019 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:14:07.318019 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:14:07.318019 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:14:07.318019 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:14:07.318019 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:07.318019 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:14:07.318019 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:07.318019 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:14:07.318019 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:07.318019 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:07.318019 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:07.318019 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:07.318019 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:07.318019 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:07.318959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:07.318959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:07.318959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:07.318959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:07.318959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:07.318959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:07.318959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:14:07.318959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:14:07.318959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:14:07.318959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:14:07.318959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:07.318959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:07.318959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:07.318959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:07.318959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:07.318959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:07.319815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:07.319815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:07.319815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:07.319815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:07.319815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:07.319815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:07.319815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:07.319815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:07.319815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:07.319815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:07.319815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:14:07.319815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:07.319815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:14:07.319815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:07.319815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 382/778] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:07 2022] GET /identity/v3/services/network => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:07.325013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044a948-cc1c-450a-872b-781e83160fda None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:07.340309 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb17123-5415-48ed-996a-3c8e37869653 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:07.483654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a044a948-cc1c-450a-872b-781e83160fda None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:07.520278 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16dd65-b15b-461b-9566-e5b94ed46cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:07.521193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16dd65-b15b-461b-9566-e5b94ed46cc1 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:07.521694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16dd65-b15b-461b-9566-e5b94ed46cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:07.522146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd16dd65-b15b-461b-9566-e5b94ed46cc1 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:07.523042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16dd65-b15b-461b-9566-e5b94ed46cc1 None admin] RBAC: Adding query filter params (name=network) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:07.523518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16dd65-b15b-461b-9566-e5b94ed46cc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:07.525231 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd16dd65-b15b-461b-9566-e5b94ed46cc1 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:07.528121 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb17123-5415-48ed-996a-3c8e37869653 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:07.530767 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 397/779] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 16 00:14:07 2022] GET /identity/v3/services?name=network => generated 124 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:07.536663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16dd65-b15b-461b-9566-e5b94ed46cc1 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:07.587834 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58373d-304f-470d-ba95-aca10bf9b2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:07.589046 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58373d-304f-470d-ba95-aca10bf9b2b4 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:07.589576 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58373d-304f-470d-ba95-aca10bf9b2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:07.590046 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c58373d-304f-470d-ba95-aca10bf9b2b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:07.592545 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:07.594372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:07.606815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c58373d-304f-470d-ba95-aca10bf9b2b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:07.615309 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-1c58373d-304f-470d-ba95-aca10bf9b2b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:07.615309 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:07.615309 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:07.615309 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:07.615309 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:07.615309 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:07.615309 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:07.615309 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:07.615309 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:07.615309 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:07.615309 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:07.615309 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:07.615309 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:07.615309 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:07.615309 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:07.615309 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:07.616284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:07.616284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:07.616284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:07.616284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:07.616284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:07.616284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:07.616284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:07.616284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:07.616284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:07.616284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:07.616284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:07.616284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:07.616284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:07.616284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:07.616284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:07.616284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:07.617113 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:07.617113 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:07.617113 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:07.617113 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:07.617113 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:07.617113 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:07.617113 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:07.617113 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:07.617113 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:07.617113 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:07.617113 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:07.617113 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:07.620033 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 383/780] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:14:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:07.625445 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58373d-304f-470d-ba95-aca10bf9b2b4 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:07.705042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd16dd65-b15b-461b-9566-e5b94ed46cc1 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:07.768271 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9c276-4729-4fb3-be74-0e2bf0ac35a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:07.770507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9c276-4729-4fb3-be74-0e2bf0ac35a7 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:07.770992 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9c276-4729-4fb3-be74-0e2bf0ac35a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:07.771723 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce9c276-4729-4fb3-be74-0e2bf0ac35a7 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:07.773328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9c276-4729-4fb3-be74-0e2bf0ac35a7 None admin] RBAC: Adding query filter params (type=network) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:07.774020 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9c276-4729-4fb3-be74-0e2bf0ac35a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:07.776884 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce9c276-4729-4fb3-be74-0e2bf0ac35a7 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:07.785520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 398/781] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 16 00:14:07 2022] GET /identity/v3/services?type=network => generated 350 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:07.790820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9c276-4729-4fb3-be74-0e2bf0ac35a7 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:07.819443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c58373d-304f-470d-ba95-aca10bf9b2b4 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:07.866679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f8cd4-1265-47e7-ae13-2c66a7f80a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:07.867352 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f8cd4-1265-47e7-ae13-2c66a7f80a83 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:07.867643 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f8cd4-1265-47e7-ae13-2c66a7f80a83 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:07.867927 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50f8cd4-1265-47e7-ae13-2c66a7f80a83 None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:07.868706 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f8cd4-1265-47e7-ae13-2c66a7f80a83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:07.869077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f8cd4-1265-47e7-ae13-2c66a7f80a83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:07.870503 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50f8cd4-1265-47e7-ae13-2c66a7f80a83 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:07.880394 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 384/782] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:07.886141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f8cd4-1265-47e7-ae13-2c66a7f80a83 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:07.973763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce9c276-4729-4fb3-be74-0e2bf0ac35a7 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:07.976289 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:08.007649 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:08.015454 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d7b78-89cd-415b-a39a-727111a8ff95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:08.016196 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d7b78-89cd-415b-a39a-727111a8ff95 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:08.016481 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d7b78-89cd-415b-a39a-727111a8ff95 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:08.016762 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410d7b78-89cd-415b-a39a-727111a8ff95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:08.018160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d7b78-89cd-415b-a39a-727111a8ff95 None admin] RBAC: Adding query filter params (interface=public, service_id=ce92e591a7114690b6d9bb931ca34f83, region_id=RegionOne) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:08.018543 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d7b78-89cd-415b-a39a-727111a8ff95 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:08.020659 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410d7b78-89cd-415b-a39a-727111a8ff95 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:08.027600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 399/783] 10.222.0.44 () {56 vars in 1251 bytes} [Thu Jun 16 00:14:07 2022] GET /identity/v3/endpoints?service_id=ce92e591a7114690b6d9bb931ca34f83&interface=public®ion_id=RegionOne => generated 194 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:08.032795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d7b78-89cd-415b-a39a-727111a8ff95 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:08.080769 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50f8cd4-1265-47e7-ae13-2c66a7f80a83 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:08.121414 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d383e-c16f-4ab3-ac7e-4d1ee6c123af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:08.122630 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d383e-c16f-4ab3-ac7e-4d1ee6c123af None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:08.122967 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d383e-c16f-4ab3-ac7e-4d1ee6c123af None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:08.123248 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d383e-c16f-4ab3-ac7e-4d1ee6c123af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:08.136342 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d383e-c16f-4ab3-ac7e-4d1ee6c123af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:08.137811 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d383e-c16f-4ab3-ac7e-4d1ee6c123af None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:08.155631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-f08d383e-c16f-4ab3-ac7e-4d1ee6c123af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:08.155631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:08.155631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:08.155631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:08.155631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:08.155631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:08.155631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:08.155631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:08.155631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:08.155631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:08.155631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:08.155631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:08.155631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:08.155631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:08.155631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:08.156545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:08.156545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:08.156545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:08.156545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:08.156545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:08.156545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:08.156545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:08.156545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:08.156545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:08.156545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:08.156545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:08.156545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:08.156545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:08.156545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:08.156545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:08.156545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:08.156545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:08.157460 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:08.157460 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:08.157460 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:08.157460 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:08.157460 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 385/784] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:08.162496 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940a737-caca-46b1-9570-0efba6035594 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:08.162496 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940a737-caca-46b1-9570-0efba6035594 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:08.162496 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f940a737-caca-46b1-9570-0efba6035594 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:08.164434 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 386/785] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:08.165212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940a737-caca-46b1-9570-0efba6035594 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:08.212799 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410d7b78-89cd-415b-a39a-727111a8ff95 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:08.260042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0256c60-d3ee-4230-b723-37eb375759f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:08.260952 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0256c60-d3ee-4230-b723-37eb375759f6 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:08.261239 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0256c60-d3ee-4230-b723-37eb375759f6 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:08.261518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0256c60-d3ee-4230-b723-37eb375759f6 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:08.262622 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0256c60-d3ee-4230-b723-37eb375759f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:08.264593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0256c60-d3ee-4230-b723-37eb375759f6 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:08.271637 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 400/786] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 16 00:14:08 2022] GET /identity/v3/services => generated 772 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:08.272824 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1da93-cf2f-47f6-9236-0cf0db3abe9e None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:08.273109 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1da93-cf2f-47f6-9236-0cf0db3abe9e None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:08.273386 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d1da93-cf2f-47f6-9236-0cf0db3abe9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:08.276128 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f940a737-caca-46b1-9570-0efba6035594 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:08.305414 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:08.312396 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-d0d1da93-cf2f-47f6-9236-0cf0db3abe9e None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:08.317455 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-d0d1da93-cf2f-47f6-9236-0cf0db3abe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:08.366184 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4355261-e718-434d-9ee6-fe8501416c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:08.366868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4355261-e718-434d-9ee6-fe8501416c77 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:08.367151 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4355261-e718-434d-9ee6-fe8501416c77 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:08.367428 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4355261-e718-434d-9ee6-fe8501416c77 None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:08.368191 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4355261-e718-434d-9ee6-fe8501416c77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:08.368497 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4355261-e718-434d-9ee6-fe8501416c77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:08.369884 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4355261-e718-434d-9ee6-fe8501416c77 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:08.379130 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:08.398005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 387/787] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:08.404255 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4355261-e718-434d-9ee6-fe8501416c77 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:08.431724 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 401/788] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:08.463385 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1da93-cf2f-47f6-9236-0cf0db3abe9e None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:08.586840 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d1da93-cf2f-47f6-9236-0cf0db3abe9e None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:08.597004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4355261-e718-434d-9ee6-fe8501416c77 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:08.653448 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76efb2f-8b6e-4530-85b4-155fc7087e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:08.654255 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76efb2f-8b6e-4530-85b4-155fc7087e6e None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:08.654543 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76efb2f-8b6e-4530-85b4-155fc7087e6e None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:08.654824 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76efb2f-8b6e-4530-85b4-155fc7087e6e None admin] PATH_INFO: `/v3/roles/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:08.655958 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8677e1-3dd7-418b-aa8b-5d97a637e7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:08.656750 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8677e1-3dd7-418b-aa8b-5d97a637e7c3 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:08.657034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8677e1-3dd7-418b-aa8b-5d97a637e7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:08.657307 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8677e1-3dd7-418b-aa8b-5d97a637e7c3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:08.668463 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8677e1-3dd7-418b-aa8b-5d97a637e7c3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:08.669920 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8677e1-3dd7-418b-aa8b-5d97a637e7c3 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:08.682096 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76efb2f-8b6e-4530-85b4-155fc7087e6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:08.689926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-e76efb2f-8b6e-4530-85b4-155fc7087e6e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:08.689926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:08.689926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:08.689926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:08.689926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:08.689926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:08.689926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:08.689926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:08.689926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:08.689926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:08.689926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:08.689926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:08.689926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:08.689926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:08.689926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:08.689926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:08.691437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:08.691437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:08.691437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:08.691437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:08.691437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:08.691437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:08.691437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:08.691437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:08.691437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:08.691437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:08.691437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:08.691437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:08.691437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:08.691437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:08.691437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:08.691437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:08.693221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:08.693221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:08.693221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:08.693221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:08.693221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:08.693221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:08.693221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:08.693221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:08.693221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:08.693221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:08.693221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:08.693221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:08.693221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 402/789] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 00:14:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:08.704009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-8f8677e1-3dd7-418b-aa8b-5d97a637e7c3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:14:08.704009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:08.704009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:08.704009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:08.704009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:08.704009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:08.704009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:08.704009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:08.704009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:08.704009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:08.704009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:08.704009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:08.704009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:14:08.704009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:14:08.704009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:14:08.704009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:14:08.705883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:08.705883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:08.705883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:14:08.705883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:08.705883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:14:08.705883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:08.705883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:08.705883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:08.705883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:08.705883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:08.705883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:08.705883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:08.705883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:08.705883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:08.705883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:08.705883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:08.705883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:08.705883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:08.708478 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:08.708478 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:08.708478 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:14:08.708478 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:14:08.708478 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:14:08.708478 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:14:08.708478 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:14:08.708478 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:14:08.708478 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:14:08.708478 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:08.708478 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 388/790] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:14:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:08.709693 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76efb2f-8b6e-4530-85b4-155fc7087e6e None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:08.720569 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8677e1-3dd7-418b-aa8b-5d97a637e7c3 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:08.752370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:08.770603 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:08.903022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8677e1-3dd7-418b-aa8b-5d97a637e7c3 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:08.906227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76efb2f-8b6e-4530-85b4-155fc7087e6e None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:08.970185 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf176c-c3f2-4c80-b7ec-672f2734a4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:08.970862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf176c-c3f2-4c80-b7ec-672f2734a4a2 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:08.971144 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf176c-c3f2-4c80-b7ec-672f2734a4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:08.971417 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bf176c-c3f2-4c80-b7ec-672f2734a4a2 None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:08.972853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf176c-c3f2-4c80-b7ec-672f2734a4a2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:08.973164 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf176c-c3f2-4c80-b7ec-672f2734a4a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:08.973928 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee401be0-806e-4935-8817-107a459b92da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:08.974645 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee401be0-806e-4935-8817-107a459b92da None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:08.974928 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee401be0-806e-4935-8817-107a459b92da None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:08.975198 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee401be0-806e-4935-8817-107a459b92da None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:08.975978 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee401be0-806e-4935-8817-107a459b92da None admin] RBAC: Adding query filter params (name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:08.976286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee401be0-806e-4935-8817-107a459b92da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:08.977662 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee401be0-806e-4935-8817-107a459b92da None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:08.980679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bf176c-c3f2-4c80-b7ec-672f2734a4a2 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:08.996030 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 403/791] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 00:14:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:09.001472 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee401be0-806e-4935-8817-107a459b92da None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:09.016456 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 389/792] 10.222.0.44 () {56 vars in 1135 bytes} [Thu Jun 16 00:14:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:09.022026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf176c-c3f2-4c80-b7ec-672f2734a4a2 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:09.179195 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:09.186598 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:09.201473 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee401be0-806e-4935-8817-107a459b92da None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:09.202946 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bf176c-c3f2-4c80-b7ec-672f2734a4a2 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:09.239336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5dc9a-687e-4136-87bd-87f9effdeaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:09.240690 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5dc9a-687e-4136-87bd-87f9effdeaa7 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:09.241213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5dc9a-687e-4136-87bd-87f9effdeaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:09.241699 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5dc9a-687e-4136-87bd-87f9effdeaa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:09.244518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16812904-29bb-4b05-ae13-db87887d317d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:09.245644 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16812904-29bb-4b05-ae13-db87887d317d None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:09.245937 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16812904-29bb-4b05-ae13-db87887d317d None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:09.246220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16812904-29bb-4b05-ae13-db87887d317d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:09.254643 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5dc9a-687e-4136-87bd-87f9effdeaa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:09.256760 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5dc9a-687e-4136-87bd-87f9effdeaa7 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:09.259322 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16812904-29bb-4b05-ae13-db87887d317d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:09.261090 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16812904-29bb-4b05-ae13-db87887d317d None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:09.276250 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-52f5dc9a-687e-4136-87bd-87f9effdeaa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:09.276250 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:09.276250 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:09.276250 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:09.276250 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:09.276250 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:09.276250 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:09.276250 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:09.276250 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:09.276250 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:09.276250 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:09.276250 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:09.276250 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:09.276250 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:09.276250 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:09.277506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:09.277506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:09.277506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:09.277506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:09.277506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:09.277506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:09.277506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:09.277506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:09.277506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:09.277506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:09.277506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:09.277506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:09.277506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:09.277506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:09.277506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:09.277506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:09.277506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:09.278408 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:09.278408 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:09.278408 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:09.278408 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:09.279694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-16812904-29bb-4b05-ae13-db87887d317d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:09.279694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:09.279694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:09.279694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:09.279694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:09.279694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:09.279694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:09.279694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:09.279694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:09.279694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:09.279694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:09.279694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:09.279694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:09.279694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:09.279694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:09.280520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:09.280520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:09.280520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:09.280520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:09.280520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:09.280520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:09.280520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:09.280520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:09.280520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:09.280520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:09.280520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:09.280520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:09.280520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:09.280520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:09.280520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:09.280520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:09.280520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:09.281406 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:09.281406 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:09.281406 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:09.281406 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:09.281406 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 404/793] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:09.282528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90e6c9-1a6f-4607-8985-4693bdd35437 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:09.282815 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90e6c9-1a6f-4607-8985-4693bdd35437 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:09.283196 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90e6c9-1a6f-4607-8985-4693bdd35437 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:09.287719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 405/794] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:09.287719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90e6c9-1a6f-4607-8985-4693bdd35437 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:09.288269 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 390/795] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:09.292099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5dc9a-687e-4136-87bd-87f9effdeaa7 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:09.403281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5dc9a-687e-4136-87bd-87f9effdeaa7 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:09.414606 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90e6c9-1a6f-4607-8985-4693bdd35437 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:09.454355 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79703f-4626-4b38-816f-a643b55f8fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:09.454945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79703f-4626-4b38-816f-a643b55f8fac None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:09.455228 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79703f-4626-4b38-816f-a643b55f8fac None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:09.455503 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79703f-4626-4b38-816f-a643b55f8fac None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:09.456779 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79703f-4626-4b38-816f-a643b55f8fac None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:09.457091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79703f-4626-4b38-816f-a643b55f8fac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:09.458345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55563e3e-2e72-47be-aab5-f9e5585e8e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:09.458468 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79703f-4626-4b38-816f-a643b55f8fac None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:09.459322 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55563e3e-2e72-47be-aab5-f9e5585e8e18 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:09.459932 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55563e3e-2e72-47be-aab5-f9e5585e8e18 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:09.460481 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55563e3e-2e72-47be-aab5-f9e5585e8e18 None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:09.461508 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55563e3e-2e72-47be-aab5-f9e5585e8e18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:09.462019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55563e3e-2e72-47be-aab5-f9e5585e8e18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:09.463691 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55563e3e-2e72-47be-aab5-f9e5585e8e18 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:09.466959 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:09.468717 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:09.477170 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 391/796] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:09.477170 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548cfe3-77cf-4fdc-ad29-4fc7183652e7 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:09.477170 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548cfe3-77cf-4fdc-ad29-4fc7183652e7 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:09.477170 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6548cfe3-77cf-4fdc-ad29-4fc7183652e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:09.485375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 406/797] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:09.486860 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49577fb-447d-43db-85c6-7eb3e367ecd7 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:09.487886 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49577fb-447d-43db-85c6-7eb3e367ecd7 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:09.488372 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49577fb-447d-43db-85c6-7eb3e367ecd7 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:09.489780 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 407/798] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:09.490709 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49577fb-447d-43db-85c6-7eb3e367ecd7 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:09.498214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-6548cfe3-77cf-4fdc-ad29-4fc7183652e7 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:09.499823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-6548cfe3-77cf-4fdc-ad29-4fc7183652e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:09.575761 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 392/799] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:09.576905 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548cfe3-77cf-4fdc-ad29-4fc7183652e7 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:09.600892 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49577fb-447d-43db-85c6-7eb3e367ecd7 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:09.641569 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c784116-2b3b-47e4-9fe1-2cf99d43eb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:09.642519 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c784116-2b3b-47e4-9fe1-2cf99d43eb79 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:09.642801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c784116-2b3b-47e4-9fe1-2cf99d43eb79 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:09.643092 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c784116-2b3b-47e4-9fe1-2cf99d43eb79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:09.650535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c784116-2b3b-47e4-9fe1-2cf99d43eb79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:09.652041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c784116-2b3b-47e4-9fe1-2cf99d43eb79 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:09.665883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-7c784116-2b3b-47e4-9fe1-2cf99d43eb79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:09.665883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:09.665883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:09.665883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:09.665883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:09.665883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:09.665883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:09.665883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:09.665883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:09.665883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:09.665883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:09.665883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:09.665883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:14:09.665883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:14:09.665883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:14:09.666923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:14:09.666923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:09.666923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:09.666923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:09.666923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:09.666923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:09.666923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:09.666923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:09.666923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:09.666923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:09.666923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:09.666923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:09.666923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:09.666923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:09.666923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:09.666923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:09.666923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:09.667964 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:14:09.667964 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:14:09.667964 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:14:09.667964 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:14:09.667964 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:14:09.667964 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:14:09.667964 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:09.667964 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:09.674099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 408/800] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:09.674099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc32f1-363c-4b62-a10e-788c9ffee510 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:09.674099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc32f1-363c-4b62-a10e-788c9ffee510 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:09.674099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc32f1-363c-4b62-a10e-788c9ffee510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:09.687650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6548cfe3-77cf-4fdc-ad29-4fc7183652e7 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:09.693693 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-68fc32f1-363c-4b62-a10e-788c9ffee510 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:09.695316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-68fc32f1-363c-4b62-a10e-788c9ffee510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:09.717112 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:09.723954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1b496-e48d-4ffc-abf4-2584432df629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:09.724767 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1b496-e48d-4ffc-abf4-2584432df629 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:09.725041 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1b496-e48d-4ffc-abf4-2584432df629 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:09.725313 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f1b496-e48d-4ffc-abf4-2584432df629 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:09.732605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1b496-e48d-4ffc-abf4-2584432df629 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:09.734066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f1b496-e48d-4ffc-abf4-2584432df629 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:09.749053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-36f1b496-e48d-4ffc-abf4-2584432df629 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:14:09.749053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:09.749053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:09.749053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:09.749053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:09.749053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:09.749053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:09.749053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:09.749053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:09.749053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:09.749053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:09.749053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:09.749053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:14:09.749053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:14:09.749053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:14:09.749053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:14:09.749992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:09.749992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:09.749992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:14:09.749992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:09.749992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:14:09.749992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:09.749992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:09.749992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:09.749992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:09.749992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:09.749992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:09.749992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:09.749992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:09.749992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:09.749992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:09.749992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:09.749992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:09.749992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:09.750921 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:09.750921 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:09.750921 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:14:09.750921 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:14:09.750921 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:14:09.750921 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:14:09.750921 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:14:09.750921 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:14:09.750921 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:14:09.750921 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:09.750921 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 393/801] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 16 00:14:09 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:09.751501 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1b496-e48d-4ffc-abf4-2584432df629 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:09.757843 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:09.783635 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 409/802] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:09.783635 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc32f1-363c-4b62-a10e-788c9ffee510 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:09.872963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f1b496-e48d-4ffc-abf4-2584432df629 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:09.900336 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc32f1-363c-4b62-a10e-788c9ffee510 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:09.911768 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b09453-9e84-4310-b7b2-91b4b50c9443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:09.912823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b09453-9e84-4310-b7b2-91b4b50c9443 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:09.913285 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b09453-9e84-4310-b7b2-91b4b50c9443 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:09.913728 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b09453-9e84-4310-b7b2-91b4b50c9443 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:09.925240 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b09453-9e84-4310-b7b2-91b4b50c9443 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:09.933201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-74b09453-9e84-4310-b7b2-91b4b50c9443 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:09.933201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:09.933201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:09.933201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:09.933201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:09.933201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:09.933201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:09.933201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:09.933201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:09.933201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:09.933201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:09.933201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:09.933201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:09.933201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:09.933201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:09.933201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:09.934312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:09.934312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:09.934312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:09.934312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:09.934312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:09.934312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:09.934312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:09.934312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:09.934312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:09.934312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:09.934312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:09.934312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:09.934312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:09.934312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:09.934312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:09.934312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:09.935346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:09.935346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:09.935346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:09.935346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:09.935346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:09.935346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:09.935346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:09.935346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:09.935346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:09.935346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:09.935346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:09.935346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:09.936179 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb65a3c-d7ca-4356-b56f-799d8cdc6bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:09.936179 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb65a3c-d7ca-4356-b56f-799d8cdc6bc0 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:09.936179 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb65a3c-d7ca-4356-b56f-799d8cdc6bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:09.936179 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb65a3c-d7ca-4356-b56f-799d8cdc6bc0 None admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:09.936440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb65a3c-d7ca-4356-b56f-799d8cdc6bc0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:09.936693 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb65a3c-d7ca-4356-b56f-799d8cdc6bc0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:09.939682 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb65a3c-d7ca-4356-b56f-799d8cdc6bc0 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:09.943552 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 394/803] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:14:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:09.944413 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b09453-9e84-4310-b7b2-91b4b50c9443 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:09.953831 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 410/804] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:14:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:09.954516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb65a3c-d7ca-4356-b56f-799d8cdc6bc0 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:10.001503 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:10.005077 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:10.052983 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b09453-9e84-4310-b7b2-91b4b50c9443 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:10.066155 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb65a3c-d7ca-4356-b56f-799d8cdc6bc0 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:10.086268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabe1b4-c988-401b-96ac-0d31a64ae6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:10.086936 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabe1b4-c988-401b-96ac-0d31a64ae6c7 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:10.087220 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabe1b4-c988-401b-96ac-0d31a64ae6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:10.087494 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabe1b4-c988-401b-96ac-0d31a64ae6c7 None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:10.088349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccabe1b4-c988-401b-96ac-0d31a64ae6c7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:10.088662 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccabe1b4-c988-401b-96ac-0d31a64ae6c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:10.090107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccabe1b4-c988-401b-96ac-0d31a64ae6c7 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:10.102117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a140e-adea-455c-acec-e529f46ffacf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:10.103166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a140e-adea-455c-acec-e529f46ffacf None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:10.103688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a140e-adea-455c-acec-e529f46ffacf None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:10.104215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28a140e-adea-455c-acec-e529f46ffacf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:10.105059 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a140e-adea-455c-acec-e529f46ffacf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:10.106619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28a140e-adea-455c-acec-e529f46ffacf None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:10.107169 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 395/805] 10.222.0.44 () {56 vars in 1149 bytes} [Thu Jun 16 00:14:09 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:10.107994 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabe1b4-c988-401b-96ac-0d31a64ae6c7 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:10.126557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-b28a140e-adea-455c-acec-e529f46ffacf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:14:10.126557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:10.126557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:14:10.126557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:14:10.126557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:14:10.126557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:14:10.126557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:14:10.126557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:10.126557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:14:10.126557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:10.126557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:14:10.126557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:10.126557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:10.126557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:10.126557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:10.126557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:10.127528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:10.127528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:10.127528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:10.127528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:10.127528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:10.127528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:10.127528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:10.127528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:14:10.127528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:14:10.127528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:14:10.127528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:14:10.127528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:10.127528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:10.127528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:10.127528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:10.127528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:10.128481 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:10.128481 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:10.128481 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:10.128481 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:10.128481 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:10.128481 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:10.128481 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:10.128481 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:10.128481 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:10.128481 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:10.128481 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:10.128481 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:14:10.128481 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:10.128481 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 16 00:14:10.128481 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:10.131022 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 411/806] 10.222.0.44 () {56 vars in 1129 bytes} [Thu Jun 16 00:14:09 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:10.131960 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a140e-adea-455c-acec-e529f46ffacf None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:10.219741 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabe1b4-c988-401b-96ac-0d31a64ae6c7 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:10.229132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:10.239769 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28a140e-adea-455c-acec-e529f46ffacf None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:10.250567 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:10.257798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5a495-6c56-477f-8b5a-599cddab3745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:10.258587 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5a495-6c56-477f-8b5a-599cddab3745 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:10.258715 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5a495-6c56-477f-8b5a-599cddab3745 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:10.258946 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5a495-6c56-477f-8b5a-599cddab3745 None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:10.259712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5a495-6c56-477f-8b5a-599cddab3745 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:10.260019 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5a495-6c56-477f-8b5a-599cddab3745 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:10.261388 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5a495-6c56-477f-8b5a-599cddab3745 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:10.274556 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 396/807] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:10.274556 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5a495-6c56-477f-8b5a-599cddab3745 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:10.281344 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b7466-6c7a-4543-8082-4d3944dca5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:10.282608 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b7466-6c7a-4543-8082-4d3944dca5f9 None admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:10.283189 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b7466-6c7a-4543-8082-4d3944dca5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:10.283485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b7466-6c7a-4543-8082-4d3944dca5f9 None admin] PATH_INFO: `/v3/projects/320d79ecbc2342af8031103e7308c10d/users/9918c4a8c6a64812b61fc235ab8e7bec/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:10.285611 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b7466-6c7a-4543-8082-4d3944dca5f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=320d79ecbc2342af8031103e7308c10d, user_id=9918c4a8c6a64812b61fc235ab8e7bec, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:10.287072 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b7466-6c7a-4543-8082-4d3944dca5f9 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:10.311646 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 412/808] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 00:14:10 2022] PUT /identity/v3/projects/320d79ecbc2342af8031103e7308c10d/users/9918c4a8c6a64812b61fc235ab8e7bec/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:14:10.311646 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b7466-6c7a-4543-8082-4d3944dca5f9 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:10.406916 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5a495-6c56-477f-8b5a-599cddab3745 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:10.445972 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b6f9b-a26f-4e1a-ad88-c8d6b2a91737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:10.446903 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b6f9b-a26f-4e1a-ad88-c8d6b2a91737 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:10.447296 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b6f9b-a26f-4e1a-ad88-c8d6b2a91737 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:10.447662 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5b6f9b-a26f-4e1a-ad88-c8d6b2a91737 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:10.449193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b7466-6c7a-4543-8082-4d3944dca5f9 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:10.461401 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b6f9b-a26f-4e1a-ad88-c8d6b2a91737 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:10.462977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5b6f9b-a26f-4e1a-ad88-c8d6b2a91737 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:10.486425 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-0e5b6f9b-a26f-4e1a-ad88-c8d6b2a91737 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:10.486425 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:10.486425 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:10.486425 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:10.486425 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:10.486425 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:10.486425 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:10.486425 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:10.486425 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:10.486425 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:10.486425 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:10.486425 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:10.486425 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:10.486425 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:10.486425 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:10.487998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:10.487998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:10.487998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:10.487998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:10.487998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:10.487998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:10.487998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:10.487998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:10.487998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:10.487998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:10.487998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:10.487998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:10.487998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:10.487998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:10.487998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:10.487998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:10.487998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:10.490612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:10.490612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:10.490612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:10.490612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:10.490612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 397/809] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:10.491293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151f4ac-91e1-46d6-b472-256be77172bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:10.491483 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b6f9b-a26f-4e1a-ad88-c8d6b2a91737 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:10.491705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151f4ac-91e1-46d6-b472-256be77172bb None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:10.491705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151f4ac-91e1-46d6-b472-256be77172bb None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:10.491705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8151f4ac-91e1-46d6-b472-256be77172bb None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:10.491705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151f4ac-91e1-46d6-b472-256be77172bb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:10.491705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151f4ac-91e1-46d6-b472-256be77172bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:10.493209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8151f4ac-91e1-46d6-b472-256be77172bb None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:10.498204 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 413/810] 10.222.0.44 () {56 vars in 1124 bytes} [Thu Jun 16 00:14:10 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:10.499026 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151f4ac-91e1-46d6-b472-256be77172bb None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:10.521910 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:10.539418 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:10.626226 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8151f4ac-91e1-46d6-b472-256be77172bb None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:10.632498 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5b6f9b-a26f-4e1a-ad88-c8d6b2a91737 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:10.665635 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3338483-89d7-49c7-82e8-0a665cc22e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:10.666310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3338483-89d7-49c7-82e8-0a665cc22e2f None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:10.666599 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3338483-89d7-49c7-82e8-0a665cc22e2f None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:10.666878 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3338483-89d7-49c7-82e8-0a665cc22e2f None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:10.667603 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3338483-89d7-49c7-82e8-0a665cc22e2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:10.667967 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3338483-89d7-49c7-82e8-0a665cc22e2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:10.668584 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec7aa30-7362-4fc8-944c-7864b82b004d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:10.669324 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3338483-89d7-49c7-82e8-0a665cc22e2f None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:10.669433 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7aa30-7362-4fc8-944c-7864b82b004d None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:10.669639 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7aa30-7362-4fc8-944c-7864b82b004d None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:10.669910 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec7aa30-7362-4fc8-944c-7864b82b004d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:10.681230 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7aa30-7362-4fc8-944c-7864b82b004d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:10.682671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec7aa30-7362-4fc8-944c-7864b82b004d None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:10.683067 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 414/811] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:10.684025 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3338483-89d7-49c7-82e8-0a665cc22e2f None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:10.706846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-cec7aa30-7362-4fc8-944c-7864b82b004d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:10.706846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:10.706846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:10.706846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:10.706846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:10.706846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:10.706846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:10.706846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:10.706846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:10.706846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:10.706846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:10.706846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:10.706846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:10.706846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:10.706846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:10.707812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:10.707812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:10.707812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:10.707812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:10.707812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:10.707812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:10.707812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:10.707812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:10.707812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:10.707812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:10.707812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:10.707812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:10.707812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:10.707812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:10.707812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:10.707812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:10.707812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:10.708730 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:10.708730 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:10.708730 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:10.708730 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:10.708953 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 398/812] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:10.710724 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6ce55-9316-4a9f-9552-8d89d34c1a48 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:10.710724 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6ce55-9316-4a9f-9552-8d89d34c1a48 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:10.710903 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea6ce55-9316-4a9f-9552-8d89d34c1a48 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:10.712319 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 399/813] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:10.713027 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6ce55-9316-4a9f-9552-8d89d34c1a48 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:10.789340 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:10.796264 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:10.802469 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3338483-89d7-49c7-82e8-0a665cc22e2f None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:10.825260 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea6ce55-9316-4a9f-9552-8d89d34c1a48 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:10.842852 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da688db0-5176-41dd-a457-2ba7a1dcf6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:10.843521 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da688db0-5176-41dd-a457-2ba7a1dcf6f4 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:10.843835 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da688db0-5176-41dd-a457-2ba7a1dcf6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:10.844112 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da688db0-5176-41dd-a457-2ba7a1dcf6f4 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:10.844817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da688db0-5176-41dd-a457-2ba7a1dcf6f4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:10.845126 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da688db0-5176-41dd-a457-2ba7a1dcf6f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:10.846753 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da688db0-5176-41dd-a457-2ba7a1dcf6f4 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:10.851667 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 415/814] 10.222.0.44 () {56 vars in 1124 bytes} [Thu Jun 16 00:14:10 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:10.856810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da688db0-5176-41dd-a457-2ba7a1dcf6f4 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:10.861025 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c77694-bf3a-433b-9d00-1d54757519fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:10.861916 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c77694-bf3a-433b-9d00-1d54757519fd None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:10.862794 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c77694-bf3a-433b-9d00-1d54757519fd None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:10.863076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c77694-bf3a-433b-9d00-1d54757519fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:10.870226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c77694-bf3a-433b-9d00-1d54757519fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:10.871748 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c77694-bf3a-433b-9d00-1d54757519fd None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:10.890308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-76c77694-bf3a-433b-9d00-1d54757519fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:10.890308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:10.890308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:10.890308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:10.890308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:10.890308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:10.890308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:10.890308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:10.890308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:10.890308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:10.890308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:10.890308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:10.890308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:14:10.890308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:14:10.890308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:14:10.891211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:14:10.891211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:10.891211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:10.891211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:10.891211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:10.891211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:10.891211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:10.891211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:10.891211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:10.891211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:10.891211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:10.891211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:10.891211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:10.891211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:10.891211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:10.891211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:10.891211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:10.898208 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:14:10.898208 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:14:10.898208 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:14:10.898208 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:14:10.898208 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:14:10.898208 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:14:10.898208 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:10.898208 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:10.898208 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 400/815] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:10.898208 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb56eb5-380e-44c6-acc6-cc8acfff8d9a None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:10.898208 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb56eb5-380e-44c6-acc6-cc8acfff8d9a None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:10.898819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb56eb5-380e-44c6-acc6-cc8acfff8d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:10.912605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-adb56eb5-380e-44c6-acc6-cc8acfff8d9a None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:10.913794 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-adb56eb5-380e-44c6-acc6-cc8acfff8d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:10.965204 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da688db0-5176-41dd-a457-2ba7a1dcf6f4 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:10.982982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 401/816] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:10.983842 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb56eb5-380e-44c6-acc6-cc8acfff8d9a None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:11.017300 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190496fe-a422-45a1-a5d5-9817f5a8ac72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:11.018245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190496fe-a422-45a1-a5d5-9817f5a8ac72 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:11.019752 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190496fe-a422-45a1-a5d5-9817f5a8ac72 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:11.020093 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190496fe-a422-45a1-a5d5-9817f5a8ac72 None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:11.020847 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190496fe-a422-45a1-a5d5-9817f5a8ac72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:11.021169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190496fe-a422-45a1-a5d5-9817f5a8ac72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:11.022574 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190496fe-a422-45a1-a5d5-9817f5a8ac72 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:11.039014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 416/817] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:11.039014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190496fe-a422-45a1-a5d5-9817f5a8ac72 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:11.053882 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:11.057886 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:11.096048 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb56eb5-380e-44c6-acc6-cc8acfff8d9a None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:11.138099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf47255-3d3c-4d8a-b74a-0b76c5956aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:11.138773 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf47255-3d3c-4d8a-b74a-0b76c5956aee None admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:11.139062 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf47255-3d3c-4d8a-b74a-0b76c5956aee None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:11.139350 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf47255-3d3c-4d8a-b74a-0b76c5956aee None admin] PATH_INFO: `/v3/endpoints` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:11.140147 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf47255-3d3c-4d8a-b74a-0b76c5956aee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:11.141624 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf47255-3d3c-4d8a-b74a-0b76c5956aee None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:11.144844 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190496fe-a422-45a1-a5d5-9817f5a8ac72 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:11.163749 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 402/818] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 16 00:14:10 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:11.164893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf47255-3d3c-4d8a-b74a-0b76c5956aee None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:11.208446 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df16cac-6d74-473d-854e-92e16d55b468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:11.209444 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df16cac-6d74-473d-854e-92e16d55b468 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:11.209910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df16cac-6d74-473d-854e-92e16d55b468 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:11.210440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df16cac-6d74-473d-854e-92e16d55b468 None admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:11.211520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df16cac-6d74-473d-854e-92e16d55b468 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:11.212142 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df16cac-6d74-473d-854e-92e16d55b468 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:11.213964 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df16cac-6d74-473d-854e-92e16d55b468 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:11.229082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 417/819] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:14:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:11.230699 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df16cac-6d74-473d-854e-92e16d55b468 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:11.282520 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf47255-3d3c-4d8a-b74a-0b76c5956aee None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:11.305400 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:11.322066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6a6ff-2a5f-4033-b345-ca707af79c23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:11.323510 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6a6ff-2a5f-4033-b345-ca707af79c23 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:11.326013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6a6ff-2a5f-4033-b345-ca707af79c23 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:11.326126 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6a6ff-2a5f-4033-b345-ca707af79c23 None admin] PATH_INFO: `/v3/services/network` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:11.326572 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:11.327021 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6a6ff-2a5f-4033-b345-ca707af79c23 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:11.328207 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6a6ff-2a5f-4033-b345-ca707af79c23 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:11.341595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-47f6a6ff-2a5f-4033-b345-ca707af79c23 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:14:11.341595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:11.341595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:14:11.341595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:14:11.341595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:14:11.341595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:14:11.341595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:14:11.341595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:11.341595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:14:11.341595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:11.341595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:14:11.341595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:11.341595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:11.341595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:11.341595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:11.341595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:11.341595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:11.342839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:11.342839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:11.342839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:11.342839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:11.342839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:11.342839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:11.342839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:14:11.342839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:14:11.342839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:14:11.342839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:14:11.342839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:11.342839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:11.342839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:11.342839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:11.342839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:11.342839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:11.343965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:11.343965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:11.343965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:11.343965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:11.343965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:11.343965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:11.343965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:11.343965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:11.343965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:11.343965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:11.343965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:14:11.343965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:11.343965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 16 00:14:11.343965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:11.343965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 403/820] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:11 2022] GET /identity/v3/services/network => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:11.344760 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6a6ff-2a5f-4033-b345-ca707af79c23 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:11.362068 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df16cac-6d74-473d-854e-92e16d55b468 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:11.402402 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13b8ee-0bed-4f09-9236-ec18aae80740 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:11.403438 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13b8ee-0bed-4f09-9236-ec18aae80740 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:11.403888 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13b8ee-0bed-4f09-9236-ec18aae80740 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:11.404325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f13b8ee-0bed-4f09-9236-ec18aae80740 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:11.413958 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13b8ee-0bed-4f09-9236-ec18aae80740 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:11.415697 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f13b8ee-0bed-4f09-9236-ec18aae80740 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:11.430161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-5f13b8ee-0bed-4f09-9236-ec18aae80740 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:14:11.430161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:11.430161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:11.430161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:11.430161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:11.430161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:11.430161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:11.430161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:11.430161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:11.430161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:11.430161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:11.430161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:11.430161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:14:11.430161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:14:11.430161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:14:11.430161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:14:11.431132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:11.431132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:11.431132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:14:11.431132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:11.431132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:14:11.431132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:11.431132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:11.431132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:11.431132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:11.431132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:11.431132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:11.431132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:11.431132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:11.431132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:11.431132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:11.431132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:11.431132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:11.431132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:11.432100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:11.432100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:11.432100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:14:11.432100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:14:11.432100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:14:11.432100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:14:11.432100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:14:11.432100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:14:11.432100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:14:11.432100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:11.438965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 418/821] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 16 00:14:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:11.440059 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13b8ee-0bed-4f09-9236-ec18aae80740 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:11.462589 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6a6ff-2a5f-4033-b345-ca707af79c23 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:11.500112 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303579fe-df3b-4e86-bb90-586d763379c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:11.501001 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303579fe-df3b-4e86-bb90-586d763379c8 None admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:11.501281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303579fe-df3b-4e86-bb90-586d763379c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:11.501553 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303579fe-df3b-4e86-bb90-586d763379c8 None admin] PATH_INFO: `/v3/projects/320d79ecbc2342af8031103e7308c10d/users/39bbc5ff02d24f40b796bd2245a7431a/roles/338a913607974d379aad3249b3d0402d` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:11.521366 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303579fe-df3b-4e86-bb90-586d763379c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=320d79ecbc2342af8031103e7308c10d, user_id=39bbc5ff02d24f40b796bd2245a7431a, role_id=338a913607974d379aad3249b3d0402d)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:11.523114 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303579fe-df3b-4e86-bb90-586d763379c8 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:11.544103 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 404/822] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 00:14:11 2022] PUT /identity/v3/projects/320d79ecbc2342af8031103e7308c10d/users/39bbc5ff02d24f40b796bd2245a7431a/roles/338a913607974d379aad3249b3d0402d => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:14:11.544958 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303579fe-df3b-4e86-bb90-586d763379c8 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:11.575235 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f13b8ee-0bed-4f09-9236-ec18aae80740 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:11.596394 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:11.667716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303579fe-df3b-4e86-bb90-586d763379c8 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:11.700381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e2bdf-3a17-4917-bf0a-f8c56e0fc8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:11.701076 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e2bdf-3a17-4917-bf0a-f8c56e0fc8a2 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:11.701364 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e2bdf-3a17-4917-bf0a-f8c56e0fc8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:11.701643 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9e2bdf-3a17-4917-bf0a-f8c56e0fc8a2 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:11.702368 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e2bdf-3a17-4917-bf0a-f8c56e0fc8a2 None admin] RBAC: Adding query filter params (name=network) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:11.702682 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e2bdf-3a17-4917-bf0a-f8c56e0fc8a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:11.704107 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9e2bdf-3a17-4917-bf0a-f8c56e0fc8a2 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:11.705543 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:11.708853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21acaf3-c607-469a-b06f-7d5cdc4de658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:11.709620 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21acaf3-c607-469a-b06f-7d5cdc4de658 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:11.709988 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21acaf3-c607-469a-b06f-7d5cdc4de658 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:11.710321 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21acaf3-c607-469a-b06f-7d5cdc4de658 None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:11.711243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21acaf3-c607-469a-b06f-7d5cdc4de658 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:11.711666 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21acaf3-c607-469a-b06f-7d5cdc4de658 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:11.713634 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21acaf3-c607-469a-b06f-7d5cdc4de658 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:11.725500 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 419/823] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 16 00:14:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:11.736827 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e2bdf-3a17-4917-bf0a-f8c56e0fc8a2 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:11.740084 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 405/824] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 16 00:14:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:11.745713 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21acaf3-c607-469a-b06f-7d5cdc4de658 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:11.872718 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9e2bdf-3a17-4917-bf0a-f8c56e0fc8a2 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:11.891958 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:11.898479 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21acaf3-c607-469a-b06f-7d5cdc4de658 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:11.936962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a5e66-4cb1-4e24-afd4-1b70303306a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:11.937622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a5e66-4cb1-4e24-afd4-1b70303306a8 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:11.937910 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a5e66-4cb1-4e24-afd4-1b70303306a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:11.938188 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a5e66-4cb1-4e24-afd4-1b70303306a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:12.011269 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a5e66-4cb1-4e24-afd4-1b70303306a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:12.012777 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a5e66-4cb1-4e24-afd4-1b70303306a8 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:12.012891 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36da217-0d8f-4d84-8556-6b082d6d77bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:12.013580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36da217-0d8f-4d84-8556-6b082d6d77bf None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:12.013874 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36da217-0d8f-4d84-8556-6b082d6d77bf None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:12.014152 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36da217-0d8f-4d84-8556-6b082d6d77bf None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:12.014872 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36da217-0d8f-4d84-8556-6b082d6d77bf None admin] RBAC: Adding query filter params (type=network) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:12.015182 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36da217-0d8f-4d84-8556-6b082d6d77bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:12.016589 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36da217-0d8f-4d84-8556-6b082d6d77bf None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:12.033886 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 420/825] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 16 00:14:11 2022] GET /identity/v3/services?type=network => generated 350 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:12.040586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36da217-0d8f-4d84-8556-6b082d6d77bf None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:12.112038 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:12.127994 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 406/826] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 00:14:12.129310 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a5e66-4cb1-4e24-afd4-1b70303306a8 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:12.238086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a5e66-4cb1-4e24-afd4-1b70303306a8 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:12.275064 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1670236-57ec-4d4d-b0e3-9238fe3b9337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:12.275909 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1670236-57ec-4d4d-b0e3-9238fe3b9337 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:12.276189 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1670236-57ec-4d4d-b0e3-9238fe3b9337 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:12.276457 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1670236-57ec-4d4d-b0e3-9238fe3b9337 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:12.285904 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:12.288718 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1670236-57ec-4d4d-b0e3-9238fe3b9337 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:12.290248 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1670236-57ec-4d4d-b0e3-9238fe3b9337 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:12.311068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-d1670236-57ec-4d4d-b0e3-9238fe3b9337 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:12.311068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:12.311068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:12.311068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:12.311068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:12.311068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:12.311068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:12.311068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:12.311068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:12.311068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:12.311068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:12.311068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:12.311068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:12.311068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:12.311068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:12.312055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:12.312055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:12.312055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:12.312055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:12.312055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:12.312055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:12.312055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:12.312055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:12.312055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:12.312055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:12.312055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:12.312055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:12.312055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:12.312055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:12.312055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:12.312055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:12.312055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:12.312970 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:12.312970 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:12.312970 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:12.312970 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:12.317201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 407/827] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:12.318368 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1670236-57ec-4d4d-b0e3-9238fe3b9337 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:12.362119 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36da217-0d8f-4d84-8556-6b082d6d77bf None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:12.375977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:12.398375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d16fd-2002-46ce-ad46-136dada24f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:12.399152 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d16fd-2002-46ce-ad46-136dada24f00 None admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:12.399442 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d16fd-2002-46ce-ad46-136dada24f00 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:12.399852 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3d16fd-2002-46ce-ad46-136dada24f00 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:12.400688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d16fd-2002-46ce-ad46-136dada24f00 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:12.402085 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3d16fd-2002-46ce-ad46-136dada24f00 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:12.440922 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1670236-57ec-4d4d-b0e3-9238fe3b9337 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:12.457973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 421/828] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 16 00:14:12 2022] POST /identity/v3/endpoints => generated 327 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:12.487456 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b20f9-d612-4dcd-94fa-37a785187165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:12.488176 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b20f9-d612-4dcd-94fa-37a785187165 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:12.488461 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b20f9-d612-4dcd-94fa-37a785187165 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:12.488774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b20f9-d612-4dcd-94fa-37a785187165 None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:12.489570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b20f9-d612-4dcd-94fa-37a785187165 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:12.489930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b20f9-d612-4dcd-94fa-37a785187165 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:12.491449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b20f9-d612-4dcd-94fa-37a785187165 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:12.509845 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 408/829] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:12.512766 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d16fd-2002-46ce-ad46-136dada24f00 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:12.655106 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3d16fd-2002-46ce-ad46-136dada24f00 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:12.673567 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:12.695586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdd753-7e6a-49b1-b898-5fb1fd54392d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:12.696563 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdd753-7e6a-49b1-b898-5fb1fd54392d None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:12.697254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdd753-7e6a-49b1-b898-5fb1fd54392d None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:12.697539 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdd753-7e6a-49b1-b898-5fb1fd54392d None admin] PATH_INFO: `/v3/projects/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:12.705301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdd753-7e6a-49b1-b898-5fb1fd54392d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:12.706898 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdd753-7e6a-49b1-b898-5fb1fd54392d None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:12.722677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-4dcdd753-7e6a-49b1-b898-5fb1fd54392d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:12.722677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:12.722677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:12.722677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:12.722677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:12.722677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:12.722677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:12.722677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:12.722677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:12.722677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:12.722677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:12.722677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:12.722677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:14:12.722677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:14:12.722677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:14:12.723588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:14:12.723588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:12.723588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:12.723588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:12.723588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:12.723588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:12.723588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:12.723588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:12.723588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:12.723588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:12.723588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:12.723588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:12.723588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:12.723588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:12.723588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:12.723588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:12.723588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:12.724739 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:14:12.724739 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:14:12.724739 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:14:12.724739 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:14:12.724739 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:14:12.724739 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:14:12.724739 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:12.724739 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:12.724739 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 422/830] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:12.731370 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b20f9-d612-4dcd-94fa-37a785187165 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:12.744494 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6774f4-54ae-4584-8f11-675d0a5e3482 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:12.744792 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6774f4-54ae-4584-8f11-675d0a5e3482 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:12.745040 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6774f4-54ae-4584-8f11-675d0a5e3482 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:12.746518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 423/831] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:12.751633 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f431d1-de48-4354-a404-2a0895bdd683 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:12.752157 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f431d1-de48-4354-a404-2a0895bdd683 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:12.752713 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f431d1-de48-4354-a404-2a0895bdd683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:12.774316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-31f431d1-de48-4354-a404-2a0895bdd683 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:12.775990 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-31f431d1-de48-4354-a404-2a0895bdd683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:12.863773 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:12.866595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b20f9-d612-4dcd-94fa-37a785187165 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:12.874564 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 424/832] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:12 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:14:12.900781 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f431d1-de48-4354-a404-2a0895bdd683 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:12.916390 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551eb1d-bd73-4873-b82b-0c1f10634137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:12.916987 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551eb1d-bd73-4873-b82b-0c1f10634137 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:12.917388 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551eb1d-bd73-4873-b82b-0c1f10634137 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:12.917674 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7551eb1d-bd73-4873-b82b-0c1f10634137 None admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:12.918473 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551eb1d-bd73-4873-b82b-0c1f10634137 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:12.918946 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551eb1d-bd73-4873-b82b-0c1f10634137 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:12.920503 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7551eb1d-bd73-4873-b82b-0c1f10634137 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:12.942239 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 409/833] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:14:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:12.943548 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551eb1d-bd73-4873-b82b-0c1f10634137 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:13.063714 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7551eb1d-bd73-4873-b82b-0c1f10634137 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:13.102645 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a5f77-962d-44b6-aff5-372ced7c96de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:13.103712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a5f77-962d-44b6-aff5-372ced7c96de None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:13.104226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a5f77-962d-44b6-aff5-372ced7c96de None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:13.104724 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55a5f77-962d-44b6-aff5-372ced7c96de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:13.105752 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a5f77-962d-44b6-aff5-372ced7c96de None admin] RBAC: Adding query filter params (role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab, scope.project.id=320d79ecbc2342af8031103e7308c10d, user.id=40432493f16b4df681daf5a1af87832a) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:13.106294 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a5f77-962d-44b6-aff5-372ced7c96de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:13.108020 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55a5f77-962d-44b6-aff5-372ced7c96de None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:13.123772 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 410/834] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:12 2022] GET /identity/v3/role_assignments?user.id=40432493f16b4df681daf5a1af87832a&scope.project.id=320d79ecbc2342af8031103e7308c10d&role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:13.154665 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f431d1-de48-4354-a404-2a0895bdd683 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:13.165708 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:13.195164 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532a718-da95-412b-b15c-38a96961f889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:13.195922 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532a718-da95-412b-b15c-38a96961f889 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:13.196207 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532a718-da95-412b-b15c-38a96961f889 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:13.196482 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5532a718-da95-412b-b15c-38a96961f889 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:13.208984 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5532a718-da95-412b-b15c-38a96961f889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:13.216980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-5532a718-da95-412b-b15c-38a96961f889 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:13.216980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:13.216980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:13.216980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:13.216980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:13.216980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:13.216980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:13.216980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:13.216980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:13.216980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:13.216980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:13.216980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:13.216980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:13.216980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:13.216980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:13.216980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:13.217977 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:13.217977 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:13.217977 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:13.217977 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:13.217977 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:13.217977 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:13.217977 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:13.217977 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:13.217977 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:13.217977 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:13.217977 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:13.217977 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:13.217977 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:13.217977 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:13.217977 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:13.217977 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:13.218820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:13.218820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:13.218820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:13.218820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:13.218820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:13.218820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:13.218820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:13.218820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:13.218820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:13.218820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:13.218820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:13.218820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:13.218820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 425/835] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:14:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:13.226012 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a5f77-962d-44b6-aff5-372ced7c96de None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:13.260741 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:13.346189 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55a5f77-962d-44b6-aff5-372ced7c96de None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:13.381826 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22e8bc-2b76-44e6-8c3f-61e32a951c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:13.382887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22e8bc-2b76-44e6-8c3f-61e32a951c56 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:13.383395 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22e8bc-2b76-44e6-8c3f-61e32a951c56 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:13.383907 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe22e8bc-2b76-44e6-8c3f-61e32a951c56 None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:13.384879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22e8bc-2b76-44e6-8c3f-61e32a951c56 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:13.385390 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22e8bc-2b76-44e6-8c3f-61e32a951c56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:13.386987 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe22e8bc-2b76-44e6-8c3f-61e32a951c56 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:13.397120 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 411/836] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:13.402915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532a718-da95-412b-b15c-38a96961f889 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:13.509046 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5532a718-da95-412b-b15c-38a96961f889 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:13.545433 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2550694e-648b-4152-ab76-0180f8b0cba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:13.546607 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550694e-648b-4152-ab76-0180f8b0cba4 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:13.547129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550694e-648b-4152-ab76-0180f8b0cba4 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:13.547626 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2550694e-648b-4152-ab76-0180f8b0cba4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:13.559063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550694e-648b-4152-ab76-0180f8b0cba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:13.560899 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2550694e-648b-4152-ab76-0180f8b0cba4 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:13.580008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-2550694e-648b-4152-ab76-0180f8b0cba4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:13.580008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:13.580008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:13.580008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:13.580008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:13.580008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:13.580008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:13.580008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:13.580008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:13.580008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:13.580008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:13.580008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:13.580008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:13.580008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:13.580008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:13.580983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:13.580983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:13.580983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:13.580983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:13.580983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:13.580983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:13.580983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:13.580983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:13.580983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:13.580983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:13.580983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:13.580983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:13.580983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:13.580983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:13.580983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:13.580983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:13.580983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:13.581929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:13.581929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:13.581929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:13.581929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:13.584164 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 426/837] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:13.589950 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22e8bc-2b76-44e6-8c3f-61e32a951c56 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:13.671214 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3230efe-e195-4d0e-82d3-a28fa3ee442c None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:13.671896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3230efe-e195-4d0e-82d3-a28fa3ee442c None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:13.672485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3230efe-e195-4d0e-82d3-a28fa3ee442c None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:13.674304 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 427/838] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:13.679873 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadf9d4-79c8-477f-ab43-784cd19d282f None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:13.680159 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadf9d4-79c8-477f-ab43-784cd19d282f None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:13.680439 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fadf9d4-79c8-477f-ab43-784cd19d282f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:13.689527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:13.702347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-1fadf9d4-79c8-477f-ab43-784cd19d282f None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:13.703546 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-1fadf9d4-79c8-477f-ab43-784cd19d282f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:13.710532 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe22e8bc-2b76-44e6-8c3f-61e32a951c56 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:13.718942 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:13.758060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1968fd-a22d-42f2-aef6-9ebbbe17b2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:13.759292 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1968fd-a22d-42f2-aef6-9ebbbe17b2b9 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:13.762957 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1968fd-a22d-42f2-aef6-9ebbbe17b2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:13.763453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1968fd-a22d-42f2-aef6-9ebbbe17b2b9 None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:13.764418 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1968fd-a22d-42f2-aef6-9ebbbe17b2b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:13.765062 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1968fd-a22d-42f2-aef6-9ebbbe17b2b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:13.766916 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1968fd-a22d-42f2-aef6-9ebbbe17b2b9 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:13.780895 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 412/839] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:13.786020 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 428/840] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:14:13.787740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadf9d4-79c8-477f-ab43-784cd19d282f None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:13.804724 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1968fd-a22d-42f2-aef6-9ebbbe17b2b9 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:13.904707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fadf9d4-79c8-477f-ab43-784cd19d282f None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:13.920710 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1968fd-a22d-42f2-aef6-9ebbbe17b2b9 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:13.941924 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cc3bf-edbb-4068-980c-20dd9499e654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:13.942935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cc3bf-edbb-4068-980c-20dd9499e654 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:13.943071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cc3bf-edbb-4068-980c-20dd9499e654 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:13.943261 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cc3bf-edbb-4068-980c-20dd9499e654 None admin] PATH_INFO: `/v3/users/swift` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:13.950709 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2cc3bf-edbb-4068-980c-20dd9499e654 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:13.952187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2cc3bf-edbb-4068-980c-20dd9499e654 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:13.957339 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554c05c9-0faa-4413-a3fb-19fc0d3bb6c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:13.958302 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c05c9-0faa-4413-a3fb-19fc0d3bb6c2 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:13.958583 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c05c9-0faa-4413-a3fb-19fc0d3bb6c2 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:13.958865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554c05c9-0faa-4413-a3fb-19fc0d3bb6c2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:13.959520 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c05c9-0faa-4413-a3fb-19fc0d3bb6c2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:13.960930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554c05c9-0faa-4413-a3fb-19fc0d3bb6c2 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:13.966908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-6f2cc3bf-edbb-4068-980c-20dd9499e654 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:14:13.966908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:13.966908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:13.966908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:13.966908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:13.966908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:13.966908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:13.966908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:13.966908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:13.966908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:13.966908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:13.966908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:13.966908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:14:13.966908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:14:13.966908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:14:13.966908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:14:13.968061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:13.968061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:13.968061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:14:13.968061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:13.968061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:14:13.968061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:13.968061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:13.968061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:13.968061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:13.968061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:13.968061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:13.968061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:13.968061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:13.968061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:13.968061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:13.968061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:13.968061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:13.968061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:13.969083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:13.969083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:13.969083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:14:13.969083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:14:13.969083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:14:13.969083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:14:13.969083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:14:13.969083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:14:13.969083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 16 00:14:13.969083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:13.969083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 429/841] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:14:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:13.969677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5328d-703b-452d-90ad-1de900e49881 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:13.970108 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5328d-703b-452d-90ad-1de900e49881 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:13.970215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df5328d-703b-452d-90ad-1de900e49881 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:13.971568 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 430/842] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:13.976049 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5328d-703b-452d-90ad-1de900e49881 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:13.976949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-554c05c9-0faa-4413-a3fb-19fc0d3bb6c2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:14:13.976949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:13.976949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:14:13.976949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:14:13.976949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:14:13.976949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:14:13.976949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:14:13.976949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:13.976949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:14:13.976949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:13.976949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:14:13.976949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:13.976949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:13.976949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:13.976949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:13.976949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:13.976949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:13.977954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:13.977954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:13.977954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:13.977954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:13.977954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:13.977954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:13.977954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:14:13.977954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:14:13.977954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:14:13.977954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:14:13.977954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:13.977954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:13.977954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:13.977954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:13.977954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:13.977954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:13.978806 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:13.978806 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:13.978806 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:13.978806 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:13.978806 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:13.978806 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:13.978806 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:13.978806 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:13.978806 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:13.978806 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:13.978806 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:14:13.978806 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:13.978806 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:14:13.978806 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:13.978806 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 413/843] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 00:14:13 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:13.984986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c5261-2c5a-4951-aebf-e67fb6754c95 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:13.984986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c5261-2c5a-4951-aebf-e67fb6754c95 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:13.984986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66c5261-2c5a-4951-aebf-e67fb6754c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:13.994415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:14.004339 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-d66c5261-2c5a-4951-aebf-e67fb6754c95 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:14.005817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d66c5261-2c5a-4951-aebf-e67fb6754c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:14.009634 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:14.079166 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 414/844] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:13 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:14.080515 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c5261-2c5a-4951-aebf-e67fb6754c95 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:14.098396 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df5328d-703b-452d-90ad-1de900e49881 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:14.135081 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3c8cb-8d0f-4390-ace0-2df793f3ec6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:14.136625 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3c8cb-8d0f-4390-ace0-2df793f3ec6a None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:14.137059 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3c8cb-8d0f-4390-ace0-2df793f3ec6a None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:14.137521 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f3c8cb-8d0f-4390-ace0-2df793f3ec6a None admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:14.138915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3c8cb-8d0f-4390-ace0-2df793f3ec6a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:14.139381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3c8cb-8d0f-4390-ace0-2df793f3ec6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:14.141031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f3c8cb-8d0f-4390-ace0-2df793f3ec6a None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:14.164649 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 431/845] 10.222.0.44 () {56 vars in 1135 bytes} [Thu Jun 16 00:14:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:14.166167 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3c8cb-8d0f-4390-ace0-2df793f3ec6a None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:14.188541 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66c5261-2c5a-4951-aebf-e67fb6754c95 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:14.225847 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f5f0f-a954-4357-b03f-37fa01f1db56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:14.226715 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f5f0f-a954-4357-b03f-37fa01f1db56 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:14.227004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f5f0f-a954-4357-b03f-37fa01f1db56 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:14.227280 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f5f0f-a954-4357-b03f-37fa01f1db56 None admin] PATH_INFO: `/v3/services` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:14.228011 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f5f0f-a954-4357-b03f-37fa01f1db56 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:14.228326 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f5f0f-a954-4357-b03f-37fa01f1db56 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:14.229695 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f5f0f-a954-4357-b03f-37fa01f1db56 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:14.238918 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 415/846] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 00:14:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:14.238918 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f5f0f-a954-4357-b03f-37fa01f1db56 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:14.240830 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:14.248719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:14.284815 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f3c8cb-8d0f-4390-ace0-2df793f3ec6a None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:14.321406 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd42cc-9655-420a-9ca6-2900a86c9488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:14.322202 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd42cc-9655-420a-9ca6-2900a86c9488 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:14.322485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd42cc-9655-420a-9ca6-2900a86c9488 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:14.322758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dd42cc-9655-420a-9ca6-2900a86c9488 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:14.333092 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dd42cc-9655-420a-9ca6-2900a86c9488 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:14.341082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-a2dd42cc-9655-420a-9ca6-2900a86c9488 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:14.341082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:14.341082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:14.341082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:14.341082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:14.341082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:14.341082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:14.341082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:14.341082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:14.341082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:14.341082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:14.341082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:14.341082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:14.341082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:14.341082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:14.341082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:14.342129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:14.342129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:14.342129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:14.342129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:14.342129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:14.342129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:14.342129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:14.342129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:14.342129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:14.342129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:14.342129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:14.342129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:14.342129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:14.342129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:14.342129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:14.342129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:14.342965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:14.342965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:14.342965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:14.342965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:14.342965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:14.342965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:14.342965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:14.342965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:14.342965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:14.342965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:14.342965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:14:14.342965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:14.343675 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f5f0f-a954-4357-b03f-37fa01f1db56 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:14.343756 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 432/847] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 00:14:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:14.343756 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd42cc-9655-420a-9ca6-2900a86c9488 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:14.386660 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99b155-ba85-4637-89a1-feec5f28948f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:14.387770 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99b155-ba85-4637-89a1-feec5f28948f None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:14.388082 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99b155-ba85-4637-89a1-feec5f28948f None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:14.388358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef99b155-ba85-4637-89a1-feec5f28948f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:14.459665 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99b155-ba85-4637-89a1-feec5f28948f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:14.461247 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef99b155-ba85-4637-89a1-feec5f28948f None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:14.461749 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dd42cc-9655-420a-9ca6-2900a86c9488 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:14.464743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:14.493041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:14.502505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3e8d7-7caf-4743-a8f7-e58e97e7b696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:14.503421 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3e8d7-7caf-4743-a8f7-e58e97e7b696 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:14.503730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3e8d7-7caf-4743-a8f7-e58e97e7b696 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:14.504009 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3e8d7-7caf-4743-a8f7-e58e97e7b696 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:14.504718 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3e8d7-7caf-4743-a8f7-e58e97e7b696 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:14.505029 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3e8d7-7caf-4743-a8f7-e58e97e7b696 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:14.506653 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3e8d7-7caf-4743-a8f7-e58e97e7b696 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:14.519640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 433/848] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 00:14:14 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:14.519640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3e8d7-7caf-4743-a8f7-e58e97e7b696 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:14.641490 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3e8d7-7caf-4743-a8f7-e58e97e7b696 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:14.682419 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e1d89-317b-44e8-8b88-69a55bd8bd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:14.683225 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e1d89-317b-44e8-8b88-69a55bd8bd55 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:14.683643 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e1d89-317b-44e8-8b88-69a55bd8bd55 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:14.684025 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e1d89-317b-44e8-8b88-69a55bd8bd55 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:14.684873 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e1d89-317b-44e8-8b88-69a55bd8bd55 None admin] RBAC: Adding query filter params (name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:14.685249 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e1d89-317b-44e8-8b88-69a55bd8bd55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:14.686724 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475e1d89-317b-44e8-8b88-69a55bd8bd55 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:14.701518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 434/849] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 00:14:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:14.702610 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e1d89-317b-44e8-8b88-69a55bd8bd55 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:14.726957 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 416/850] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:14 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:14:14.732610 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99b155-ba85-4637-89a1-feec5f28948f None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:14.784798 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:14.828541 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475e1d89-317b-44e8-8b88-69a55bd8bd55 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:14.843344 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef99b155-ba85-4637-89a1-feec5f28948f None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:14.847113 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:14.875199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8d417-1f4b-4868-9484-4f081018a1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:14.876501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8d417-1f4b-4868-9484-4f081018a1cb None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:14.877301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8d417-1f4b-4868-9484-4f081018a1cb None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:14.878013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d8d417-1f4b-4868-9484-4f081018a1cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:14.882013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b391ce7-8744-4f90-ab20-3e8a0f7aefac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:14.882810 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b391ce7-8744-4f90-ab20-3e8a0f7aefac None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:14.883097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b391ce7-8744-4f90-ab20-3e8a0f7aefac None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:14.883368 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b391ce7-8744-4f90-ab20-3e8a0f7aefac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:14.892812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8d417-1f4b-4868-9484-4f081018a1cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:14.894773 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b391ce7-8744-4f90-ab20-3e8a0f7aefac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:14.895438 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d8d417-1f4b-4868-9484-4f081018a1cb None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:14.896258 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b391ce7-8744-4f90-ab20-3e8a0f7aefac None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:14.916063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-e0d8d417-1f4b-4868-9484-4f081018a1cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:14.916063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:14.916063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:14.916063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:14.916063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:14.916063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:14.916063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:14.916063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:14.916063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:14.916063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:14.916063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:14.916063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:14.916063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:14.916063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:14.916063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:14.917181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:14.917181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:14.917181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:14.917181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:14.917181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:14.917181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:14.917181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:14.917181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:14.917181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:14.917181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:14.917181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:14.917181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:14.917181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:14.917181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:14.917181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:14.917181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:14.917181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:14.918346 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:14.918346 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:14.918346 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:14.918346 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:14.918578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-3b391ce7-8744-4f90-ab20-3e8a0f7aefac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:14.918578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:14.918578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:14.918578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:14.918578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:14.918578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:14.918578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:14.918578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:14.918578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:14.918578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:14.918578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:14.918578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:14.918578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:14.918578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:14.918578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:14.919365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:14.919365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:14.919365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:14.919365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:14.919365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:14.919365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:14.919365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:14.919365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:14.919365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:14.919365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:14.919365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:14.919365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:14.919365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:14.919365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:14.919365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:14.919365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:14.919365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:14.920511 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:14.920511 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:14.920511 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:14.920511 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:14.922289 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 435/852] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:14.924338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 417/852] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:14.925352 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8d417-1f4b-4868-9484-4f081018a1cb None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:14.927851 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b391ce7-8744-4f90-ab20-3e8a0f7aefac None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:15.032974 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b391ce7-8744-4f90-ab20-3e8a0f7aefac None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:15.057895 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d8d417-1f4b-4868-9484-4f081018a1cb None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:15.067733 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddc740-faec-4f23-a8cc-2f9ebb2c8f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:15.068404 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddc740-faec-4f23-a8cc-2f9ebb2c8f5a None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:15.068684 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddc740-faec-4f23-a8cc-2f9ebb2c8f5a None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:15.068957 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ddc740-faec-4f23-a8cc-2f9ebb2c8f5a None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:15.069862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddc740-faec-4f23-a8cc-2f9ebb2c8f5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:15.069977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddc740-faec-4f23-a8cc-2f9ebb2c8f5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:15.070410 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:15.071945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ddc740-faec-4f23-a8cc-2f9ebb2c8f5a None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:15.088493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 418/853] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:15.093521 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddc740-faec-4f23-a8cc-2f9ebb2c8f5a None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:15.101327 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9844593-fd9a-47bc-b62e-503f8c648125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:15.102273 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9844593-fd9a-47bc-b62e-503f8c648125 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:15.102772 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9844593-fd9a-47bc-b62e-503f8c648125 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:15.103340 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9844593-fd9a-47bc-b62e-503f8c648125 None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:15.104297 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9844593-fd9a-47bc-b62e-503f8c648125 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:15.104824 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9844593-fd9a-47bc-b62e-503f8c648125 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:15.106494 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9844593-fd9a-47bc-b62e-503f8c648125 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:15.113231 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:15.127425 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 436/854] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:15.128622 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9844593-fd9a-47bc-b62e-503f8c648125 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:15.196120 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ddc740-faec-4f23-a8cc-2f9ebb2c8f5a None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:15.229678 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ed4cf-a497-4938-b4df-e160dd166260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:15.230539 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ed4cf-a497-4938-b4df-e160dd166260 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:15.230819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ed4cf-a497-4938-b4df-e160dd166260 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:15.231092 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943ed4cf-a497-4938-b4df-e160dd166260 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:15.238206 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9844593-fd9a-47bc-b62e-503f8c648125 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:15.239604 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ed4cf-a497-4938-b4df-e160dd166260 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:15.241654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943ed4cf-a497-4938-b4df-e160dd166260 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:15.260222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-943ed4cf-a497-4938-b4df-e160dd166260 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:14:15.260222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:15.260222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:15.260222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:15.260222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:15.260222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:15.260222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:15.260222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:15.260222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:15.260222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:15.260222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:15.260222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:15.260222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:14:15.260222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:14:15.260222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:14:15.260222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:14:15.261223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:15.261223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:15.261223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:14:15.261223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:15.261223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:14:15.261223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:15.261223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:15.261223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:15.261223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:15.261223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:15.261223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:15.261223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:15.261223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:15.261223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:15.261223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:15.261223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:15.261223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:15.261223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:15.262188 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:15.262188 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:15.262188 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:14:15.262188 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:14:15.262188 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:14:15.262188 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:14:15.262188 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:14:15.262188 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:14:15.262188 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:14:15.262188 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:15.262188 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 419/855] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 16 00:14:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:15.266814 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ed4cf-a497-4938-b4df-e160dd166260 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:15.278940 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d54ee9-f650-4f4d-ba32-38a57ee89511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:15.280090 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d54ee9-f650-4f4d-ba32-38a57ee89511 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:15.280515 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d54ee9-f650-4f4d-ba32-38a57ee89511 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:15.280954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d54ee9-f650-4f4d-ba32-38a57ee89511 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:15.289115 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d54ee9-f650-4f4d-ba32-38a57ee89511 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:15.290795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d54ee9-f650-4f4d-ba32-38a57ee89511 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:15.305746 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-35d54ee9-f650-4f4d-ba32-38a57ee89511 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:15.305746 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:15.305746 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:15.305746 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:15.305746 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:15.305746 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:15.305746 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:15.305746 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:15.305746 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:15.305746 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:15.305746 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:15.305746 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:15.305746 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:14:15.305746 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:14:15.305746 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:14:15.306875 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:14:15.306875 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:15.306875 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:15.306875 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:15.306875 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:15.306875 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:15.306875 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:15.306875 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:15.306875 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:15.306875 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:15.306875 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:15.306875 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:15.306875 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:15.306875 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:15.306875 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:15.306875 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:15.306875 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:15.308019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:14:15.308019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:14:15.308019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:14:15.308019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:14:15.308019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:14:15.308019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:14:15.308019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:15.308019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:15.314558 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 437/856] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:15.315755 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d54ee9-f650-4f4d-ba32-38a57ee89511 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:15.345730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:15.355462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:15.382889 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943ed4cf-a497-4938-b4df-e160dd166260 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:15.421458 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cd5424-2ef1-4568-94a8-ea367c1302b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:15.422386 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd5424-2ef1-4568-94a8-ea367c1302b4 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:15.422764 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd5424-2ef1-4568-94a8-ea367c1302b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:15.423367 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd5424-2ef1-4568-94a8-ea367c1302b4 None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:15.424205 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd5424-2ef1-4568-94a8-ea367c1302b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:15.425164 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd5424-2ef1-4568-94a8-ea367c1302b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:15.426824 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cd5424-2ef1-4568-94a8-ea367c1302b4 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:15.433207 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d54ee9-f650-4f4d-ba32-38a57ee89511 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:15.446029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 420/857] 10.222.0.44 () {56 vars in 1149 bytes} [Thu Jun 16 00:14:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:15.447506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85a1c9-6995-440f-949b-b7834c5b5e61 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:15.447882 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85a1c9-6995-440f-949b-b7834c5b5e61 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:15.448251 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85a1c9-6995-440f-949b-b7834c5b5e61 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:15.449802 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 421/858] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:15.452286 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85a1c9-6995-440f-949b-b7834c5b5e61 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:15.469814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275eaf54-3642-4c07-964d-ce03988ea3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:15.470479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eaf54-3642-4c07-964d-ce03988ea3ad None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:15.470764 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eaf54-3642-4c07-964d-ce03988ea3ad None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:15.471038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275eaf54-3642-4c07-964d-ce03988ea3ad None admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:15.471881 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275eaf54-3642-4c07-964d-ce03988ea3ad None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:15.472196 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275eaf54-3642-4c07-964d-ce03988ea3ad None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:15.473663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275eaf54-3642-4c07-964d-ce03988ea3ad None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:15.493038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 438/859] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:14:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:15.494096 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5927fc-4550-4e76-b246-df1e196f6178 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:15.494386 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5927fc-4550-4e76-b246-df1e196f6178 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:15.494665 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5927fc-4550-4e76-b246-df1e196f6178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:15.512599 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-0a5927fc-4550-4e76-b246-df1e196f6178 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:15.514028 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-0a5927fc-4550-4e76-b246-df1e196f6178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:15.555637 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85a1c9-6995-440f-949b-b7834c5b5e61 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:15.585058 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 439/860] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:15 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:15.591886 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5927fc-4550-4e76-b246-df1e196f6178 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:15.599899 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b12ab9-8c1f-4755-aee6-dd0ee9c00439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:15.600801 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b12ab9-8c1f-4755-aee6-dd0ee9c00439 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:15.601257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b12ab9-8c1f-4755-aee6-dd0ee9c00439 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:15.601755 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b12ab9-8c1f-4755-aee6-dd0ee9c00439 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:15.604647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:15.609004 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:15.675372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b12ab9-8c1f-4755-aee6-dd0ee9c00439 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:15.676875 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b12ab9-8c1f-4755-aee6-dd0ee9c00439 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:15.696067 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5927fc-4550-4e76-b246-df1e196f6178 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:15.731127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3dfaea-d191-4b47-b555-771ea1fa7340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:15.731826 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dfaea-d191-4b47-b555-771ea1fa7340 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:15.732111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dfaea-d191-4b47-b555-771ea1fa7340 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:15.732389 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3dfaea-d191-4b47-b555-771ea1fa7340 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:15.733249 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3dfaea-d191-4b47-b555-771ea1fa7340 None admin] RBAC: Adding query filter params (role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab, scope.project.id=320d79ecbc2342af8031103e7308c10d, user.id=9918c4a8c6a64812b61fc235ab8e7bec) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:15.733566 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3dfaea-d191-4b47-b555-771ea1fa7340 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:15.735047 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3dfaea-d191-4b47-b555-771ea1fa7340 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:15.742176 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 440/861] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:15 2022] GET /identity/v3/role_assignments?user.id=9918c4a8c6a64812b61fc235ab8e7bec&scope.project.id=320d79ecbc2342af8031103e7308c10d&role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:15.744775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3dfaea-d191-4b47-b555-771ea1fa7340 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:15.807640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 422/862] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:15 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 00:14:15.808702 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b12ab9-8c1f-4755-aee6-dd0ee9c00439 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:15.856894 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:15.858640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:15.880393 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3dfaea-d191-4b47-b555-771ea1fa7340 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:15.923069 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e3236-a6e0-497d-bbf1-65ee99cced74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:15.923929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e3236-a6e0-497d-bbf1-65ee99cced74 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:15.924214 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e3236-a6e0-497d-bbf1-65ee99cced74 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:15.924492 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e3236-a6e0-497d-bbf1-65ee99cced74 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:15.925207 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e3236-a6e0-497d-bbf1-65ee99cced74 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:15.926951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e3236-a6e0-497d-bbf1-65ee99cced74 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:15.942471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-404e3236-a6e0-497d-bbf1-65ee99cced74 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:14:15.942471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:15.942471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:14:15.942471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:14:15.942471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:14:15.942471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:14:15.942471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:14:15.942471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:15.942471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:14:15.942471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:15.942471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:14:15.942471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:15.942471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:15.942471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:15.942471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:15.942471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:15.943423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:15.943423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:15.943423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:15.943423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:15.943423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:15.943423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:15.943423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:15.943423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:14:15.943423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:14:15.943423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:14:15.943423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:14:15.943423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:15.943423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:15.943423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:15.943423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:15.943423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:15.944325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:15.944325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:15.944325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:15.944325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:15.944325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:15.944325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:15.944325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:15.944325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:15.944325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:15.944325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:15.944325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:15.944325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:14:15.944325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:15.944325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:14:15.944325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:15.946306 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 441/863] 10.222.0.44 () {56 vars in 1132 bytes} [Thu Jun 16 00:14:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:15.949750 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e3236-a6e0-497d-bbf1-65ee99cced74 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:15.963992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b12ab9-8c1f-4755-aee6-dd0ee9c00439 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:15.999143 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78002f-60ee-4644-b1c2-9130e9c040d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:15.999875 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78002f-60ee-4644-b1c2-9130e9c040d0 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:16.000166 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78002f-60ee-4644-b1c2-9130e9c040d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:16.000440 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d78002f-60ee-4644-b1c2-9130e9c040d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:16.011604 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78002f-60ee-4644-b1c2-9130e9c040d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:16.013042 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d78002f-60ee-4644-b1c2-9130e9c040d0 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:16.032281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-2d78002f-60ee-4644-b1c2-9130e9c040d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:16.032281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:16.032281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:16.032281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:16.032281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:16.032281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:16.032281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:16.032281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:16.032281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:16.032281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:16.032281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:16.032281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:16.032281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:16.032281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:16.032281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:16.033222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:16.033222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:16.033222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:16.033222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:16.033222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:16.033222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:16.033222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:16.033222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:16.033222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:16.033222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:16.033222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:16.033222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:16.033222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:16.033222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:16.033222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:16.033222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:16.033222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:16.034145 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:16.034145 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:16.034145 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:16.034145 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:16.034145 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 423/864] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:16.039219 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78002f-60ee-4644-b1c2-9130e9c040d0 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:16.078583 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e3236-a6e0-497d-bbf1-65ee99cced74 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:16.115425 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75135b7-9744-4160-8a15-d5adb26bc640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:16.116141 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75135b7-9744-4160-8a15-d5adb26bc640 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:16.116424 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75135b7-9744-4160-8a15-d5adb26bc640 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:16.116696 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75135b7-9744-4160-8a15-d5adb26bc640 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:16.117395 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75135b7-9744-4160-8a15-d5adb26bc640 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:16.117761 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75135b7-9744-4160-8a15-d5adb26bc640 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:16.119180 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75135b7-9744-4160-8a15-d5adb26bc640 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:16.128848 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 442/865] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 16 00:14:15 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:16.131629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75135b7-9744-4160-8a15-d5adb26bc640 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:16.138915 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:16.146784 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:16.159312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d78002f-60ee-4644-b1c2-9130e9c040d0 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:16.205829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6ef39-be15-4238-9478-f809cfa7fc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:16.206512 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6ef39-be15-4238-9478-f809cfa7fc04 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:16.206787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6ef39-be15-4238-9478-f809cfa7fc04 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:16.207063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec6ef39-be15-4238-9478-f809cfa7fc04 None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:16.207816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6ef39-be15-4238-9478-f809cfa7fc04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:16.208124 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6ef39-be15-4238-9478-f809cfa7fc04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:16.209733 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec6ef39-be15-4238-9478-f809cfa7fc04 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:16.227712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 424/866] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:16.230913 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6ef39-be15-4238-9478-f809cfa7fc04 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:16.254900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75135b7-9744-4160-8a15-d5adb26bc640 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:16.297088 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2f553-a3f9-4c7b-8258-753163018e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:16.298025 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2f553-a3f9-4c7b-8258-753163018e26 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:16.298310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2f553-a3f9-4c7b-8258-753163018e26 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:16.298586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e2f553-a3f9-4c7b-8258-753163018e26 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:16.299290 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2f553-a3f9-4c7b-8258-753163018e26 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:16.300207 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2f553-a3f9-4c7b-8258-753163018e26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:16.302034 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e2f553-a3f9-4c7b-8258-753163018e26 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:16.307645 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 443/867] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 16 00:14:16 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:16.356538 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec6ef39-be15-4238-9478-f809cfa7fc04 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:16.395758 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d7112-2542-4cb4-a675-c6dcb9e89bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:16.396993 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d7112-2542-4cb4-a675-c6dcb9e89bf3 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:16.397511 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d7112-2542-4cb4-a675-c6dcb9e89bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:16.397979 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d7112-2542-4cb4-a675-c6dcb9e89bf3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:16.406234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d7112-2542-4cb4-a675-c6dcb9e89bf3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:16.408092 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d7112-2542-4cb4-a675-c6dcb9e89bf3 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:16.423659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-e17d7112-2542-4cb4-a675-c6dcb9e89bf3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:16.423659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:16.423659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:16.423659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:16.423659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:16.423659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:16.423659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:16.423659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:16.423659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:16.423659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:16.423659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:16.423659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:16.423659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:14:16.423659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:14:16.423659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:14:16.425165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:14:16.425165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:16.425165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:16.425165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:16.425165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:16.425165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:16.425165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:16.425165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:16.425165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:16.425165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:16.425165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:16.425165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:16.425165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:16.425165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:16.425165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:16.425165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:16.425165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:16.426055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:14:16.426055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:14:16.426055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:14:16.426055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:14:16.426055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:14:16.426055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:14:16.426055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:16.426055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:16.428631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 425/868] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:16.436781 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2f553-a3f9-4c7b-8258-753163018e26 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:16.511986 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:16.544250 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e2f553-a3f9-4c7b-8258-753163018e26 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:16.579579 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d723f24d-cfb1-4e5a-ac8b-09b611f4a2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:16.580316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723f24d-cfb1-4e5a-ac8b-09b611f4a2be None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:16.580599 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723f24d-cfb1-4e5a-ac8b-09b611f4a2be None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:16.580958 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d723f24d-cfb1-4e5a-ac8b-09b611f4a2be None admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:16.581760 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723f24d-cfb1-4e5a-ac8b-09b611f4a2be None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:16.582074 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723f24d-cfb1-4e5a-ac8b-09b611f4a2be None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:16.583498 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d723f24d-cfb1-4e5a-ac8b-09b611f4a2be None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:16.596974 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 444/869] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:14:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:16.602764 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d7112-2542-4cb4-a675-c6dcb9e89bf3 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:16.612095 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:16.707769 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d7112-2542-4cb4-a675-c6dcb9e89bf3 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:16.746939 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcac1916-5dcf-41d8-af9d-cd2612683853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:16.748041 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac1916-5dcf-41d8-af9d-cd2612683853 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:16.748528 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac1916-5dcf-41d8-af9d-cd2612683853 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:16.749000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcac1916-5dcf-41d8-af9d-cd2612683853 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:16.750049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac1916-5dcf-41d8-af9d-cd2612683853 None admin] RBAC: Adding query filter params (role.id=338a913607974d379aad3249b3d0402d, scope.project.id=320d79ecbc2342af8031103e7308c10d, user.id=39bbc5ff02d24f40b796bd2245a7431a) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:16.750577 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac1916-5dcf-41d8-af9d-cd2612683853 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:16.752351 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcac1916-5dcf-41d8-af9d-cd2612683853 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:16.760233 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 426/870] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:16 2022] GET /identity/v3/role_assignments?user.id=39bbc5ff02d24f40b796bd2245a7431a&scope.project.id=320d79ecbc2342af8031103e7308c10d&role.id=338a913607974d379aad3249b3d0402d => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:16.827892 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8325c-f6af-4adb-afde-32097bb82f4f None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:16.828214 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8325c-f6af-4adb-afde-32097bb82f4f None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:16.828458 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8325c-f6af-4adb-afde-32097bb82f4f None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:16.830173 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 445/871] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:16.837753 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b085d-3f8e-40d7-9bba-d147cb47cde2 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:16.838270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b085d-3f8e-40d7-9bba-d147cb47cde2 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:16.838346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559b085d-3f8e-40d7-9bba-d147cb47cde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:16.859223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-559b085d-3f8e-40d7-9bba-d147cb47cde2 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:16.860467 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-559b085d-3f8e-40d7-9bba-d147cb47cde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:16.929984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:16.937012 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 427/872] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:16 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:16.960070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8325c-f6af-4adb-afde-32097bb82f4f None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:17.080072 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8325c-f6af-4adb-afde-32097bb82f4f None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:17.114191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:17.119600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522978f-ffea-4f0e-9a57-ab9c5c1d5809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:17.120698 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522978f-ffea-4f0e-9a57-ab9c5c1d5809 None admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:17.121364 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522978f-ffea-4f0e-9a57-ab9c5c1d5809 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:17.121654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522978f-ffea-4f0e-9a57-ab9c5c1d5809 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:17.122776 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522978f-ffea-4f0e-9a57-ab9c5c1d5809 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:17.124184 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c522978f-ffea-4f0e-9a57-ab9c5c1d5809 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:17.141821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 446/873] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 00:14:16 2022] POST /identity/v3/services => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:17.993648 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5fa6e-ab52-49e6-8430-1a1ea7bfddc8 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:17.994263 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5fa6e-ab52-49e6-8430-1a1ea7bfddc8 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:17.994263 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe5fa6e-ab52-49e6-8430-1a1ea7bfddc8 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:17.995750 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 428/874] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:18.001157 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121deb2-eac0-4064-88fb-4deb49bf21ae None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:18.001546 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121deb2-eac0-4064-88fb-4deb49bf21ae None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:18.001729 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6121deb2-eac0-4064-88fb-4deb49bf21ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:18.022309 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-6121deb2-eac0-4064-88fb-4deb49bf21ae None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:18.023903 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-6121deb2-eac0-4064-88fb-4deb49bf21ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:18.102205 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 447/875] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:17 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:18.124257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5fa6e-ab52-49e6-8430-1a1ea7bfddc8 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:18.231800 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe5fa6e-ab52-49e6-8430-1a1ea7bfddc8 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:18.266227 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e185a58-d5c5-4141-8cd7-5dbc6cb47036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:18.267061 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e185a58-d5c5-4141-8cd7-5dbc6cb47036 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:18.267341 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e185a58-d5c5-4141-8cd7-5dbc6cb47036 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:18.267634 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e185a58-d5c5-4141-8cd7-5dbc6cb47036 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:18.268378 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e185a58-d5c5-4141-8cd7-5dbc6cb47036 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:18.269796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e185a58-d5c5-4141-8cd7-5dbc6cb47036 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:18.282821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-5e185a58-d5c5-4141-8cd7-5dbc6cb47036 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:14:18.282821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:18.282821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:14:18.282821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:14:18.282821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:14:18.282821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:14:18.282821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:14:18.282821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:18.282821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:14:18.282821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:18.282821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:14:18.282821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:18.282821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:18.282821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:18.282821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:18.282821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:18.282821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:18.284462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:18.284462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:18.284462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:18.284462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:18.284462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:18.284462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:18.284462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:14:18.284462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:14:18.284462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:14:18.284462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:14:18.284462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:18.284462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:18.284462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:18.284462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:18.284462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:18.284462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:18.285508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:18.285508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:18.285508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:18.285508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:18.285508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:18.285508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:18.285508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:18.285508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:18.285508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:18.285508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:18.285508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:14:18.285508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:18.285508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:14:18.285508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:18.285508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 429/876] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 16 00:14:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:18.292756 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121deb2-eac0-4064-88fb-4deb49bf21ae None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:18.395004 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6121deb2-eac0-4064-88fb-4deb49bf21ae None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:18.413171 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:18.431481 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd7c0e-78cb-415d-98b9-d68348be6a30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:18.432353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd7c0e-78cb-415d-98b9-d68348be6a30 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:18.432813 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd7c0e-78cb-415d-98b9-d68348be6a30 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:18.433090 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd7c0e-78cb-415d-98b9-d68348be6a30 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:18.433806 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd7c0e-78cb-415d-98b9-d68348be6a30 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:18.434296 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd7c0e-78cb-415d-98b9-d68348be6a30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:18.435708 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd7c0e-78cb-415d-98b9-d68348be6a30 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:18.441116 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 448/877] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 16 00:14:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:18.446802 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e185a58-d5c5-4141-8cd7-5dbc6cb47036 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:18.513030 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:18.558327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e185a58-d5c5-4141-8cd7-5dbc6cb47036 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:18.593553 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d060f1b-3010-4eb3-9ad6-61d24eeac204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:18.594223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d060f1b-3010-4eb3-9ad6-61d24eeac204 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:18.594510 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d060f1b-3010-4eb3-9ad6-61d24eeac204 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:18.594790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d060f1b-3010-4eb3-9ad6-61d24eeac204 None admin] PATH_INFO: `/v3/services` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:18.595557 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d060f1b-3010-4eb3-9ad6-61d24eeac204 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:18.595977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d060f1b-3010-4eb3-9ad6-61d24eeac204 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:18.597478 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d060f1b-3010-4eb3-9ad6-61d24eeac204 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:18.598068 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b3e31-929e-4290-9b8a-4619dcd98841 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:18.598366 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b3e31-929e-4290-9b8a-4619dcd98841 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:18.598649 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b3e31-929e-4290-9b8a-4619dcd98841 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:18.602581 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 430/878] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 16 00:14:18 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:18.604105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 449/879] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:18.609665 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab0cea-4bab-4f90-8888-e35a6af3cd6f None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:18.609974 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab0cea-4bab-4f90-8888-e35a6af3cd6f None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:18.610230 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab0cea-4bab-4f90-8888-e35a6af3cd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:18.632056 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-d4ab0cea-4bab-4f90-8888-e35a6af3cd6f None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:18.633278 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d4ab0cea-4bab-4f90-8888-e35a6af3cd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:18.707581 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 431/880] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:18 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:18.730467 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b3e31-929e-4290-9b8a-4619dcd98841 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:18.843225 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b3e31-929e-4290-9b8a-4619dcd98841 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:18.878880 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9a36c5-413e-49ac-96ae-5f6e9cdf4431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:18.879548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a36c5-413e-49ac-96ae-5f6e9cdf4431 None admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:18.879862 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a36c5-413e-49ac-96ae-5f6e9cdf4431 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:18.880139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9a36c5-413e-49ac-96ae-5f6e9cdf4431 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:18.881136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a36c5-413e-49ac-96ae-5f6e9cdf4431 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:18.882499 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9a36c5-413e-49ac-96ae-5f6e9cdf4431 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:18.899362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 450/881] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 00:14:18 2022] POST /identity/v3/services => generated 269 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:19.112549 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f83d0-fb6a-4017-827c-a6043cfbdeae None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:19.113041 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f83d0-fb6a-4017-827c-a6043cfbdeae None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:19.113307 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3f83d0-fb6a-4017-827c-a6043cfbdeae None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:19.115038 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 432/882] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:19.120450 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36244811-777c-432f-b0e2-07396316f443 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:19.120865 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36244811-777c-432f-b0e2-07396316f443 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:19.121127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36244811-777c-432f-b0e2-07396316f443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:19.138464 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-36244811-777c-432f-b0e2-07396316f443 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:19.139700 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-36244811-777c-432f-b0e2-07396316f443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:19.176605 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:19.216258 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 451/883] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:19.240007 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f83d0-fb6a-4017-827c-a6043cfbdeae None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:19.303946 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:19.354032 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3f83d0-fb6a-4017-827c-a6043cfbdeae None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:19.378149 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b67cb-81af-493c-95a7-ca047bac260c None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:19.378345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b67cb-81af-493c-95a7-ca047bac260c None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:19.378628 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329b67cb-81af-493c-95a7-ca047bac260c None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:19.381562 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 452/884] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:19.385898 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add6578-3015-4bb8-a765-79018741d19b None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:19.386121 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add6578-3015-4bb8-a765-79018741d19b None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:19.386400 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6add6578-3015-4bb8-a765-79018741d19b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:19.392120 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291fefb7-8048-47ff-8a2f-4ef958932e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:19.393706 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fefb7-8048-47ff-8a2f-4ef958932e6d None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:19.394199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fefb7-8048-47ff-8a2f-4ef958932e6d None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:19.394475 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291fefb7-8048-47ff-8a2f-4ef958932e6d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:19.406017 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291fefb7-8048-47ff-8a2f-4ef958932e6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:19.406853 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-6add6578-3015-4bb8-a765-79018741d19b None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:19.408308 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-6add6578-3015-4bb8-a765-79018741d19b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:19.414196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-291fefb7-8048-47ff-8a2f-4ef958932e6d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:14:19.414196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:19.414196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:19.414196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:19.414196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:19.414196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:19.414196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:19.414196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:19.414196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:19.414196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:19.414196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:19.414196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:19.414196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:19.414196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:19.414196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:19.414196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:19.415130 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:19.415130 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:19.415130 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:19.415130 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:19.415130 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:19.415130 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:19.415130 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:19.415130 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:19.415130 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:19.415130 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:19.415130 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:19.415130 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:19.415130 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:19.415130 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:19.415130 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:19.415130 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:19.420409 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:19.420409 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:19.420409 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:19.420409 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:19.420409 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:19.420409 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:19.420409 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:19.420409 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:19.420409 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:19.420409 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:19.420409 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:14:19.420409 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:19.420409 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 433/885] 10.222.0.44 () {56 vars in 1120 bytes} [Thu Jun 16 00:14:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:19.422990 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291fefb7-8048-47ff-8a2f-4ef958932e6d None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:19.490655 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 453/886] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:19 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:14:19.513034 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add6578-3015-4bb8-a765-79018741d19b None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:19.528351 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291fefb7-8048-47ff-8a2f-4ef958932e6d None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:19.555991 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:19.564821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb808034-b1aa-4073-b980-60128d20c751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:19.566009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb808034-b1aa-4073-b980-60128d20c751 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:19.566291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb808034-b1aa-4073-b980-60128d20c751 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:19.566565 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb808034-b1aa-4073-b980-60128d20c751 None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:19.567365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb808034-b1aa-4073-b980-60128d20c751 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:19.567808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb808034-b1aa-4073-b980-60128d20c751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:19.569340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb808034-b1aa-4073-b980-60128d20c751 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:19.582692 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 434/887] 10.222.0.44 () {56 vars in 1115 bytes} [Thu Jun 16 00:14:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:19.583910 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb808034-b1aa-4073-b980-60128d20c751 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:19.623096 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:19.628310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6add6578-3015-4bb8-a765-79018741d19b None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:19.665629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce213d-dcb3-422d-a423-12be60daab42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:19.666671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce213d-dcb3-422d-a423-12be60daab42 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:19.667109 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce213d-dcb3-422d-a423-12be60daab42 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:19.667601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cce213d-dcb3-422d-a423-12be60daab42 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:19.668474 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce213d-dcb3-422d-a423-12be60daab42 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:19.670023 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cce213d-dcb3-422d-a423-12be60daab42 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:19.682915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-1cce213d-dcb3-422d-a423-12be60daab42 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:14:19.682915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:19.682915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:14:19.682915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:14:19.682915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:14:19.682915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:14:19.682915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:14:19.682915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:19.682915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:14:19.682915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:19.682915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:14:19.682915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:19.682915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:19.682915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:19.682915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:19.682915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:19.682915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:19.684234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:19.684234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:19.684234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:19.684234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:19.684234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:19.684234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:19.684234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:14:19.684234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:14:19.684234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:14:19.684234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:14:19.684234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:19.684234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:19.684234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:19.684234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:19.684234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:19.684234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:19.685151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:19.685151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:19.685151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:19.685151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:19.685151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:19.685151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:19.685151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:19.685151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:19.685151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:19.685151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:19.685151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:14:19.685151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:19.685151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:14:19.685151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:19.687817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 454/888] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 00:14:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:19.691561 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb808034-b1aa-4073-b980-60128d20c751 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:19.693559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce213d-dcb3-422d-a423-12be60daab42 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:19.729485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475b20c-bbba-4b46-bdfc-9b5afa03eb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:19.730290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475b20c-bbba-4b46-bdfc-9b5afa03eb9e None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:19.730573 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475b20c-bbba-4b46-bdfc-9b5afa03eb9e None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:19.730845 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a475b20c-bbba-4b46-bdfc-9b5afa03eb9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:19.742052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475b20c-bbba-4b46-bdfc-9b5afa03eb9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:19.743507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a475b20c-bbba-4b46-bdfc-9b5afa03eb9e None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:19.761612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-a475b20c-bbba-4b46-bdfc-9b5afa03eb9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:19.761612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:19.761612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:19.761612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:19.761612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:19.761612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:19.761612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:19.761612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:19.761612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:19.761612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:19.761612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:19.761612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:19.761612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:19.761612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:19.761612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:19.762505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:19.762505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:19.762505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:19.762505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:19.762505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:19.762505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:19.762505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:19.762505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:19.762505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:19.762505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:19.762505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:19.762505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:19.762505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:19.762505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:19.762505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:19.762505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:19.762505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:19.763397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:19.763397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:19.763397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:19.763397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:19.763397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 435/889] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:19.768711 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475b20c-bbba-4b46-bdfc-9b5afa03eb9e None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:19.802372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:19.815039 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cce213d-dcb3-422d-a423-12be60daab42 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:19.852895 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b1185-9e6e-4d63-9fdf-54f8519b6390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:19.853919 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b1185-9e6e-4d63-9fdf-54f8519b6390 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:19.854435 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b1185-9e6e-4d63-9fdf-54f8519b6390 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:19.854917 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664b1185-9e6e-4d63-9fdf-54f8519b6390 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:19.855877 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b1185-9e6e-4d63-9fdf-54f8519b6390 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:19.856393 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b1185-9e6e-4d63-9fdf-54f8519b6390 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:19.857966 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-664b1185-9e6e-4d63-9fdf-54f8519b6390 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:19.863448 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 455/890] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 00:14:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:19.869219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b1185-9e6e-4d63-9fdf-54f8519b6390 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:19.883441 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a475b20c-bbba-4b46-bdfc-9b5afa03eb9e None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:19.906432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:19.931998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7323bb-9c47-4f4b-acdb-9e1f6973368f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:19.932698 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7323bb-9c47-4f4b-acdb-9e1f6973368f None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:19.932997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7323bb-9c47-4f4b-acdb-9e1f6973368f None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:19.933731 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7323bb-9c47-4f4b-acdb-9e1f6973368f None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:19.934477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7323bb-9c47-4f4b-acdb-9e1f6973368f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:19.934814 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7323bb-9c47-4f4b-acdb-9e1f6973368f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:19.936745 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7323bb-9c47-4f4b-acdb-9e1f6973368f None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:19.956146 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 436/891] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:19.958423 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7323bb-9c47-4f4b-acdb-9e1f6973368f None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:20.010598 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664b1185-9e6e-4d63-9fdf-54f8519b6390 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:20.057635 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19c18d-92f4-4670-bc8a-f4052c2c2bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:20.058310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19c18d-92f4-4670-bc8a-f4052c2c2bc5 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:20.058598 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19c18d-92f4-4670-bc8a-f4052c2c2bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:20.058876 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c19c18d-92f4-4670-bc8a-f4052c2c2bc5 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:20.059586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19c18d-92f4-4670-bc8a-f4052c2c2bc5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:20.059952 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19c18d-92f4-4670-bc8a-f4052c2c2bc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:20.061910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c19c18d-92f4-4670-bc8a-f4052c2c2bc5 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:20.071687 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 456/892] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 00:14:19 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:20.075330 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19c18d-92f4-4670-bc8a-f4052c2c2bc5 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:20.085476 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:20.095563 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7323bb-9c47-4f4b-acdb-9e1f6973368f None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:20.132154 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc6e8b-d9a3-4db7-986b-294c8d76b7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:20.133867 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc6e8b-d9a3-4db7-986b-294c8d76b7e6 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:20.134352 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc6e8b-d9a3-4db7-986b-294c8d76b7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:20.134822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77fc6e8b-d9a3-4db7-986b-294c8d76b7e6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:20.143743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc6e8b-d9a3-4db7-986b-294c8d76b7e6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:20.145523 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77fc6e8b-d9a3-4db7-986b-294c8d76b7e6 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:20.160848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-77fc6e8b-d9a3-4db7-986b-294c8d76b7e6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:14:20.160848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:20.160848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:20.160848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:20.160848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:20.160848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:20.160848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:20.160848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:20.160848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:20.160848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:20.160848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:20.160848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:20.160848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:14:20.160848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:14:20.160848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:14:20.160848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:14:20.161796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:20.161796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:20.161796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:14:20.161796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:20.161796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:14:20.161796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:20.161796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:20.161796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:20.161796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:20.161796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:20.161796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:20.161796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:20.161796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:20.161796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:20.161796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:20.161796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:20.161796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:20.161796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:20.162757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:20.162757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:20.162757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:14:20.162757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:14:20.162757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:14:20.162757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:14:20.162757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:14:20.162757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:14:20.162757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:14:20.162757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:20.165396 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 437/893] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 16 00:14:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:20.171293 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc6e8b-d9a3-4db7-986b-294c8d76b7e6 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:20.177629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:20.189061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c19c18d-92f4-4670-bc8a-f4052c2c2bc5 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:20.229578 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947dc9d-ccae-4964-b4de-aec85aa5b82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:20.231035 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947dc9d-ccae-4964-b4de-aec85aa5b82e None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:20.231555 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947dc9d-ccae-4964-b4de-aec85aa5b82e None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:20.232468 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3947dc9d-ccae-4964-b4de-aec85aa5b82e None admin] PATH_INFO: `/v3/endpoints` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:20.233767 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947dc9d-ccae-4964-b4de-aec85aa5b82e None admin] RBAC: Adding query filter params (interface=public, service_id=5303255f159b4679b2592b40210587f4, region_id=RegionOne) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:20.234306 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947dc9d-ccae-4964-b4de-aec85aa5b82e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:20.236594 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3947dc9d-ccae-4964-b4de-aec85aa5b82e None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:20.248232 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 457/894] 10.222.0.44 () {56 vars in 1251 bytes} [Thu Jun 16 00:14:20 2022] GET /identity/v3/endpoints?service_id=5303255f159b4679b2592b40210587f4&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:20.249824 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947dc9d-ccae-4964-b4de-aec85aa5b82e None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:20.292600 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77fc6e8b-d9a3-4db7-986b-294c8d76b7e6 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:20.328161 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536f890-0e9a-4a34-8985-b7fb9a54db59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:20.328991 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536f890-0e9a-4a34-8985-b7fb9a54db59 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:20.329376 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536f890-0e9a-4a34-8985-b7fb9a54db59 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:20.329730 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a536f890-0e9a-4a34-8985-b7fb9a54db59 None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:20.330668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536f890-0e9a-4a34-8985-b7fb9a54db59 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:20.331084 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536f890-0e9a-4a34-8985-b7fb9a54db59 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:20.332625 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a536f890-0e9a-4a34-8985-b7fb9a54db59 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:20.355864 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 438/895] 10.222.0.44 () {56 vars in 1149 bytes} [Thu Jun 16 00:14:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:20.357096 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536f890-0e9a-4a34-8985-b7fb9a54db59 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:20.361474 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3947dc9d-ccae-4964-b4de-aec85aa5b82e None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:20.369647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:20.401678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b4a67-3b4f-45b4-be14-6f6ff8022281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:20.402635 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b4a67-3b4f-45b4-be14-6f6ff8022281 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:20.403193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b4a67-3b4f-45b4-be14-6f6ff8022281 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:20.403704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b4a67-3b4f-45b4-be14-6f6ff8022281 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:20.404713 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b4a67-3b4f-45b4-be14-6f6ff8022281 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:20.406278 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258b4a67-3b4f-45b4-be14-6f6ff8022281 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:20.419101 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 458/896] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 16 00:14:20 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:14:20.468524 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a536f890-0e9a-4a34-8985-b7fb9a54db59 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:20.508788 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e61107-ced2-42ee-8be9-d8cdc7d34eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:20.509529 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e61107-ced2-42ee-8be9-d8cdc7d34eef None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:20.509819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e61107-ced2-42ee-8be9-d8cdc7d34eef None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:20.510103 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e61107-ced2-42ee-8be9-d8cdc7d34eef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:20.588127 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e61107-ced2-42ee-8be9-d8cdc7d34eef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:20.589599 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e61107-ced2-42ee-8be9-d8cdc7d34eef None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:20.601448 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:20.698727 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 439/897] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:20 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 00:14:20.704289 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b4a67-3b4f-45b4-be14-6f6ff8022281 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:20.724958 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:20.821481 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b4a67-3b4f-45b4-be14-6f6ff8022281 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:20.857567 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3832b-9dbe-4b5f-8449-22276d524eca None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:20.857873 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d207e34-7ede-41d8-81fd-aeafefa79a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:20.857991 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3832b-9dbe-4b5f-8449-22276d524eca None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:20.858146 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3832b-9dbe-4b5f-8449-22276d524eca None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:20.858653 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d207e34-7ede-41d8-81fd-aeafefa79a9b None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:20.858936 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d207e34-7ede-41d8-81fd-aeafefa79a9b None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:20.859209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d207e34-7ede-41d8-81fd-aeafefa79a9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:20.859890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 440/898] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:20.865667 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c29de-b472-4b9e-9c23-f8c05bacfbcf None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:20.866440 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c29de-b472-4b9e-9c23-f8c05bacfbcf None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:20.866728 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c29de-b472-4b9e-9c23-f8c05bacfbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:20.874786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d207e34-7ede-41d8-81fd-aeafefa79a9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:20.876283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d207e34-7ede-41d8-81fd-aeafefa79a9b None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:20.887192 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-fd3c29de-b472-4b9e-9c23-f8c05bacfbcf None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:20.888487 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-fd3c29de-b472-4b9e-9c23-f8c05bacfbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:20.894460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-1d207e34-7ede-41d8-81fd-aeafefa79a9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:20.894460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:20.894460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:20.894460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:20.894460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:20.894460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:20.894460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:20.894460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:20.894460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:20.894460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:20.894460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:20.894460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:20.894460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:20.894460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:20.894460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:20.895329 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:20.895329 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:20.895329 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:20.895329 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:20.895329 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:20.895329 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:20.895329 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:20.895329 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:20.895329 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:20.895329 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:20.895329 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:20.895329 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:20.895329 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:20.895329 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:20.895329 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:20.895329 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:20.895329 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:20.896449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:20.896449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:20.896449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:20.896449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:20.896449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 459/899] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:20.901207 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d207e34-7ede-41d8-81fd-aeafefa79a9b None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:20.978841 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 441/900] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:20 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:14:20.990532 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:21.001781 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c29de-b472-4b9e-9c23-f8c05bacfbcf None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:21.025473 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d207e34-7ede-41d8-81fd-aeafefa79a9b None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:21.062823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:21.064619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4df1b2-997f-4359-a245-66d82031446c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:21.065994 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4df1b2-997f-4359-a245-66d82031446c None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:21.066330 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4df1b2-997f-4359-a245-66d82031446c None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:21.067050 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4df1b2-997f-4359-a245-66d82031446c None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:21.067574 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4df1b2-997f-4359-a245-66d82031446c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:21.068132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4df1b2-997f-4359-a245-66d82031446c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:21.069543 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4df1b2-997f-4359-a245-66d82031446c None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:21.088973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 460/901] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:21.089955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4df1b2-997f-4359-a245-66d82031446c None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:21.144885 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c29de-b472-4b9e-9c23-f8c05bacfbcf None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:21.181708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a137a-6451-4143-8a9e-9d2a11730a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:21.182380 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a137a-6451-4143-8a9e-9d2a11730a07 None admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:21.182663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a137a-6451-4143-8a9e-9d2a11730a07 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:21.182941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a137a-6451-4143-8a9e-9d2a11730a07 None admin] PATH_INFO: `/v3/services` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:21.183732 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a137a-6451-4143-8a9e-9d2a11730a07 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:21.185104 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a137a-6451-4143-8a9e-9d2a11730a07 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:21.198295 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 442/902] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 00:14:21 2022] POST /identity/v3/services => generated 241 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:14:21.199793 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023115b-2ac8-47b6-a40d-42afe4efffc1 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:21.200084 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023115b-2ac8-47b6-a40d-42afe4efffc1 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:21.200357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023115b-2ac8-47b6-a40d-42afe4efffc1 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:21.201650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 443/903] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:21.210229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4df1b2-997f-4359-a245-66d82031446c None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:21.212420 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a30cc-d37c-44e2-9e86-466841f7457a None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:21.212705 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a30cc-d37c-44e2-9e86-466841f7457a None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:21.213110 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3a30cc-d37c-44e2-9e86-466841f7457a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:21.241606 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-6e3a30cc-d37c-44e2-9e86-466841f7457a None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:21.243148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-6e3a30cc-d37c-44e2-9e86-466841f7457a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:21.250308 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:21.269520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e778aa-1a5c-42fa-8a88-66f0f7d3512e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:21.272392 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e778aa-1a5c-42fa-8a88-66f0f7d3512e None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:21.273566 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e778aa-1a5c-42fa-8a88-66f0f7d3512e None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:21.274063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e778aa-1a5c-42fa-8a88-66f0f7d3512e None admin] PATH_INFO: `/v3/projects/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:21.284764 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e778aa-1a5c-42fa-8a88-66f0f7d3512e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:21.287175 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e778aa-1a5c-42fa-8a88-66f0f7d3512e None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:21.305070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-95e778aa-1a5c-42fa-8a88-66f0f7d3512e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:21.305070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:21.305070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:21.305070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:21.305070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:21.305070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:21.305070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:21.305070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:21.305070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:21.305070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:21.305070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:21.305070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:21.305070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:14:21.305070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:14:21.305070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:14:21.306066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:14:21.306066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:21.306066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:21.306066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:21.306066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:21.306066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:21.306066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:21.306066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:21.306066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:21.306066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:21.306066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:21.306066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:21.306066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:21.306066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:21.306066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:21.306066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:21.306066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:21.306953 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:14:21.306953 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:14:21.306953 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:14:21.306953 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:14:21.306953 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:14:21.306953 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:14:21.306953 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:21.306953 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:21.310099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 461/904] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:21.318891 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e778aa-1a5c-42fa-8a88-66f0f7d3512e None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:21.329838 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 444/905] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:21.354392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a30cc-d37c-44e2-9e86-466841f7457a None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:21.390585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:21.439175 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e778aa-1a5c-42fa-8a88-66f0f7d3512e None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:21.486490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3a30cc-d37c-44e2-9e86-466841f7457a None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:21.488235 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63dcb7c-b81f-488a-91fd-27566697d339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:21.489145 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63dcb7c-b81f-488a-91fd-27566697d339 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:21.489624 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63dcb7c-b81f-488a-91fd-27566697d339 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:21.490105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63dcb7c-b81f-488a-91fd-27566697d339 None admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:21.491092 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63dcb7c-b81f-488a-91fd-27566697d339 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:21.491596 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63dcb7c-b81f-488a-91fd-27566697d339 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:21.493307 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63dcb7c-b81f-488a-91fd-27566697d339 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:21.507075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 462/906] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:14:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:21.513072 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63dcb7c-b81f-488a-91fd-27566697d339 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:21.528966 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf69cc-51b3-4253-9c10-38e2ec1e405c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:21.530065 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf69cc-51b3-4253-9c10-38e2ec1e405c None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:21.530351 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf69cc-51b3-4253-9c10-38e2ec1e405c None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:21.530870 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bf69cc-51b3-4253-9c10-38e2ec1e405c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:21.531929 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf69cc-51b3-4253-9c10-38e2ec1e405c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:21.533327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bf69cc-51b3-4253-9c10-38e2ec1e405c None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:21.551474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-38bf69cc-51b3-4253-9c10-38e2ec1e405c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:14:21.551474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:21.551474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:14:21.551474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:14:21.551474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:14:21.551474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:14:21.551474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:14:21.551474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:21.551474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:14:21.551474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:21.551474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:14:21.551474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:21.551474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:21.551474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:21.551474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:21.551474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:21.552502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:21.552502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:21.552502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:21.552502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:21.552502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:21.552502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:21.552502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:21.552502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:14:21.552502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:14:21.552502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:14:21.552502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:14:21.552502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:21.552502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:21.552502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:21.552502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:21.552502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:21.553349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:21.553349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:21.553349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:21.553349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:21.553349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:21.553349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:21.553349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:21.553349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:21.553349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:21.553349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:21.553349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:21.553349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:14:21.553349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:21.553349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:14:21.553349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:21.553349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 445/907] 10.222.0.44 () {56 vars in 1132 bytes} [Thu Jun 16 00:14:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:21.558867 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf69cc-51b3-4253-9c10-38e2ec1e405c None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:21.563483 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:21.620983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63dcb7c-b81f-488a-91fd-27566697d339 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:21.661215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbe588-2d20-4796-9472-00c33a2d5194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:21.662038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbe588-2d20-4796-9472-00c33a2d5194 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:21.662430 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbe588-2d20-4796-9472-00c33a2d5194 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:21.662812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cbe588-2d20-4796-9472-00c33a2d5194 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:21.663814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbe588-2d20-4796-9472-00c33a2d5194 None admin] RBAC: Adding query filter params (role.id=0876003b49cc4c678dc978764ef54594, scope.project.id=320d79ecbc2342af8031103e7308c10d, user.id=39bbc5ff02d24f40b796bd2245a7431a) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:21.664238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbe588-2d20-4796-9472-00c33a2d5194 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:21.665780 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cbe588-2d20-4796-9472-00c33a2d5194 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:21.675832 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 463/908] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:21 2022] GET /identity/v3/role_assignments?user.id=39bbc5ff02d24f40b796bd2245a7431a&scope.project.id=320d79ecbc2342af8031103e7308c10d&role.id=0876003b49cc4c678dc978764ef54594 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:21.694632 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:21.703998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bf69cc-51b3-4253-9c10-38e2ec1e405c None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:21.749750 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e046517-c764-4a2a-8539-cd4390aeceb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:21.750668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e046517-c764-4a2a-8539-cd4390aeceb6 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:21.751098 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e046517-c764-4a2a-8539-cd4390aeceb6 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:21.751519 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e046517-c764-4a2a-8539-cd4390aeceb6 None admin] PATH_INFO: `/v3/services` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:21.752961 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e046517-c764-4a2a-8539-cd4390aeceb6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:21.753436 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e046517-c764-4a2a-8539-cd4390aeceb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:21.754990 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e046517-c764-4a2a-8539-cd4390aeceb6 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:21.761612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 446/909] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 16 00:14:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:21.766923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbe588-2d20-4796-9472-00c33a2d5194 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:21.876660 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cbe588-2d20-4796-9472-00c33a2d5194 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:21.888152 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:21.912606 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266a72d-f6ac-425a-ba8b-cc96e2f0de76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:21.913327 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266a72d-f6ac-425a-ba8b-cc96e2f0de76 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:21.913615 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266a72d-f6ac-425a-ba8b-cc96e2f0de76 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:21.913894 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e266a72d-f6ac-425a-ba8b-cc96e2f0de76 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:21.914601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266a72d-f6ac-425a-ba8b-cc96e2f0de76 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:21.914909 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266a72d-f6ac-425a-ba8b-cc96e2f0de76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:21.916354 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e266a72d-f6ac-425a-ba8b-cc96e2f0de76 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:21.921718 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 464/910] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 16 00:14:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:21.927170 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e046517-c764-4a2a-8539-cd4390aeceb6 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:22.034794 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e046517-c764-4a2a-8539-cd4390aeceb6 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:22.068842 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d856a9e-2762-43a1-aa9d-faa82badfb76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:22.069497 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d856a9e-2762-43a1-aa9d-faa82badfb76 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:22.069780 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d856a9e-2762-43a1-aa9d-faa82badfb76 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:22.070056 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d856a9e-2762-43a1-aa9d-faa82badfb76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:22.070838 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d856a9e-2762-43a1-aa9d-faa82badfb76 None admin] RBAC: Adding query filter params (interface=public, service_id=b41ebd605d1e40228c6e3c351c64481a, region_id=RegionOne) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:22.071150 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d856a9e-2762-43a1-aa9d-faa82badfb76 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:22.072550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d856a9e-2762-43a1-aa9d-faa82badfb76 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:22.085867 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 447/911] 10.222.0.44 () {56 vars in 1251 bytes} [Thu Jun 16 00:14:21 2022] GET /identity/v3/endpoints?service_id=b41ebd605d1e40228c6e3c351c64481a&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:22.091345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266a72d-f6ac-425a-ba8b-cc96e2f0de76 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:22.192731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e266a72d-f6ac-425a-ba8b-cc96e2f0de76 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:22.227888 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24c184-a921-4e0e-8c91-670c9c779f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:22.228650 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c184-a921-4e0e-8c91-670c9c779f24 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:22.228887 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c184-a921-4e0e-8c91-670c9c779f24 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:22.229173 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24c184-a921-4e0e-8c91-670c9c779f24 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:22.229859 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24c184-a921-4e0e-8c91-670c9c779f24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:22.231235 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24c184-a921-4e0e-8c91-670c9c779f24 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:22.238399 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 465/912] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 16 00:14:22 2022] GET /identity/v3/services => generated 1497 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:14:22.726464 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ced46-aa0e-48e9-9d86-4433c7d8f53b None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:22.727581 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ced46-aa0e-48e9-9d86-4433c7d8f53b None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:22.728117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8ced46-aa0e-48e9-9d86-4433c7d8f53b None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:22.729929 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 448/913] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:22.735236 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf52f2-dcfa-4ffc-b57a-96e3863a4dda None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:22.735539 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf52f2-dcfa-4ffc-b57a-96e3863a4dda None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:22.735852 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bf52f2-dcfa-4ffc-b57a-96e3863a4dda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:22.758863 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-51bf52f2-dcfa-4ffc-b57a-96e3863a4dda None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:22.760086 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-51bf52f2-dcfa-4ffc-b57a-96e3863a4dda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:22.792440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:22.836926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 466/914] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:22.859599 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ced46-aa0e-48e9-9d86-4433c7d8f53b None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:22.885545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:22.963176 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8ced46-aa0e-48e9-9d86-4433c7d8f53b None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:22.996712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cea29f-a272-4515-a7f5-31e89aed5fdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:22.997442 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cea29f-a272-4515-a7f5-31e89aed5fdd None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:22.997714 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cea29f-a272-4515-a7f5-31e89aed5fdd None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:22.997981 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cea29f-a272-4515-a7f5-31e89aed5fdd None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:22.998628 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cea29f-a272-4515-a7f5-31e89aed5fdd None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:23.000020 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cea29f-a272-4515-a7f5-31e89aed5fdd None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:23.012031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-12cea29f-a272-4515-a7f5-31e89aed5fdd None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:14:23.012031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:23.012031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:14:23.012031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:14:23.012031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:14:23.012031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:14:23.012031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:14:23.012031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:23.012031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:14:23.012031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:23.012031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:14:23.012031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:23.012031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:23.012031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:23.012031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:23.012031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:23.012031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:23.013159 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:23.013159 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:23.013159 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:23.013159 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:23.013159 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:23.013159 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:23.013159 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:14:23.013159 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:14:23.013159 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:14:23.013159 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:14:23.013159 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:23.013159 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:23.013159 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:23.013159 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:23.013159 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:23.013159 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:23.014663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:23.014663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:23.014663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:23.014663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:23.014663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:23.014663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:23.014663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:23.014663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:23.014663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:23.014663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:23.014663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:14:23.014663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:23.014663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 16 00:14:23.014663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:23.014663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 449/915] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 00:14:22 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:23.020215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf52f2-dcfa-4ffc-b57a-96e3863a4dda None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:23.118277 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bf52f2-dcfa-4ffc-b57a-96e3863a4dda None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:23.152371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f297d7-9373-41df-8d75-89bb0df13d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:23.153041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f297d7-9373-41df-8d75-89bb0df13d18 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:23.153321 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f297d7-9373-41df-8d75-89bb0df13d18 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:23.153601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f297d7-9373-41df-8d75-89bb0df13d18 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:23.154292 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f297d7-9373-41df-8d75-89bb0df13d18 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:23.154600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f297d7-9373-41df-8d75-89bb0df13d18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:23.155980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f297d7-9373-41df-8d75-89bb0df13d18 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:23.161016 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 467/916] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 00:14:23 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:23.166573 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cea29f-a272-4515-a7f5-31e89aed5fdd None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:23.270298 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:23.286357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cea29f-a272-4515-a7f5-31e89aed5fdd None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:23.330634 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f4a0ca-7679-4d58-9d3d-f66886de8cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:23.331316 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4a0ca-7679-4d58-9d3d-f66886de8cdf None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:23.331604 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4a0ca-7679-4d58-9d3d-f66886de8cdf None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:23.331919 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f4a0ca-7679-4d58-9d3d-f66886de8cdf None admin] PATH_INFO: `/v3/services` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:23.332636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4a0ca-7679-4d58-9d3d-f66886de8cdf None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:23.332950 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4a0ca-7679-4d58-9d3d-f66886de8cdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:23.334337 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f4a0ca-7679-4d58-9d3d-f66886de8cdf None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:23.339979 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 450/917] 10.222.0.44 () {56 vars in 1114 bytes} [Thu Jun 16 00:14:23 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:23.345335 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f297d7-9373-41df-8d75-89bb0df13d18 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:23.400796 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:23.457507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f297d7-9373-41df-8d75-89bb0df13d18 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:23.498085 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0daf3-09f5-4dba-aa48-eed8e49a74db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:23.498766 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0daf3-09f5-4dba-aa48-eed8e49a74db None admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:23.499054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0daf3-09f5-4dba-aa48-eed8e49a74db None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:23.499339 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0daf3-09f5-4dba-aa48-eed8e49a74db None admin] PATH_INFO: `/v3/endpoints` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:23.500197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0daf3-09f5-4dba-aa48-eed8e49a74db None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:23.501581 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0daf3-09f5-4dba-aa48-eed8e49a74db None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:23.521546 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f95ef7-39c6-4934-8225-aa1849c1d8a1 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:23.521799 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f95ef7-39c6-4934-8225-aa1849c1d8a1 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:23.522028 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f95ef7-39c6-4934-8225-aa1849c1d8a1 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:23.523651 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 451/918] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:23.524708 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 468/919] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 16 00:14:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:23.528861 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eb510-0f89-4f35-aa99-e415bd8099e5 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:23.529157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eb510-0f89-4f35-aa99-e415bd8099e5 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:23.529415 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366eb510-0f89-4f35-aa99-e415bd8099e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:23.553075 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-366eb510-0f89-4f35-aa99-e415bd8099e5 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:23.554392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-366eb510-0f89-4f35-aa99-e415bd8099e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:23.647272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 452/920] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:23 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:14:23.670543 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0daf3-09f5-4dba-aa48-eed8e49a74db None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:23.776074 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:23.792290 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0daf3-09f5-4dba-aa48-eed8e49a74db None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:23.832401 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185c5b3-6aef-49c7-9b4b-8e4df79d0e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:23.833222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185c5b3-6aef-49c7-9b4b-8e4df79d0e30 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:23.833505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185c5b3-6aef-49c7-9b4b-8e4df79d0e30 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:23.833781 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5185c5b3-6aef-49c7-9b4b-8e4df79d0e30 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:23.834438 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185c5b3-6aef-49c7-9b4b-8e4df79d0e30 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:23.835863 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5185c5b3-6aef-49c7-9b4b-8e4df79d0e30 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:23.848136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-5185c5b3-6aef-49c7-9b4b-8e4df79d0e30 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:14:23.848136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:23.848136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:14:23.848136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:14:23.848136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:14:23.848136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:14:23.848136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:14:23.848136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:23.848136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:14:23.848136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:23.848136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:14:23.848136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:23.848136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:23.848136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:23.848136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:23.848136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:23.848136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:23.849174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:23.849174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:23.849174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:23.849174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:23.849174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:23.849174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:23.849174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:14:23.849174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:14:23.849174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:14:23.849174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:14:23.849174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:23.849174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:23.849174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:23.849174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:23.849174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:23.849174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:23.850008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:23.850008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:23.850008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:23.850008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:23.850008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:23.850008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:23.850008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:23.850008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:23.850008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:23.850008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:23.850008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:14:23.850008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:23.850008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:14:23.850008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:23.850008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 469/921] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 16 00:14:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:23.856106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366eb510-0f89-4f35-aa99-e415bd8099e5 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:23.936912 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:23.964758 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366eb510-0f89-4f35-aa99-e415bd8099e5 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:24.003739 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249da1d-21c5-4910-a66e-76c865a6af49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:24.004464 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249da1d-21c5-4910-a66e-76c865a6af49 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:24.004757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249da1d-21c5-4910-a66e-76c865a6af49 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:24.005030 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249da1d-21c5-4910-a66e-76c865a6af49 None admin] PATH_INFO: `/v3/services` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:24.005995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249da1d-21c5-4910-a66e-76c865a6af49 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:24.006303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249da1d-21c5-4910-a66e-76c865a6af49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:24.007708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249da1d-21c5-4910-a66e-76c865a6af49 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:24.012994 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 453/922] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 16 00:14:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:24.019104 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185c5b3-6aef-49c7-9b4b-8e4df79d0e30 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:24.036816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9e4d1-ea2d-4b5c-8a61-9de30b962249 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:24.037122 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9e4d1-ea2d-4b5c-8a61-9de30b962249 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:24.037806 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee9e4d1-ea2d-4b5c-8a61-9de30b962249 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:24.039813 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 454/923] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:24.045035 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57de01e-9b6e-42c0-998d-3118de524635 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:24.045328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57de01e-9b6e-42c0-998d-3118de524635 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:24.045612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57de01e-9b6e-42c0-998d-3118de524635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:24.063132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-e57de01e-9b6e-42c0-998d-3118de524635 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:24.064365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e57de01e-9b6e-42c0-998d-3118de524635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:24.134800 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5185c5b3-6aef-49c7-9b4b-8e4df79d0e30 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:24.143754 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 455/924] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:14:24.166945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57de01e-9b6e-42c0-998d-3118de524635 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:24.177625 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860411e4-66d1-4152-a281-a04613532cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:24.178301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860411e4-66d1-4152-a281-a04613532cfa None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:24.178588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860411e4-66d1-4152-a281-a04613532cfa None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:24.178931 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860411e4-66d1-4152-a281-a04613532cfa None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:24.179667 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860411e4-66d1-4152-a281-a04613532cfa None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:24.180035 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860411e4-66d1-4152-a281-a04613532cfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:24.181413 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860411e4-66d1-4152-a281-a04613532cfa None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:24.187071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 470/925] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 16 00:14:24 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:24.193087 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860411e4-66d1-4152-a281-a04613532cfa None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:24.217273 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:24.251267 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:24.285964 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57de01e-9b6e-42c0-998d-3118de524635 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:24.324854 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2405dd7-4532-46fa-8b83-75ad2d4dc6d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:24.325392 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860411e4-66d1-4152-a281-a04613532cfa None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:24.326136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2405dd7-4532-46fa-8b83-75ad2d4dc6d7 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:24.326587 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2405dd7-4532-46fa-8b83-75ad2d4dc6d7 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:24.327058 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2405dd7-4532-46fa-8b83-75ad2d4dc6d7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:24.338384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2405dd7-4532-46fa-8b83-75ad2d4dc6d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:24.347493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-d2405dd7-4532-46fa-8b83-75ad2d4dc6d7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:14:24.347493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:24.347493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:24.347493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:24.347493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:24.347493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:24.347493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:24.347493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:24.347493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:24.347493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:24.347493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:24.347493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:24.347493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:24.347493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:24.347493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:24.347493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:24.348712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:24.348712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:24.348712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:24.348712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:24.348712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:24.348712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:24.348712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:24.348712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:24.348712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:24.348712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:24.348712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:24.348712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:24.348712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:24.348712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:24.348712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:24.348712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:24.349716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:24.349716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:24.349716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:24.349716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:24.349716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:24.349716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:24.349716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:24.349716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:24.349716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:24.349716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:24.349716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:14:24.349716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:24.352034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 456/926] 10.222.0.44 () {56 vars in 1120 bytes} [Thu Jun 16 00:14:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:24.357783 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2405dd7-4532-46fa-8b83-75ad2d4dc6d7 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:24.370496 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2d44c-0a1d-4cee-8d43-82db036e80e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:24.371539 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2d44c-0a1d-4cee-8d43-82db036e80e0 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:24.371861 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2d44c-0a1d-4cee-8d43-82db036e80e0 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:24.372149 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad2d44c-0a1d-4cee-8d43-82db036e80e0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:24.373283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2d44c-0a1d-4cee-8d43-82db036e80e0 None admin] RBAC: Adding query filter params (interface=public, service_id=4b83334bcf22497da829c54fb3fd4c7f, region_id=RegionOne) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:24.373752 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2d44c-0a1d-4cee-8d43-82db036e80e0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:24.375272 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad2d44c-0a1d-4cee-8d43-82db036e80e0 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:24.383767 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 471/927] 10.222.0.44 () {56 vars in 1251 bytes} [Thu Jun 16 00:14:24 2022] GET /identity/v3/endpoints?service_id=4b83334bcf22497da829c54fb3fd4c7f&interface=public®ion_id=RegionOne => generated 194 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:24.388922 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2d44c-0a1d-4cee-8d43-82db036e80e0 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:24.474994 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2405dd7-4532-46fa-8b83-75ad2d4dc6d7 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:24.498523 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:24.505197 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:24.512164 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea7d78-b154-49da-8f7d-236528c4fdbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:24.512833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea7d78-b154-49da-8f7d-236528c4fdbc None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:24.513117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea7d78-b154-49da-8f7d-236528c4fdbc None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:24.513392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea7d78-b154-49da-8f7d-236528c4fdbc None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:24.514139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea7d78-b154-49da-8f7d-236528c4fdbc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:24.514447 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea7d78-b154-49da-8f7d-236528c4fdbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:24.515842 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea7d78-b154-49da-8f7d-236528c4fdbc None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:24.521230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad2d44c-0a1d-4cee-8d43-82db036e80e0 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:24.525468 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 457/928] 10.222.0.44 () {56 vars in 1115 bytes} [Thu Jun 16 00:14:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:24.526899 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc813ad-5d71-483b-9a40-9b3a826c284c None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:24.527189 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc813ad-5d71-483b-9a40-9b3a826c284c None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:24.527460 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc813ad-5d71-483b-9a40-9b3a826c284c None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:24.532600 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 458/929] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:24.532600 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc813ad-5d71-483b-9a40-9b3a826c284c None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:24.565323 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f8f547-705f-4816-8d5e-ba5cd0a2fe93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:24.566218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8f547-705f-4816-8d5e-ba5cd0a2fe93 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:24.566673 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8f547-705f-4816-8d5e-ba5cd0a2fe93 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:24.567114 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f8f547-705f-4816-8d5e-ba5cd0a2fe93 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:24.567967 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8f547-705f-4816-8d5e-ba5cd0a2fe93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:24.569513 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f8f547-705f-4816-8d5e-ba5cd0a2fe93 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:24.575996 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 472/930] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 16 00:14:24 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:14:24.577387 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae93d9-91a2-4642-9554-5ad5f92bbfbe None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:24.577680 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae93d9-91a2-4642-9554-5ad5f92bbfbe None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:24.577960 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bae93d9-91a2-4642-9554-5ad5f92bbfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:24.600398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-0bae93d9-91a2-4642-9554-5ad5f92bbfbe None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:24.602024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-0bae93d9-91a2-4642-9554-5ad5f92bbfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:24.667455 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc813ad-5d71-483b-9a40-9b3a826c284c None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:24.688040 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 473/931] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:24 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:24.706223 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae93d9-91a2-4642-9554-5ad5f92bbfbe None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:24.710858 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed557f-8b0b-4ac9-b3c4-bd5935c61cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:24.711729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed557f-8b0b-4ac9-b3c4-bd5935c61cce None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:24.712021 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed557f-8b0b-4ac9-b3c4-bd5935c61cce None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:24.712300 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bed557f-8b0b-4ac9-b3c4-bd5935c61cce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:24.728150 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed557f-8b0b-4ac9-b3c4-bd5935c61cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:24.730135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bed557f-8b0b-4ac9-b3c4-bd5935c61cce None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:24.753911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-6bed557f-8b0b-4ac9-b3c4-bd5935c61cce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:24.753911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:24.753911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:24.753911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:24.753911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:24.753911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:24.753911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:24.753911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:24.753911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:24.753911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:24.753911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:24.753911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:24.753911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:24.753911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:24.753911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:24.754881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:24.754881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:24.754881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:24.754881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:24.754881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:24.754881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:24.754881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:24.754881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:24.754881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:24.754881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:24.754881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:24.754881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:24.754881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:24.754881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:24.754881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:24.754881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:24.754881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:24.756064 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:24.756064 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:24.756064 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:24.756064 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:24.758065 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 459/932] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:24.763337 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed557f-8b0b-4ac9-b3c4-bd5935c61cce None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:24.811653 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:24.818935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:24.843373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bae93d9-91a2-4642-9554-5ad5f92bbfbe None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:24.887673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bed557f-8b0b-4ac9-b3c4-bd5935c61cce None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:24.893406 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e84149-9b9e-476e-8143-e7eb7c9a7774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:24.894487 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e84149-9b9e-476e-8143-e7eb7c9a7774 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:24.895033 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e84149-9b9e-476e-8143-e7eb7c9a7774 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:24.896081 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e84149-9b9e-476e-8143-e7eb7c9a7774 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:24.896957 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e84149-9b9e-476e-8143-e7eb7c9a7774 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:24.899427 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e84149-9b9e-476e-8143-e7eb7c9a7774 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:24.914593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-55e84149-9b9e-476e-8143-e7eb7c9a7774 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:14:24.914593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:24.914593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:14:24.914593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:14:24.914593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:14:24.914593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:14:24.914593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:14:24.914593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:24.914593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:14:24.914593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:24.914593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:14:24.914593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:24.914593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:24.914593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:24.914593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:24.914593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:24.915560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:24.915560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:24.915560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:24.915560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:24.915560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:24.915560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:24.915560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:24.915560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:14:24.915560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:14:24.915560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:14:24.915560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:14:24.915560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:24.915560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:24.915560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:24.915560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:24.915560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:24.916440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:24.916440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:24.916440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:24.916440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:24.916440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:24.916440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:24.916440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:24.916440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:24.916440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:24.916440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:24.916440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:24.916440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:14:24.916440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:24.916440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 16 00:14:24.916440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:24.919467 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 474/933] 10.222.0.44 () {56 vars in 1132 bytes} [Thu Jun 16 00:14:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:24.923536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdc9e8-bd3e-4b2f-9ae2-42862c316d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:24.924808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdc9e8-bd3e-4b2f-9ae2-42862c316d90 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:24.925095 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdc9e8-bd3e-4b2f-9ae2-42862c316d90 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:24.925371 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57bdc9e8-bd3e-4b2f-9ae2-42862c316d90 None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:24.925992 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e84149-9b9e-476e-8143-e7eb7c9a7774 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:24.926111 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bdc9e8-bd3e-4b2f-9ae2-42862c316d90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:24.926392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bdc9e8-bd3e-4b2f-9ae2-42862c316d90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:24.927852 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57bdc9e8-bd3e-4b2f-9ae2-42862c316d90 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:24.940790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 460/934] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:24.946341 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdc9e8-bd3e-4b2f-9ae2-42862c316d90 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:25.045465 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e84149-9b9e-476e-8143-e7eb7c9a7774 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:25.056762 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57bdc9e8-bd3e-4b2f-9ae2-42862c316d90 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:25.059691 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:25.080250 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b3acd-4d5e-4877-b633-3f06a47ad885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:25.081463 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b3acd-4d5e-4877-b633-3f06a47ad885 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:25.081740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b3acd-4d5e-4877-b633-3f06a47ad885 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:25.082019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b3acd-4d5e-4877-b633-3f06a47ad885 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:25.082729 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b3acd-4d5e-4877-b633-3f06a47ad885 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:25.083038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b3acd-4d5e-4877-b633-3f06a47ad885 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:25.084450 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9b3acd-4d5e-4877-b633-3f06a47ad885 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:25.089665 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 475/935] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 16 00:14:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:25.094811 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b3acd-4d5e-4877-b633-3f06a47ad885 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:25.097498 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:25.100864 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc559a-1de4-49f5-a873-d34045cb9777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:25.102023 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc559a-1de4-49f5-a873-d34045cb9777 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:25.102521 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc559a-1de4-49f5-a873-d34045cb9777 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:25.103014 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcc559a-1de4-49f5-a873-d34045cb9777 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:25.110926 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc559a-1de4-49f5-a873-d34045cb9777 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:25.113414 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcc559a-1de4-49f5-a873-d34045cb9777 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:25.129052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-2bcc559a-1de4-49f5-a873-d34045cb9777 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:14:25.129052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:25.129052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:25.129052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:25.129052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:25.129052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:25.129052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:25.129052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:25.129052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:25.129052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:25.129052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:25.129052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:25.129052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:14:25.129052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:14:25.129052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:14:25.129052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:14:25.130034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:25.130034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:25.130034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:14:25.130034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:25.130034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:14:25.130034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:25.130034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:25.130034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:25.130034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:25.130034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:25.130034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:25.130034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:25.130034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:25.130034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:25.130034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:25.130034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:25.130034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:25.130034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:25.131279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:25.131279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:25.131279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:14:25.131279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:14:25.131279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:14:25.131279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:14:25.131279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:14:25.131279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:14:25.131279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:14:25.131279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:25.138420 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 461/936] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 16 00:14:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:25.139494 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc559a-1de4-49f5-a873-d34045cb9777 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:25.206567 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9b3acd-4d5e-4877-b633-3f06a47ad885 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:25.242492 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f933e67-d59d-40c7-a5e4-6c383824e4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:25.243155 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f933e67-d59d-40c7-a5e4-6c383824e4ed None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:25.243435 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f933e67-d59d-40c7-a5e4-6c383824e4ed None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:25.243738 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f933e67-d59d-40c7-a5e4-6c383824e4ed None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:25.244440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f933e67-d59d-40c7-a5e4-6c383824e4ed None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:25.244747 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f933e67-d59d-40c7-a5e4-6c383824e4ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:25.245499 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcc559a-1de4-49f5-a873-d34045cb9777 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:25.246105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f933e67-d59d-40c7-a5e4-6c383824e4ed None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:25.255777 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 476/937] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 16 00:14:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:25.257255 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f933e67-d59d-40c7-a5e4-6c383824e4ed None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:25.283070 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16864ce4-494f-4e26-8225-19a7c5e597d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:25.284223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16864ce4-494f-4e26-8225-19a7c5e597d5 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:25.284738 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16864ce4-494f-4e26-8225-19a7c5e597d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:25.285273 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16864ce4-494f-4e26-8225-19a7c5e597d5 None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:25.286375 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16864ce4-494f-4e26-8225-19a7c5e597d5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:25.286942 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16864ce4-494f-4e26-8225-19a7c5e597d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:25.288620 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16864ce4-494f-4e26-8225-19a7c5e597d5 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:25.312287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 462/938] 10.222.0.44 () {56 vars in 1149 bytes} [Thu Jun 16 00:14:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:25.313525 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16864ce4-494f-4e26-8225-19a7c5e597d5 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:25.336440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:25.344419 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:25.375903 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f933e67-d59d-40c7-a5e4-6c383824e4ed None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:25.418981 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d3c19-6eaf-4329-b1f9-bf2787780a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:25.419679 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d3c19-6eaf-4329-b1f9-bf2787780a37 None admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:25.419973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d3c19-6eaf-4329-b1f9-bf2787780a37 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:25.420402 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d3c19-6eaf-4329-b1f9-bf2787780a37 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:25.421593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d3c19-6eaf-4329-b1f9-bf2787780a37 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:25.423315 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6d3c19-6eaf-4329-b1f9-bf2787780a37 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:25.446118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16864ce4-494f-4e26-8225-19a7c5e597d5 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:25.448653 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 477/939] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 16 00:14:25 2022] POST /identity/v3/endpoints => generated 347 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:14:25.495011 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24298780-22c8-4d37-9f05-1160357f32f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:25.496325 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24298780-22c8-4d37-9f05-1160357f32f7 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:25.496873 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24298780-22c8-4d37-9f05-1160357f32f7 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:25.497307 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24298780-22c8-4d37-9f05-1160357f32f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:25.511473 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24298780-22c8-4d37-9f05-1160357f32f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:25.513435 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24298780-22c8-4d37-9f05-1160357f32f7 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:25.534759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-24298780-22c8-4d37-9f05-1160357f32f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:25.534759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:25.534759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:25.534759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:25.534759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:25.534759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:25.534759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:25.534759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:25.534759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:25.534759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:25.534759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:25.534759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:25.534759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:25.534759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:25.534759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:25.535997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:25.535997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:25.535997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:25.535997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:25.535997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:25.535997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:25.535997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:25.535997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:25.535997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:25.535997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:25.535997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:25.535997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:25.535997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:25.535997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:25.535997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:25.535997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:25.535997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:25.537155 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:25.537155 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:25.537155 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:25.537155 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:25.539815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 463/940] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:25.546193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d3c19-6eaf-4329-b1f9-bf2787780a37 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:25.659844 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d3c19-6eaf-4329-b1f9-bf2787780a37 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:25.684111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:25.697620 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a869f5-a5bd-4d2b-ac7e-1210346032b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:25.698293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a869f5-a5bd-4d2b-ac7e-1210346032b5 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:25.698579 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a869f5-a5bd-4d2b-ac7e-1210346032b5 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:25.698861 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a869f5-a5bd-4d2b-ac7e-1210346032b5 None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:25.699586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a869f5-a5bd-4d2b-ac7e-1210346032b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:25.699927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a869f5-a5bd-4d2b-ac7e-1210346032b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:25.701300 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a869f5-a5bd-4d2b-ac7e-1210346032b5 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:25.714864 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 478/941] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:25.720636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24298780-22c8-4d37-9f05-1160357f32f7 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:25.812034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:25.847952 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24298780-22c8-4d37-9f05-1160357f32f7 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:25.883922 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c85066-3183-464f-b4a1-4ef95ab791b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:25.884731 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c85066-3183-464f-b4a1-4ef95ab791b9 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:25.885026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c85066-3183-464f-b4a1-4ef95ab791b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:25.885303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c85066-3183-464f-b4a1-4ef95ab791b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:25.889122 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00211b58-8f6c-47e6-b4fc-e7a902be5a30 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:25.889417 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00211b58-8f6c-47e6-b4fc-e7a902be5a30 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:25.889699 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00211b58-8f6c-47e6-b4fc-e7a902be5a30 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:25.891277 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 479/942] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:25.892376 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c85066-3183-464f-b4a1-4ef95ab791b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:25.894423 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c85066-3183-464f-b4a1-4ef95ab791b9 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:25.896738 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f1809-7b3a-4c9d-b315-c48d88bb079c None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:25.897031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f1809-7b3a-4c9d-b315-c48d88bb079c None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:25.897309 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f1809-7b3a-4c9d-b315-c48d88bb079c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:25.908892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-38c85066-3183-464f-b4a1-4ef95ab791b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:25.908892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:25.908892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:25.908892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:25.908892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:25.908892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:25.908892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:25.908892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:25.908892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:25.908892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:25.908892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:25.908892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:25.908892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:14:25.908892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:14:25.908892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:14:25.909816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:14:25.909816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:25.909816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:25.909816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:25.909816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:25.909816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:25.909816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:25.909816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:25.909816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:25.909816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:25.909816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:25.909816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:25.909816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:25.909816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:25.909816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:25.909816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:25.909816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:25.910751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:14:25.910751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:14:25.910751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:14:25.910751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:14:25.910751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:14:25.910751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:14:25.910751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:25.910751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:25.910751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 464/943] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:25.915793 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c85066-3183-464f-b4a1-4ef95ab791b9 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:25.918828 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-bc1f1809-7b3a-4c9d-b315-c48d88bb079c None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:25.920158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-bc1f1809-7b3a-4c9d-b315-c48d88bb079c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:25.997067 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 480/944] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:25 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:14:26.015514 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f1809-7b3a-4c9d-b315-c48d88bb079c None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:26.020517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c85066-3183-464f-b4a1-4ef95ab791b9 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:26.061749 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a52e8-e7ec-4212-b0f8-0adc742340e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:26.062423 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a52e8-e7ec-4212-b0f8-0adc742340e1 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:26.062757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a52e8-e7ec-4212-b0f8-0adc742340e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:26.063048 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a52e8-e7ec-4212-b0f8-0adc742340e1 None admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:26.063869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a52e8-e7ec-4212-b0f8-0adc742340e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:26.064190 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a52e8-e7ec-4212-b0f8-0adc742340e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:26.066644 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a52e8-e7ec-4212-b0f8-0adc742340e1 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:26.084044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:26.087017 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 465/945] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:14:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:26.088082 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a52e8-e7ec-4212-b0f8-0adc742340e1 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:26.146044 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f1809-7b3a-4c9d-b315-c48d88bb079c None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:26.164428 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:26.193386 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb8291-b0a0-4fc1-ae46-7943980dbfd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:26.194581 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb8291-b0a0-4fc1-ae46-7943980dbfd7 None admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:26.195027 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb8291-b0a0-4fc1-ae46-7943980dbfd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:26.195899 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb8291-b0a0-4fc1-ae46-7943980dbfd7 None admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:26.197051 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb8291-b0a0-4fc1-ae46-7943980dbfd7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:26.199303 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb8291-b0a0-4fc1-ae46-7943980dbfd7 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:26.201125 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: WARNING keystone.server.flask.common [None req-02cb8291-b0a0-4fc1-ae46-7943980dbfd7 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 16 00:14:26.201788 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a52e8-e7ec-4212-b0f8-0adc742340e1 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:26.223748 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.sql.core [None req-02cb8291-b0a0-4fc1-ae46-7943980dbfd7 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 00:14:26.223748 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 00:14:26.223748 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [parameters: {'id': '89cac8cba90c45a8acb179864e7cf295', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 00:14:26.223748 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86524) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 00:14:26.240083 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6349bc-d989-4714-8b40-ef5f70208ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:26.241200 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6349bc-d989-4714-8b40-ef5f70208ef0 None admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:26.241586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6349bc-d989-4714-8b40-ef5f70208ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:26.241992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6349bc-d989-4714-8b40-ef5f70208ef0 None admin] PATH_INFO: `/v3/projects/320d79ecbc2342af8031103e7308c10d/users/39bbc5ff02d24f40b796bd2245a7431a/roles/0876003b49cc4c678dc978764ef54594` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:26.244523 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6349bc-d989-4714-8b40-ef5f70208ef0 None admin] RBAC: Authorizing `identity:create_grant(project_id=320d79ecbc2342af8031103e7308c10d, user_id=39bbc5ff02d24f40b796bd2245a7431a, role_id=0876003b49cc4c678dc978764ef54594)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:26.246083 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6349bc-d989-4714-8b40-ef5f70208ef0 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:26.246399 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-02cb8291-b0a0-4fc1-ae46-7943980dbfd7 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 89cac8cba90c45a8acb179864e7cf295.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 89cac8cba90c45a8acb179864e7cf295. Jun 16 00:14:26.246399 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:26.246399 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 00:14:26.246399 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 00:14:26.246399 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 00:14:26.246399 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 00:14:26.246399 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 00:14:26.246399 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 00:14:26.246399 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 00:14:26.246399 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application conn.query(q) Jun 16 00:14:26.246399 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 00:14:26.246399 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 00:14:26.246399 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 00:14:26.247342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application result.read() Jun 16 00:14:26.247342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 00:14:26.247342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 00:14:26.247342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 00:14:26.247342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 00:14:26.247342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 00:14:26.247342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 00:14:26.247342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 00:14:26.247342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 00:14:26.247342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 00:14:26.247342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:26.247342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 00:14:26.247342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:26.247342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:26.247342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 00:14:26.247342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 00:14:26.247342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 16 00:14:26.247342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 16 00:14:26.248365 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 00:14:26.248365 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application next(self.gen) Jun 16 00:14:26.248365 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 00:14:26.248365 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application yield resource Jun 16 00:14:26.248365 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 00:14:26.248365 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application next(self.gen) Jun 16 00:14:26.248365 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 00:14:26.248365 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 00:14:26.248365 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 00:14:26.248365 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 00:14:26.248365 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 00:14:26.248365 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise self.value Jun 16 00:14:26.248365 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 00:14:26.248365 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 00:14:26.248365 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 00:14:26.248365 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application session.commit() Jun 16 00:14:26.248365 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 00:14:26.249283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 00:14:26.249283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 00:14:26.249283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 00:14:26.249283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 00:14:26.249283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self.session.flush() Jun 16 00:14:26.249283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 00:14:26.249283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 00:14:26.249283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 00:14:26.249283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 00:14:26.249283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 00:14:26.249283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application compat.raise_( Jun 16 00:14:26.249283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 00:14:26.249283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception Jun 16 00:14:26.249283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 00:14:26.249283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 00:14:26.249283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 00:14:26.249283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 00:14:26.250669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 00:14:26.250669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 00:14:26.250669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 00:14:26.250669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 00:14:26.250669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 16 00:14:26.250669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 16 00:14:26.250669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 00:14:26.250669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 00:14:26.250669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 00:14:26.250669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 00:14:26.250669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 00:14:26.250669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 00:14:26.250669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 00:14:26.250669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 00:14:26.250669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 00:14:26.251730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 00:14:26.251730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 00:14:26.251730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception Jun 16 00:14:26.251730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 00:14:26.251730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 00:14:26.251730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 00:14:26.251730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 00:14:26.251730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 00:14:26.251730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 00:14:26.251730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 00:14:26.251730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application conn.query(q) Jun 16 00:14:26.251730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 00:14:26.251730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 00:14:26.251730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 00:14:26.251730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application result.read() Jun 16 00:14:26.251730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 00:14:26.251730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 00:14:26.253375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 00:14:26.253375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 00:14:26.253375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 00:14:26.253375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 00:14:26.253375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 00:14:26.253375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 00:14:26.253375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 16 00:14:26.253375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 16 00:14:26.253375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [parameters: {'id': '89cac8cba90c45a8acb179864e7cf295', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 16 00:14:26.253375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 00:14:26.253375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:26.253375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:14:26.253375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:26.253375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:26.253375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 16 00:14:26.255747 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 16 00:14:26.255747 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 00:14:26.255747 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 00:14:26.255747 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 16 00:14:26.255747 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:26.255747 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:14:26.255747 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:26.255747 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:26.255747 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:26.255747 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:26.255747 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:26.255747 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:26.255747 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:26.255747 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:26.255747 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:26.255747 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:26.255747 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:26.256945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:26.256945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 16 00:14:26.256945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 16 00:14:26.256945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:26.256945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:26.256945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 16 00:14:26.256945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 16 00:14:26.256945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 89cac8cba90c45a8acb179864e7cf295. Jun 16 00:14:26.256945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:26.264056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 481/946] 10.222.0.44 () {60 vars in 1140 bytes} [Thu Jun 16 00:14:26 2022] POST /identity/v3/projects => generated 262 bytes in 249 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:26.266436 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb8291-b0a0-4fc1-ae46-7943980dbfd7 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:26.267336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 466/947] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 00:14:26 2022] PUT /identity/v3/projects/320d79ecbc2342af8031103e7308c10d/users/39bbc5ff02d24f40b796bd2245a7431a/roles/0876003b49cc4c678dc978764ef54594 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:14:26.385037 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb8291-b0a0-4fc1-ae46-7943980dbfd7 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:26.423721 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ef0232-fe98-4c28-b184-d4f911ae31db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:26.424922 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef0232-fe98-4c28-b184-d4f911ae31db None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:26.425405 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef0232-fe98-4c28-b184-d4f911ae31db None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:26.425862 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef0232-fe98-4c28-b184-d4f911ae31db None admin] PATH_INFO: `/v3/projects/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:26.433884 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef0232-fe98-4c28-b184-d4f911ae31db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:26.436463 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ef0232-fe98-4c28-b184-d4f911ae31db None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:26.452111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-60ef0232-fe98-4c28-b184-d4f911ae31db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:26.452111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:26.452111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:26.452111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:26.452111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:26.452111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:26.452111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:26.452111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:26.452111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:26.452111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:26.452111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:26.452111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:26.452111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:14:26.452111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:14:26.452111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:14:26.453010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:14:26.453010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:26.453010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:26.453010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:26.453010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:26.453010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:26.453010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:26.453010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:26.453010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:26.453010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:26.453010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:26.453010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:26.453010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:26.453010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:26.453010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:26.453010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:26.453010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:26.453899 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:14:26.453899 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:14:26.453899 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:14:26.453899 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:14:26.453899 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:14:26.453899 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:14:26.453899 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:26.453899 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:26.456034 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 482/948] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:26.462156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6349bc-d989-4714-8b40-ef5f70208ef0 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:26.523309 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:26.577336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6349bc-d989-4714-8b40-ef5f70208ef0 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:26.616822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63590d03-d6e5-4535-9abb-aefdd9bc3e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:26.617828 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63590d03-d6e5-4535-9abb-aefdd9bc3e9f None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:26.618345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63590d03-d6e5-4535-9abb-aefdd9bc3e9f None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:26.618801 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63590d03-d6e5-4535-9abb-aefdd9bc3e9f None admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:26.619763 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63590d03-d6e5-4535-9abb-aefdd9bc3e9f None admin] RBAC: Adding query filter params (name=service) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:26.620255 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63590d03-d6e5-4535-9abb-aefdd9bc3e9f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:26.621897 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63590d03-d6e5-4535-9abb-aefdd9bc3e9f None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:26.641716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 467/949] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 16 00:14:26 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:26.813384 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185e2a5-8e08-4503-b149-5b2a7a55af49 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:26.813674 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185e2a5-8e08-4503-b149-5b2a7a55af49 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:26.813957 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7185e2a5-8e08-4503-b149-5b2a7a55af49 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:26.818994 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 483/950] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:26.824210 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dedd81-b020-4656-95a5-4635cd252072 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:26.824500 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dedd81-b020-4656-95a5-4635cd252072 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:26.824783 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dedd81-b020-4656-95a5-4635cd252072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:26.842303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-c1dedd81-b020-4656-95a5-4635cd252072 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:26.843505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-c1dedd81-b020-4656-95a5-4635cd252072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:26.915394 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 468/951] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:26 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:26.939380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185e2a5-8e08-4503-b149-5b2a7a55af49 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:26.970525 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:27.047976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7185e2a5-8e08-4503-b149-5b2a7a55af49 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:27.084541 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f19221-d358-4ddf-a9ab-133051a2867a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:27.085279 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f19221-d358-4ddf-a9ab-133051a2867a None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:27.085567 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f19221-d358-4ddf-a9ab-133051a2867a None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:27.085851 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f19221-d358-4ddf-a9ab-133051a2867a None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:27.086519 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f19221-d358-4ddf-a9ab-133051a2867a None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:27.087926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f19221-d358-4ddf-a9ab-133051a2867a None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:27.100347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-e4f19221-d358-4ddf-a9ab-133051a2867a None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:14:27.100347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:27.100347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:14:27.100347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:14:27.100347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:14:27.100347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:14:27.100347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:14:27.100347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:27.100347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:14:27.100347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:27.100347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:14:27.100347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:27.100347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:27.100347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:27.100347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:27.100347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:27.100347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:27.101371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:27.101371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:27.101371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:27.101371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:27.101371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:27.101371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:27.101371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:14:27.101371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:14:27.101371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:14:27.101371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:14:27.101371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:27.101371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:27.101371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:27.101371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:27.101371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:27.101371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:27.102678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:27.102678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:27.102678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:27.102678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:27.102678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:27.102678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:27.102678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:27.102678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:27.102678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:27.102678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:27.102678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:14:27.102678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:27.102678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:14:27.102678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:27.102678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 484/952] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 16 00:14:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:27.110027 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dedd81-b020-4656-95a5-4635cd252072 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:27.159038 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:27.218494 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dedd81-b020-4656-95a5-4635cd252072 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:27.263094 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c2e9c-9aca-4080-abc7-fba8b8025b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:27.263801 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c2e9c-9aca-4080-abc7-fba8b8025b9b None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:27.264094 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c2e9c-9aca-4080-abc7-fba8b8025b9b None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:27.264377 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741c2e9c-9aca-4080-abc7-fba8b8025b9b None admin] PATH_INFO: `/v3/services` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:27.265091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c2e9c-9aca-4080-abc7-fba8b8025b9b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:27.265405 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c2e9c-9aca-4080-abc7-fba8b8025b9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:27.266867 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741c2e9c-9aca-4080-abc7-fba8b8025b9b None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:27.272850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 469/953] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 16 00:14:27 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:27.278463 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f19221-d358-4ddf-a9ab-133051a2867a None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:27.375055 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:27.384110 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f19221-d358-4ddf-a9ab-133051a2867a None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:27.419389 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d49273-03f1-4ce0-ab71-ff5c4ca8cbfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:27.420193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d49273-03f1-4ce0-ab71-ff5c4ca8cbfd None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:27.420372 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d49273-03f1-4ce0-ab71-ff5c4ca8cbfd None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:27.420644 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d49273-03f1-4ce0-ab71-ff5c4ca8cbfd None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:27.421359 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d49273-03f1-4ce0-ab71-ff5c4ca8cbfd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:27.421673 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d49273-03f1-4ce0-ab71-ff5c4ca8cbfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:27.423038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d49273-03f1-4ce0-ab71-ff5c4ca8cbfd None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:27.429111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 485/954] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 16 00:14:27 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:27.436819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c2e9c-9aca-4080-abc7-fba8b8025b9b None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:27.551837 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741c2e9c-9aca-4080-abc7-fba8b8025b9b None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:27.554330 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:27.589256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8491cf-0d88-459a-b4ac-65d5d3763de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:27.589932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8491cf-0d88-459a-b4ac-65d5d3763de1 None admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:27.590226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8491cf-0d88-459a-b4ac-65d5d3763de1 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:27.590507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8491cf-0d88-459a-b4ac-65d5d3763de1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:27.591251 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8491cf-0d88-459a-b4ac-65d5d3763de1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:27.592667 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8491cf-0d88-459a-b4ac-65d5d3763de1 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:27.613477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 470/955] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 16 00:14:27 2022] POST /identity/v3/endpoints => generated 349 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:27.707196 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3be0a-81c6-42bc-b139-87f2bacea89c None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:27.707534 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3be0a-81c6-42bc-b139-87f2bacea89c None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:27.707820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3be0a-81c6-42bc-b139-87f2bacea89c None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:27.709472 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 486/956] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:27.715393 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b593b-8977-49bd-9282-02138e371f8a None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:27.715745 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b593b-8977-49bd-9282-02138e371f8a None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:27.716026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763b593b-8977-49bd-9282-02138e371f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:27.734729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-763b593b-8977-49bd-9282-02138e371f8a None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:27.735991 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-763b593b-8977-49bd-9282-02138e371f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:27.817991 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 471/957] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:27 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:27.840384 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3be0a-81c6-42bc-b139-87f2bacea89c None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:27.949074 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3be0a-81c6-42bc-b139-87f2bacea89c None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:27.984661 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bf681-3fa4-4134-8b1a-61eb859a15db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:27.985390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bf681-3fa4-4134-8b1a-61eb859a15db None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:27.985678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bf681-3fa4-4134-8b1a-61eb859a15db None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:27.985956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7bf681-3fa4-4134-8b1a-61eb859a15db None admin] PATH_INFO: `/v3/services/compute` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:27.987196 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7bf681-3fa4-4134-8b1a-61eb859a15db None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:27.988577 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7bf681-3fa4-4134-8b1a-61eb859a15db None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:28.000733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-0b7bf681-3fa4-4134-8b1a-61eb859a15db None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:14:28.000733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:28.000733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:14:28.000733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:14:28.000733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:14:28.000733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:14:28.000733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:14:28.000733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:28.000733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:14:28.000733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:28.000733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:14:28.000733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:28.000733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:28.000733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:28.000733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:28.000733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:28.000733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:28.001851 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:28.001851 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:28.001851 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:28.001851 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:28.001851 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:28.001851 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:28.001851 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:14:28.001851 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:14:28.001851 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:14:28.001851 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:14:28.001851 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:28.001851 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:28.001851 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:28.001851 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:28.001851 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:28.001851 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:28.003403 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:28.003403 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:28.003403 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:28.003403 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:28.003403 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:28.003403 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:28.003403 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:28.003403 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:28.003403 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:28.003403 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:28.003403 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:14:28.003403 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:28.003403 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:14:28.003403 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:28.003403 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 487/958] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:27 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:28.008428 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b593b-8977-49bd-9282-02138e371f8a None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:28.099868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:28.114901 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763b593b-8977-49bd-9282-02138e371f8a None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:28.150917 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a4270-0490-4594-9ee5-1e9ca3d3f0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:28.151603 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a4270-0490-4594-9ee5-1e9ca3d3f0e6 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:28.151950 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a4270-0490-4594-9ee5-1e9ca3d3f0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:28.152190 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a4270-0490-4594-9ee5-1e9ca3d3f0e6 None admin] PATH_INFO: `/v3/services` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:28.152894 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a4270-0490-4594-9ee5-1e9ca3d3f0e6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:28.153202 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a4270-0490-4594-9ee5-1e9ca3d3f0e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:28.154631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a4270-0490-4594-9ee5-1e9ca3d3f0e6 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:28.161615 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 472/959] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 16 00:14:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:28.167184 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bf681-3fa4-4134-8b1a-61eb859a15db None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:28.191357 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:28.273994 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7bf681-3fa4-4134-8b1a-61eb859a15db None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:28.309064 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6828e5e-a690-477d-a521-0077f8e68a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:28.310112 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6828e5e-a690-477d-a521-0077f8e68a0c None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:28.310626 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6828e5e-a690-477d-a521-0077f8e68a0c None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:28.311119 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6828e5e-a690-477d-a521-0077f8e68a0c None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:28.312061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6828e5e-a690-477d-a521-0077f8e68a0c None admin] RBAC: Adding query filter params (type=compute) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:28.312636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6828e5e-a690-477d-a521-0077f8e68a0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:28.314274 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6828e5e-a690-477d-a521-0077f8e68a0c None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:28.319706 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 488/960] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 16 00:14:28 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:28.578961 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4847ce-2f69-4ade-82e4-753bb2f53c57 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:28.579301 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4847ce-2f69-4ade-82e4-753bb2f53c57 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:28.579481 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4847ce-2f69-4ade-82e4-753bb2f53c57 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:28.581191 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 473/961] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:28.586313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1ab8d-3cd0-4eda-8c61-bf878eb2783a None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:28.586755 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1ab8d-3cd0-4eda-8c61-bf878eb2783a None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:28.586853 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae1ab8d-3cd0-4eda-8c61-bf878eb2783a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:28.604417 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-eae1ab8d-3cd0-4eda-8c61-bf878eb2783a None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:28.605923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-eae1ab8d-3cd0-4eda-8c61-bf878eb2783a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:28.673626 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 489/962] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:28.697186 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4847ce-2f69-4ade-82e4-753bb2f53c57 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:28.800728 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4847ce-2f69-4ade-82e4-753bb2f53c57 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:28.840686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e836412-ed0f-45ab-8d7f-8a3ed35515b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:28.841429 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e836412-ed0f-45ab-8d7f-8a3ed35515b7 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:28.841713 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e836412-ed0f-45ab-8d7f-8a3ed35515b7 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:28.842045 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e836412-ed0f-45ab-8d7f-8a3ed35515b7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:28.852777 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e836412-ed0f-45ab-8d7f-8a3ed35515b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:28.861024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-5e836412-ed0f-45ab-8d7f-8a3ed35515b7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:14:28.861024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:28.861024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:28.861024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:28.861024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:28.861024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:28.861024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:28.861024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:28.861024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:28.861024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:28.861024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:28.861024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:28.861024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:28.861024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:28.861024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:28.861024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:28.862516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:28.862516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:28.862516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:28.862516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:28.862516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:28.862516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:28.862516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:28.862516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:28.862516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:28.862516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:28.862516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:28.862516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:28.862516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:28.862516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:28.862516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:28.862516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:28.863390 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:28.863390 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:28.863390 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:28.863390 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:28.863390 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:28.863390 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:28.863390 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:28.863390 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:28.863390 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:28.863390 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:28.863390 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:14:28.863390 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:28.863390 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 474/963] 10.222.0.44 () {56 vars in 1120 bytes} [Thu Jun 16 00:14:28 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:28.868877 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1ab8d-3cd0-4eda-8c61-bf878eb2783a None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:28.892037 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:28.973886 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31018788-17cb-46f1-b937-131e744897bd None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:28.974227 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31018788-17cb-46f1-b937-131e744897bd None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:28.974451 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31018788-17cb-46f1-b937-131e744897bd None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:28.976084 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 475/964] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:28.979786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae1ab8d-3cd0-4eda-8c61-bf878eb2783a None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:28.980880 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb887b43-e39f-4f5d-8cec-bbe632bb6c2a None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:28.981168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb887b43-e39f-4f5d-8cec-bbe632bb6c2a None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:28.981444 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb887b43-e39f-4f5d-8cec-bbe632bb6c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:28.998714 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-cb887b43-e39f-4f5d-8cec-bbe632bb6c2a None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:28.999993 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-cb887b43-e39f-4f5d-8cec-bbe632bb6c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:29.003010 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:29.018454 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fea30-ae6f-4ac2-b60b-d67640048215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:29.019281 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fea30-ae6f-4ac2-b60b-d67640048215 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:29.019696 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fea30-ae6f-4ac2-b60b-d67640048215 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:29.020078 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8fea30-ae6f-4ac2-b60b-d67640048215 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:29.020922 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fea30-ae6f-4ac2-b60b-d67640048215 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:29.021333 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fea30-ae6f-4ac2-b60b-d67640048215 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:29.022799 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8fea30-ae6f-4ac2-b60b-d67640048215 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:29.031887 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 490/965] 10.222.0.44 () {56 vars in 1115 bytes} [Thu Jun 16 00:14:28 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:29.037298 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fea30-ae6f-4ac2-b60b-d67640048215 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:29.087657 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 476/966] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:28 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:14:29.108627 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb887b43-e39f-4f5d-8cec-bbe632bb6c2a None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:29.140282 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:29.171159 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8fea30-ae6f-4ac2-b60b-d67640048215 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:29.216927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434c08d-820e-4d6f-a65a-c486a927a734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:29.218669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434c08d-820e-4d6f-a65a-c486a927a734 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:29.219155 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434c08d-820e-4d6f-a65a-c486a927a734 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:29.219645 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4434c08d-820e-4d6f-a65a-c486a927a734 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:29.234834 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434c08d-820e-4d6f-a65a-c486a927a734 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:29.235844 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb887b43-e39f-4f5d-8cec-bbe632bb6c2a None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:29.236963 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4434c08d-820e-4d6f-a65a-c486a927a734 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:29.260238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-4434c08d-820e-4d6f-a65a-c486a927a734 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:29.260238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:29.260238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:29.260238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:29.260238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:29.260238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:29.260238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:29.260238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:29.260238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:29.260238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:29.260238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:29.260238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:29.260238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:29.260238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:29.260238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:29.261146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:29.261146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:29.261146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:29.261146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:29.261146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:29.261146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:29.261146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:29.261146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:29.261146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:29.261146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:29.261146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:29.261146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:29.261146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:29.261146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:29.261146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:29.261146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:29.261146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:29.262029 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:29.262029 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:29.262029 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:29.262029 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:29.269470 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 491/967] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:29.270199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434c08d-820e-4d6f-a65a-c486a927a734 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:29.282774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cffbad-36eb-4ff1-9e43-699ee3d86ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:29.284043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cffbad-36eb-4ff1-9e43-699ee3d86ccb None admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:29.284749 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cffbad-36eb-4ff1-9e43-699ee3d86ccb None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:29.285038 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cffbad-36eb-4ff1-9e43-699ee3d86ccb None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:29.285748 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cffbad-36eb-4ff1-9e43-699ee3d86ccb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:29.287877 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56cffbad-36eb-4ff1-9e43-699ee3d86ccb None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:29.289201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: WARNING keystone.server.flask.common [None req-56cffbad-36eb-4ff1-9e43-699ee3d86ccb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 16 00:14:29.305176 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.sql.core [None req-56cffbad-36eb-4ff1-9e43-699ee3d86ccb None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 00:14:29.305176 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 00:14:29.305176 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [parameters: {'user_id': 'f88a2ed2a35e49edae12b2d581302b40', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 00:14:29.305176 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=86525) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 16 00:14:29.316066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-56cffbad-36eb-4ff1-9e43-699ee3d86ccb None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 00:14:29.316066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:29.316066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 00:14:29.316066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 00:14:29.316066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 00:14:29.316066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 00:14:29.316066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 00:14:29.316066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 00:14:29.316066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 00:14:29.316066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application conn.query(q) Jun 16 00:14:29.316066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 00:14:29.316066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 00:14:29.316066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 00:14:29.316066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application result.read() Jun 16 00:14:29.316066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 00:14:29.317004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 00:14:29.317004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 00:14:29.317004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 00:14:29.317004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 00:14:29.317004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 00:14:29.317004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 00:14:29.317004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 00:14:29.317004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 00:14:29.317004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:29.317004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 16 00:14:29.317004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:29.317004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:29.317004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 16 00:14:29.317004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 16 00:14:29.317004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 16 00:14:29.317004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 16 00:14:29.317004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 00:14:29.317004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application next(self.gen) Jun 16 00:14:29.317963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 16 00:14:29.317963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application yield resource Jun 16 00:14:29.317963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 16 00:14:29.317963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application next(self.gen) Jun 16 00:14:29.317963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 16 00:14:29.317963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self.session.rollback() Jun 16 00:14:29.317963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 16 00:14:29.317963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self.force_reraise() Jun 16 00:14:29.317963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 16 00:14:29.317963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise self.value Jun 16 00:14:29.317963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 16 00:14:29.317963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 16 00:14:29.317963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 16 00:14:29.317963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application session.commit() Jun 16 00:14:29.317963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 16 00:14:29.317963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 16 00:14:29.317963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 16 00:14:29.318890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._prepare_impl() Jun 16 00:14:29.318890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 16 00:14:29.318890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self.session.flush() Jun 16 00:14:29.318890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 16 00:14:29.318890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._flush(objects) Jun 16 00:14:29.318890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 16 00:14:29.318890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 16 00:14:29.318890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 16 00:14:29.318890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application compat.raise_( Jun 16 00:14:29.318890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 00:14:29.318890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception Jun 16 00:14:29.318890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 16 00:14:29.318890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application flush_context.execute() Jun 16 00:14:29.318890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 16 00:14:29.318890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rec.execute(self) Jun 16 00:14:29.318890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 16 00:14:29.318890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 16 00:14:29.319865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 16 00:14:29.319865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 16 00:14:29.319865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 16 00:14:29.319865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 16 00:14:29.319865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 16 00:14:29.319865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 16 00:14:29.319865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 16 00:14:29.319865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 16 00:14:29.319865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 16 00:14:29.319865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 16 00:14:29.319865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 16 00:14:29.319865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 16 00:14:29.319865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 16 00:14:29.319865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 16 00:14:29.319865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 16 00:14:29.319865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception Jun 16 00:14:29.320914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 16 00:14:29.320914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 16 00:14:29.320914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 16 00:14:29.320914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 16 00:14:29.320914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 16 00:14:29.320914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application result = self._query(query) Jun 16 00:14:29.320914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 16 00:14:29.320914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application conn.query(q) Jun 16 00:14:29.320914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 16 00:14:29.320914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 16 00:14:29.320914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 16 00:14:29.320914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application result.read() Jun 16 00:14:29.320914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 16 00:14:29.320914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 16 00:14:29.320914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 16 00:14:29.320914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 16 00:14:29.321769 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 16 00:14:29.321769 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 16 00:14:29.321769 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 16 00:14:29.321769 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 16 00:14:29.321769 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 16 00:14:29.321769 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 16 00:14:29.321769 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [parameters: {'user_id': 'f88a2ed2a35e49edae12b2d581302b40', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 16 00:14:29.321769 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 16 00:14:29.321769 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:29.321769 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:14:29.321769 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:29.321769 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:29.321769 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:29.321769 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:29.321769 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:29.322586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:29.322586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:29.322586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:29.322586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:29.322586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:29.322586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:29.322586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:29.322586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 16 00:14:29.322586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 16 00:14:29.322586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:29.322586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:29.322586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:14:29.322586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:29.322586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:14:29.322586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:29.322586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 16 00:14:29.322586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 16 00:14:29.323507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 16 00:14:29.323507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 16 00:14:29.323507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 16 00:14:29.323507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 16 00:14:29.323507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 16 00:14:29.323507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:29.323507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 477/968] 10.222.0.44 () {60 vars in 1131 bytes} [Thu Jun 16 00:14:29 2022] POST /identity/v3/users => generated 160 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:29.326929 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cffbad-36eb-4ff1-9e43-699ee3d86ccb None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:29.330204 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:29.394582 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4434c08d-820e-4d6f-a65a-c486a927a734 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:29.423021 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:29.432877 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93cb61-7835-4bce-aeb3-9d2082b34420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:29.433584 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93cb61-7835-4bce-aeb3-9d2082b34420 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:29.433985 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93cb61-7835-4bce-aeb3-9d2082b34420 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:29.434229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93cb61-7835-4bce-aeb3-9d2082b34420 None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:29.435010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93cb61-7835-4bce-aeb3-9d2082b34420 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:29.435320 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93cb61-7835-4bce-aeb3-9d2082b34420 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:29.436829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93cb61-7835-4bce-aeb3-9d2082b34420 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:29.437278 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cffbad-36eb-4ff1-9e43-699ee3d86ccb None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:29.455979 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 492/969] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:29.457764 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93cb61-7835-4bce-aeb3-9d2082b34420 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:29.476725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7f128-fe99-4209-829f-fb44cf0b3d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:29.477903 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7f128-fe99-4209-829f-fb44cf0b3d30 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:29.478393 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7f128-fe99-4209-829f-fb44cf0b3d30 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:29.478890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a7f128-fe99-4209-829f-fb44cf0b3d30 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:29.487332 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7f128-fe99-4209-829f-fb44cf0b3d30 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:29.489327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a7f128-fe99-4209-829f-fb44cf0b3d30 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:29.504804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-80a7f128-fe99-4209-829f-fb44cf0b3d30 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:14:29.504804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:29.504804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:29.504804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:29.504804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:29.504804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:29.504804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:29.504804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:29.504804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:29.504804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:29.504804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:29.504804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:29.504804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:14:29.504804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:14:29.504804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:14:29.504804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:14:29.506060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:29.506060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:29.506060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:14:29.506060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:29.506060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:14:29.506060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:29.506060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:29.506060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:29.506060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:29.506060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:29.506060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:29.506060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:29.506060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:29.506060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:29.506060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:29.506060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:29.506060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:29.506060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:29.507022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:29.507022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:29.507022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:14:29.507022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:14:29.507022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:14:29.507022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:14:29.507022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:14:29.507022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:14:29.507022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 16 00:14:29.507022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:29.509665 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 478/970] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:29 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:29.519717 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7f128-fe99-4209-829f-fb44cf0b3d30 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:29.574997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93cb61-7835-4bce-aeb3-9d2082b34420 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:29.603115 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:29.612802 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f329d94-c927-4f6b-b383-fbe1d5fac053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:29.613711 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f329d94-c927-4f6b-b383-fbe1d5fac053 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:29.614068 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f329d94-c927-4f6b-b383-fbe1d5fac053 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:29.614421 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f329d94-c927-4f6b-b383-fbe1d5fac053 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:29.622311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f329d94-c927-4f6b-b383-fbe1d5fac053 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:29.623904 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f329d94-c927-4f6b-b383-fbe1d5fac053 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:29.639783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-0f329d94-c927-4f6b-b383-fbe1d5fac053 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:14:29.639783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:29.639783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:29.639783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:29.639783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:29.639783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:29.639783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:29.639783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:29.639783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:29.639783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:29.639783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:29.639783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:29.639783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:14:29.639783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:14:29.639783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:14:29.639783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:14:29.640945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:29.640945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:29.640945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:14:29.640945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:29.640945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:14:29.640945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:29.640945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:29.640945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:29.640945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:29.640945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:29.640945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:29.640945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:29.640945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:29.640945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:29.640945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:29.640945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:29.640945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:29.640945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:29.642142 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:29.642142 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:29.642142 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:14:29.642142 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:14:29.642142 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:14:29.642142 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:14:29.642142 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:14:29.642142 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:14:29.642142 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 16 00:14:29.642142 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:29.644791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 493/971] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 16 00:14:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:29.649172 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f329d94-c927-4f6b-b383-fbe1d5fac053 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:29.651662 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a7f128-fe99-4209-829f-fb44cf0b3d30 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:29.693440 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038140e6-bbe5-4da7-994d-8a2fb7f73f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:29.694409 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038140e6-bbe5-4da7-994d-8a2fb7f73f1c None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:29.694939 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038140e6-bbe5-4da7-994d-8a2fb7f73f1c None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:29.695364 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038140e6-bbe5-4da7-994d-8a2fb7f73f1c None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:29.696456 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038140e6-bbe5-4da7-994d-8a2fb7f73f1c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:29.696937 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038140e6-bbe5-4da7-994d-8a2fb7f73f1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:29.698528 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038140e6-bbe5-4da7-994d-8a2fb7f73f1c None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:29.703586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:29.741968 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 479/972] 10.222.0.44 () {56 vars in 1101 bytes} [Thu Jun 16 00:14:29 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:29.758945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f329d94-c927-4f6b-b383-fbe1d5fac053 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:29.806836 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93cbb50-99c5-4cc0-bc9a-990aa4339f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:29.807573 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cbb50-99c5-4cc0-bc9a-990aa4339f6e None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:29.807901 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cbb50-99c5-4cc0-bc9a-990aa4339f6e None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:29.808190 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93cbb50-99c5-4cc0-bc9a-990aa4339f6e None admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:29.809105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93cbb50-99c5-4cc0-bc9a-990aa4339f6e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:29.809426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93cbb50-99c5-4cc0-bc9a-990aa4339f6e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:29.810969 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93cbb50-99c5-4cc0-bc9a-990aa4339f6e None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:29.833635 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 494/973] 10.222.0.44 () {56 vars in 1149 bytes} [Thu Jun 16 00:14:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:29.840796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038140e6-bbe5-4da7-994d-8a2fb7f73f1c None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:29.873017 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806945a-e038-4633-ba96-34a7e7702b45 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:29.873363 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806945a-e038-4633-ba96-34a7e7702b45 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:29.873588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8806945a-e038-4633-ba96-34a7e7702b45 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:29.875158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 495/974] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:29.881343 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351398b7-f543-4dac-9e8f-611e48a0129f None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:29.881685 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351398b7-f543-4dac-9e8f-611e48a0129f None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:29.881976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351398b7-f543-4dac-9e8f-611e48a0129f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:29.904090 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-351398b7-f543-4dac-9e8f-611e48a0129f None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:29.905268 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-351398b7-f543-4dac-9e8f-611e48a0129f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:29.967102 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038140e6-bbe5-4da7-994d-8a2fb7f73f1c None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:29.987697 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 496/975] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:29 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:14:29.988245 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:30.005151 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b67ecd-5920-4687-9662-56aa39283eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:30.006144 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b67ecd-5920-4687-9662-56aa39283eb9 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:30.006494 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b67ecd-5920-4687-9662-56aa39283eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:30.006839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b67ecd-5920-4687-9662-56aa39283eb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:30.011501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351398b7-f543-4dac-9e8f-611e48a0129f None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:30.059597 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:30.089283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b67ecd-5920-4687-9662-56aa39283eb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:30.091682 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b67ecd-5920-4687-9662-56aa39283eb9 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:30.131805 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351398b7-f543-4dac-9e8f-611e48a0129f None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:30.172277 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15737ee-d8ee-4158-8a18-3abfe70b31bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:30.173026 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15737ee-d8ee-4158-8a18-3abfe70b31bd None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:30.173306 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15737ee-d8ee-4158-8a18-3abfe70b31bd None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:30.173578 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15737ee-d8ee-4158-8a18-3abfe70b31bd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:30.174377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15737ee-d8ee-4158-8a18-3abfe70b31bd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:30.175869 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15737ee-d8ee-4158-8a18-3abfe70b31bd None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:30.187786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-e15737ee-d8ee-4158-8a18-3abfe70b31bd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:14:30.187786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:30.187786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:14:30.187786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:14:30.187786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:14:30.187786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:14:30.187786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:14:30.187786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:30.187786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:14:30.187786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:30.187786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:14:30.187786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:30.187786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:30.187786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:30.187786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:30.187786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:30.187786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:30.188882 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:30.188882 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:30.188882 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:30.188882 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:30.188882 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:30.188882 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:30.188882 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:14:30.188882 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:14:30.188882 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:14:30.188882 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:14:30.188882 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:30.188882 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:30.188882 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:30.188882 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:30.188882 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:30.188882 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:30.190270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:30.190270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:30.190270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:30.190270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:30.190270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:30.190270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:30.190270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:30.190270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:30.190270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:30.190270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:30.190270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:14:30.190270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:30.190270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:14:30.190270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:30.194167 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 497/976] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 16 00:14:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:30.195353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15737ee-d8ee-4158-8a18-3abfe70b31bd None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:30.220544 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 480/977] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:29 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:14:30.221641 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b67ecd-5920-4687-9662-56aa39283eb9 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:30.242249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:30.296649 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:30.299740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15737ee-d8ee-4158-8a18-3abfe70b31bd None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:30.326959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b67ecd-5920-4687-9662-56aa39283eb9 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:30.333870 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4108ce1-f9d6-4ec0-a592-2c5a4bcc2664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:30.334541 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4108ce1-f9d6-4ec0-a592-2c5a4bcc2664 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:30.334832 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4108ce1-f9d6-4ec0-a592-2c5a4bcc2664 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:30.335112 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4108ce1-f9d6-4ec0-a592-2c5a4bcc2664 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:30.335854 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4108ce1-f9d6-4ec0-a592-2c5a4bcc2664 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:30.336168 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4108ce1-f9d6-4ec0-a592-2c5a4bcc2664 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:30.337537 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4108ce1-f9d6-4ec0-a592-2c5a4bcc2664 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:30.342370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 498/978] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 16 00:14:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:30.347701 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4108ce1-f9d6-4ec0-a592-2c5a4bcc2664 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:30.363015 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0add43c-2c8a-47f4-a264-42d73300f97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:30.363837 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0add43c-2c8a-47f4-a264-42d73300f97d None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:30.364123 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0add43c-2c8a-47f4-a264-42d73300f97d None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:30.364421 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0add43c-2c8a-47f4-a264-42d73300f97d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:30.374369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0add43c-2c8a-47f4-a264-42d73300f97d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:30.375847 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0add43c-2c8a-47f4-a264-42d73300f97d None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:30.394168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-d0add43c-2c8a-47f4-a264-42d73300f97d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:30.394168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:30.394168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:30.394168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:30.394168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:30.394168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:30.394168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:30.394168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:30.394168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:30.394168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:30.394168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:30.394168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:30.394168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:30.394168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:30.394168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:30.395091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:30.395091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:30.395091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:30.395091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:30.395091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:30.395091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:30.395091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:30.395091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:30.395091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:30.395091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:30.395091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:30.395091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:30.395091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:30.395091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:30.395091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:30.395091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:30.395091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:30.396032 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:30.396032 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:30.396032 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:30.396032 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:30.396032 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 481/979] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:30.400870 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0add43c-2c8a-47f4-a264-42d73300f97d None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:30.452507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4108ce1-f9d6-4ec0-a592-2c5a4bcc2664 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:30.479220 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:30.487863 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadf294-5270-4880-bf25-dc626628d85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:30.488531 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadf294-5270-4880-bf25-dc626628d85b None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:30.488815 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadf294-5270-4880-bf25-dc626628d85b None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:30.489092 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadf294-5270-4880-bf25-dc626628d85b None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:30.489795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aadf294-5270-4880-bf25-dc626628d85b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:30.490104 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aadf294-5270-4880-bf25-dc626628d85b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:30.491461 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aadf294-5270-4880-bf25-dc626628d85b None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:30.496518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 499/980] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 16 00:14:30 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:30.502635 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadf294-5270-4880-bf25-dc626628d85b None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:30.516048 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0add43c-2c8a-47f4-a264-42d73300f97d None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:30.536364 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:30.558075 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f766d1-ab9b-487f-82e3-7861c235447c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:30.558794 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f766d1-ab9b-487f-82e3-7861c235447c None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:30.559081 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f766d1-ab9b-487f-82e3-7861c235447c None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:30.559353 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f766d1-ab9b-487f-82e3-7861c235447c None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:30.560109 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f766d1-ab9b-487f-82e3-7861c235447c None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:30.560415 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f766d1-ab9b-487f-82e3-7861c235447c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:30.561848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f766d1-ab9b-487f-82e3-7861c235447c None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:30.574162 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 482/981] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:30.579507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f766d1-ab9b-487f-82e3-7861c235447c None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:30.614027 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadf294-5270-4880-bf25-dc626628d85b None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:30.646833 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4443001-98ab-4abe-99a4-a26e36ed3c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:30.647483 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4443001-98ab-4abe-99a4-a26e36ed3c39 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:30.647842 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4443001-98ab-4abe-99a4-a26e36ed3c39 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:30.648119 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4443001-98ab-4abe-99a4-a26e36ed3c39 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:30.648909 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4443001-98ab-4abe-99a4-a26e36ed3c39 None admin] RBAC: Adding query filter params (interface=admin, service_id=4b83334bcf22497da829c54fb3fd4c7f, region_id=RegionOne) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:30.649219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4443001-98ab-4abe-99a4-a26e36ed3c39 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:30.650573 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4443001-98ab-4abe-99a4-a26e36ed3c39 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:30.655459 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 500/982] 10.222.0.44 () {56 vars in 1249 bytes} [Thu Jun 16 00:14:30 2022] GET /identity/v3/endpoints?service_id=4b83334bcf22497da829c54fb3fd4c7f&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:30.657980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215de7b-028b-40bf-8461-472ab0e6aba8 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:30.658818 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215de7b-028b-40bf-8461-472ab0e6aba8 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:30.659112 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b215de7b-028b-40bf-8461-472ab0e6aba8 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:30.660728 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 501/983] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:30.661400 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215de7b-028b-40bf-8461-472ab0e6aba8 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:30.681791 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f766d1-ab9b-487f-82e3-7861c235447c None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:30.711006 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:30.716242 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4620d5-ac9c-475c-80c7-55ab325ffc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:30.717032 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4620d5-ac9c-475c-80c7-55ab325ffc3b None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:30.717315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4620d5-ac9c-475c-80c7-55ab325ffc3b None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:30.717584 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4620d5-ac9c-475c-80c7-55ab325ffc3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:30.724722 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4620d5-ac9c-475c-80c7-55ab325ffc3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:30.726158 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4620d5-ac9c-475c-80c7-55ab325ffc3b None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:30.740726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-7e4620d5-ac9c-475c-80c7-55ab325ffc3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:30.740726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:30.740726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:30.740726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:30.740726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:30.740726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:30.740726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:30.740726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:30.740726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:30.740726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:30.740726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:30.740726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:30.740726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:14:30.740726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:14:30.740726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:14:30.741686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:14:30.741686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:30.741686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:30.741686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:30.741686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:30.741686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:30.741686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:30.741686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:30.741686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:30.741686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:30.741686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:30.741686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:30.741686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:30.741686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:30.741686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:30.741686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:30.741686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:30.742590 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:14:30.742590 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:14:30.742590 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:14:30.742590 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:14:30.742590 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:14:30.742590 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:14:30.742590 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:30.742590 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:30.742590 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 483/984] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:30.743438 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa4c1d-0de2-4a59-b3af-5f8570f72854 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:30.743438 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa4c1d-0de2-4a59-b3af-5f8570f72854 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:30.743676 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa4c1d-0de2-4a59-b3af-5f8570f72854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:30.758845 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:30.759796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-0cfa4c1d-0de2-4a59-b3af-5f8570f72854 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:30.761510 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-0cfa4c1d-0de2-4a59-b3af-5f8570f72854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:30.770235 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b215de7b-028b-40bf-8461-472ab0e6aba8 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:30.806526 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7634e21-d50a-4242-9c00-a5a861038b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:30.807193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7634e21-d50a-4242-9c00-a5a861038b5c None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:30.807479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7634e21-d50a-4242-9c00-a5a861038b5c None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:30.807791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7634e21-d50a-4242-9c00-a5a861038b5c None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:30.808480 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7634e21-d50a-4242-9c00-a5a861038b5c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:30.809840 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7634e21-d50a-4242-9c00-a5a861038b5c None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:30.815930 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 502/985] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 16 00:14:30 2022] GET /identity/v3/services => generated 1497 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:14:30.816716 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7634e21-d50a-4242-9c00-a5a861038b5c None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:30.828735 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 484/986] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:30 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:30.851811 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa4c1d-0de2-4a59-b3af-5f8570f72854 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:30.954909 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7634e21-d50a-4242-9c00-a5a861038b5c None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:30.963669 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa4c1d-0de2-4a59-b3af-5f8570f72854 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:30.991462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:30.993743 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2074e-ebd5-4f0c-a077-37022b0728b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:30.994424 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2074e-ebd5-4f0c-a077-37022b0728b1 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:30.994709 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2074e-ebd5-4f0c-a077-37022b0728b1 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:30.995013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc2074e-ebd5-4f0c-a077-37022b0728b1 None admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:30.995821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2074e-ebd5-4f0c-a077-37022b0728b1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:30.996136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2074e-ebd5-4f0c-a077-37022b0728b1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:30.997591 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc2074e-ebd5-4f0c-a077-37022b0728b1 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:31.004808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ca831-153c-452b-89d8-f0afdd04c70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:31.005733 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ca831-153c-452b-89d8-f0afdd04c70a None admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:31.006012 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ca831-153c-452b-89d8-f0afdd04c70a None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:31.006288 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ca831-153c-452b-89d8-f0afdd04c70a None admin] PATH_INFO: `/v3/services` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:31.007009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ca831-153c-452b-89d8-f0afdd04c70a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:31.008444 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ca831-153c-452b-89d8-f0afdd04c70a None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:31.011361 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 503/987] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:14:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:31.017544 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2074e-ebd5-4f0c-a077-37022b0728b1 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:31.027650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 485/988] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 00:14:30 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:14:31.037415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:31.132182 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc2074e-ebd5-4f0c-a077-37022b0728b1 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:31.180808 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d4173-c5b4-4030-b752-431a2ce8a68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:31.181817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d4173-c5b4-4030-b752-431a2ce8a68d None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:31.182317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d4173-c5b4-4030-b752-431a2ce8a68d None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:31.182830 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d4173-c5b4-4030-b752-431a2ce8a68d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:31.183674 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d4173-c5b4-4030-b752-431a2ce8a68d None admin] RBAC: Adding query filter params (role.id=0876003b49cc4c678dc978764ef54594, scope.project.id=320d79ecbc2342af8031103e7308c10d, user.id=39bbc5ff02d24f40b796bd2245a7431a) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:31.183993 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d4173-c5b4-4030-b752-431a2ce8a68d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:31.185443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67d4173-c5b4-4030-b752-431a2ce8a68d None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:31.192898 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 504/989] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:31 2022] GET /identity/v3/role_assignments?user.id=39bbc5ff02d24f40b796bd2245a7431a&scope.project.id=320d79ecbc2342af8031103e7308c10d&role.id=0876003b49cc4c678dc978764ef54594 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:32.955981 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6aff6-ac44-4cab-91ef-90c96d4ba15b None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:32.956490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6aff6-ac44-4cab-91ef-90c96d4ba15b None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:32.956594 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6aff6-ac44-4cab-91ef-90c96d4ba15b None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:32.958068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 486/990] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:32.963064 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3e451-2bdc-45e7-b94e-40ea5f49b7fe None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:32.963439 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3e451-2bdc-45e7-b94e-40ea5f49b7fe None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:32.963662 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b3e451-2bdc-45e7-b94e-40ea5f49b7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:32.981025 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-55b3e451-2bdc-45e7-b94e-40ea5f49b7fe None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:32.982227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-55b3e451-2bdc-45e7-b94e-40ea5f49b7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:33.051722 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 505/991] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:32 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:33.075058 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6aff6-ac44-4cab-91ef-90c96d4ba15b None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:33.133753 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f4b57-9bde-4d47-b6ad-c7df33c233cf None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:33.134582 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f4b57-9bde-4d47-b6ad-c7df33c233cf None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:33.134873 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965f4b57-9bde-4d47-b6ad-c7df33c233cf None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:33.136424 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 506/992] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:33.141421 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82e4ae-8ba4-48b9-a330-e751c5a680d2 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:33.141710 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82e4ae-8ba4-48b9-a330-e751c5a680d2 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:33.141990 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe82e4ae-8ba4-48b9-a330-e751c5a680d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:33.153676 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:33.159960 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-fe82e4ae-8ba4-48b9-a330-e751c5a680d2 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:33.161558 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-fe82e4ae-8ba4-48b9-a330-e751c5a680d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:33.189689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6aff6-ac44-4cab-91ef-90c96d4ba15b None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:33.224940 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4482b-cfe3-427e-be87-e46f5cddbb08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:33.225750 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4482b-cfe3-427e-be87-e46f5cddbb08 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:33.226034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4482b-cfe3-427e-be87-e46f5cddbb08 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:33.226315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b4482b-cfe3-427e-be87-e46f5cddbb08 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:33.227008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4482b-cfe3-427e-be87-e46f5cddbb08 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:33.228417 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b4482b-cfe3-427e-be87-e46f5cddbb08 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:33.235933 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 507/993] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:14:33.240823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-d9b4482b-cfe3-427e-be87-e46f5cddbb08 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:14:33.240823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:33.240823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:14:33.240823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:14:33.240823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:14:33.240823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:14:33.240823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:14:33.240823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:33.240823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:14:33.240823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:33.240823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:14:33.240823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:33.240823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:33.240823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:33.240823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:33.240823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:33.240823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:33.241787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:33.241787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:33.241787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:33.241787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:33.241787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:33.241787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:33.241787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:14:33.241787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:14:33.241787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:14:33.241787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:14:33.241787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:33.241787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:33.241787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:33.241787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:33.241787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:33.241787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:33.242639 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:33.242639 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:33.242639 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:33.242639 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:33.242639 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:33.242639 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:33.242639 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:33.242639 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:33.242639 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:33.242639 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:33.242639 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:14:33.242639 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:33.242639 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 16 00:14:33.242639 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:33.242639 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 487/994] 10.222.0.44 () {56 vars in 1126 bytes} [Thu Jun 16 00:14:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:33.247780 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82e4ae-8ba4-48b9-a330-e751c5a680d2 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:33.259879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4482b-cfe3-427e-be87-e46f5cddbb08 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:33.312947 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:33.357504 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe82e4ae-8ba4-48b9-a330-e751c5a680d2 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:33.371664 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b4482b-cfe3-427e-be87-e46f5cddbb08 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:33.390740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c8f825-e0a7-41fb-ae62-35c7a356550f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:33.391406 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8f825-e0a7-41fb-ae62-35c7a356550f None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:33.391726 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8f825-e0a7-41fb-ae62-35c7a356550f None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:33.392011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c8f825-e0a7-41fb-ae62-35c7a356550f None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:33.393249 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8f825-e0a7-41fb-ae62-35c7a356550f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:33.393564 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8f825-e0a7-41fb-ae62-35c7a356550f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:33.394941 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c8f825-e0a7-41fb-ae62-35c7a356550f None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:33.396679 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:33.400162 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 508/995] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 16 00:14:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:33.401566 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2c110-6167-4d27-9a88-d71bab0d2c1d None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:33.401908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2c110-6167-4d27-9a88-d71bab0d2c1d None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:33.402191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc2c110-6167-4d27-9a88-d71bab0d2c1d None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:33.403426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 509/996] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:33.405535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2c110-6167-4d27-9a88-d71bab0d2c1d None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:33.410597 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc718fda-17c6-4582-a648-06292e3bc51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:33.411394 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc718fda-17c6-4582-a648-06292e3bc51f None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:33.411709 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc718fda-17c6-4582-a648-06292e3bc51f None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:33.411983 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc718fda-17c6-4582-a648-06292e3bc51f None admin] PATH_INFO: `/v3/services/compute` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:33.412729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc718fda-17c6-4582-a648-06292e3bc51f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:33.414089 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc718fda-17c6-4582-a648-06292e3bc51f None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:33.426029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-fc718fda-17c6-4582-a648-06292e3bc51f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:14:33.426029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:33.426029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:14:33.426029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:14:33.426029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:14:33.426029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:14:33.426029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:14:33.426029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:33.426029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:14:33.426029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:33.426029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:14:33.426029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:33.426029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:33.426029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:33.426029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:33.426029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:33.426029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:33.427008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:33.427008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:33.427008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:33.427008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:33.427008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:33.427008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:33.427008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:14:33.427008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:14:33.427008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:14:33.427008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:14:33.427008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:33.427008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:33.427008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:33.427008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:33.427008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:33.427008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:33.427891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:33.427891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:33.427891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:33.427891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:33.427891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:33.427891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:33.427891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:33.427891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:33.427891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:33.427891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:33.427891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:14:33.427891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:33.427891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:14:33.427891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:33.427891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 488/997] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:33 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:33.428758 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a79d4-13fa-4312-a904-f9f4a6018f33 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:33.429116 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a79d4-13fa-4312-a904-f9f4a6018f33 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:33.429222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9a79d4-13fa-4312-a904-f9f4a6018f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:33.444923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-bd9a79d4-13fa-4312-a904-f9f4a6018f33 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:33.446108 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-bd9a79d4-13fa-4312-a904-f9f4a6018f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:33.508669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc2c110-6167-4d27-9a88-d71bab0d2c1d None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:33.511247 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 489/998] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:33 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:33.512100 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a79d4-13fa-4312-a904-f9f4a6018f33 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:33.543644 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09ed4d-d6b9-473e-8f7b-74a608790d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:33.544366 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09ed4d-d6b9-473e-8f7b-74a608790d4c None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:33.544614 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09ed4d-d6b9-473e-8f7b-74a608790d4c None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:33.544912 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea09ed4d-d6b9-473e-8f7b-74a608790d4c None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:33.545569 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09ed4d-d6b9-473e-8f7b-74a608790d4c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:33.545911 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09ed4d-d6b9-473e-8f7b-74a608790d4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:33.547256 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea09ed4d-d6b9-473e-8f7b-74a608790d4c None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:33.552201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 510/999] 10.222.0.44 () {56 vars in 1122 bytes} [Thu Jun 16 00:14:33 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:33.552822 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09ed4d-d6b9-473e-8f7b-74a608790d4c None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:33.557427 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:33.615500 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9a79d4-13fa-4312-a904-f9f4a6018f33 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:33.617943 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:33.650673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5e65e-ee66-486c-9dc5-8e9f8e39f105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:33.651342 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5e65e-ee66-486c-9dc5-8e9f8e39f105 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:33.651649 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5e65e-ee66-486c-9dc5-8e9f8e39f105 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:33.651933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5e65e-ee66-486c-9dc5-8e9f8e39f105 None admin] PATH_INFO: `/v3/services` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:33.652636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5e65e-ee66-486c-9dc5-8e9f8e39f105 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:33.653141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5e65e-ee66-486c-9dc5-8e9f8e39f105 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:33.654329 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5e65e-ee66-486c-9dc5-8e9f8e39f105 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:33.655652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea09ed4d-d6b9-473e-8f7b-74a608790d4c None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:33.659283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 490/1000] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 16 00:14:33 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:33.659987 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5e65e-ee66-486c-9dc5-8e9f8e39f105 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:33.689964 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90262e-12f7-49df-a57b-d8b4248b895f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:33.690753 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90262e-12f7-49df-a57b-d8b4248b895f None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:33.691032 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90262e-12f7-49df-a57b-d8b4248b895f None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:33.691306 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90262e-12f7-49df-a57b-d8b4248b895f None admin] PATH_INFO: `/v3/services/image` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:33.691981 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90262e-12f7-49df-a57b-d8b4248b895f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:33.693339 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d90262e-12f7-49df-a57b-d8b4248b895f None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:33.704507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-7d90262e-12f7-49df-a57b-d8b4248b895f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:14:33.704507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:33.704507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:14:33.704507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:14:33.704507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:14:33.704507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:14:33.704507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:14:33.704507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:33.704507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:14:33.704507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:33.704507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:14:33.704507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:33.704507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:33.704507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:33.704507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:33.704507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:33.704507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:33.710929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:33.710929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:33.710929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:33.710929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:33.710929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:33.710929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:33.710929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:14:33.710929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:14:33.710929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:14:33.710929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:14:33.710929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:33.710929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:33.710929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:33.710929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:33.710929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:33.710929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:33.712051 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:33.712051 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:33.712051 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:33.712051 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:33.712051 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:33.712051 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:33.712051 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:33.712051 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:33.712051 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:33.712051 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:33.712051 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:14:33.712051 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:33.712051 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:14:33.712051 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:33.712051 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 511/1001] 10.222.0.44 () {56 vars in 1105 bytes} [Thu Jun 16 00:14:33 2022] GET /identity/v3/services/image => generated 86 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:33.712878 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90262e-12f7-49df-a57b-d8b4248b895f None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:33.756861 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5e65e-ee66-486c-9dc5-8e9f8e39f105 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:33.759138 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:33.791688 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b431a9a-4d1c-4a41-934b-c8c7e688dfa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:33.792351 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b431a9a-4d1c-4a41-934b-c8c7e688dfa3 None admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:33.792635 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b431a9a-4d1c-4a41-934b-c8c7e688dfa3 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:33.792964 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b431a9a-4d1c-4a41-934b-c8c7e688dfa3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:33.793710 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b431a9a-4d1c-4a41-934b-c8c7e688dfa3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:33.795093 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b431a9a-4d1c-4a41-934b-c8c7e688dfa3 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:33.809988 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 491/1002] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 16 00:14:33 2022] POST /identity/v3/endpoints => generated 325 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:33.810996 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b431a9a-4d1c-4a41-934b-c8c7e688dfa3 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:33.813433 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90262e-12f7-49df-a57b-d8b4248b895f None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:33.845322 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:33.862758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869929f-9cf3-4d67-b9e6-006bde847a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:33.863453 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869929f-9cf3-4d67-b9e6-006bde847a28 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:33.863775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869929f-9cf3-4d67-b9e6-006bde847a28 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:33.864056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b869929f-9cf3-4d67-b9e6-006bde847a28 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:33.864811 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869929f-9cf3-4d67-b9e6-006bde847a28 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:33.865152 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869929f-9cf3-4d67-b9e6-006bde847a28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:33.866639 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b869929f-9cf3-4d67-b9e6-006bde847a28 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:33.872159 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 512/1003] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 16 00:14:33 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:33.878181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869929f-9cf3-4d67-b9e6-006bde847a28 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:33.948839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b431a9a-4d1c-4a41-934b-c8c7e688dfa3 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:33.988391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78cb58-a2d6-4d91-a5b9-8e2095b0b8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:33.989060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78cb58-a2d6-4d91-a5b9-8e2095b0b8af None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:33.989352 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78cb58-a2d6-4d91-a5b9-8e2095b0b8af None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:33.989630 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78cb58-a2d6-4d91-a5b9-8e2095b0b8af None admin] PATH_INFO: `/v3/services` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:33.990338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78cb58-a2d6-4d91-a5b9-8e2095b0b8af None admin] RBAC: Adding query filter params (name=image) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:33.990653 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78cb58-a2d6-4d91-a5b9-8e2095b0b8af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:33.991198 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b869929f-9cf3-4d67-b9e6-006bde847a28 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:33.992078 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78cb58-a2d6-4d91-a5b9-8e2095b0b8af None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:33.997692 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 492/1004] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:33 2022] GET /identity/v3/services?name=image => generated 122 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:34.003775 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78cb58-a2d6-4d91-a5b9-8e2095b0b8af None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:34.028922 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5df57-55a4-49da-97a7-d8c4defecda2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:34.029613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5df57-55a4-49da-97a7-d8c4defecda2 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:34.029903 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5df57-55a4-49da-97a7-d8c4defecda2 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:34.030183 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be5df57-55a4-49da-97a7-d8c4defecda2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:34.030976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5df57-55a4-49da-97a7-d8c4defecda2 None admin] RBAC: Adding query filter params (interface=public, service_id=9e43d5743a0440b1bd4ddc0dfeab0735, region_id=RegionOne) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:34.031292 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5df57-55a4-49da-97a7-d8c4defecda2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:34.032772 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be5df57-55a4-49da-97a7-d8c4defecda2 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:34.038701 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 513/1005] 10.222.0.44 () {56 vars in 1251 bytes} [Thu Jun 16 00:14:33 2022] GET /identity/v3/endpoints?service_id=9e43d5743a0440b1bd4ddc0dfeab0735&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:34.039154 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:34.044494 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5df57-55a4-49da-97a7-d8c4defecda2 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:34.099961 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:34.118690 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78cb58-a2d6-4d91-a5b9-8e2095b0b8af None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:34.150314 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be5df57-55a4-49da-97a7-d8c4defecda2 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:34.156226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5821d5-62a1-4534-a386-50fbb2542dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:34.156904 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5821d5-62a1-4534-a386-50fbb2542dc1 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:34.157191 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5821d5-62a1-4534-a386-50fbb2542dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:34.157713 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5821d5-62a1-4534-a386-50fbb2542dc1 None admin] PATH_INFO: `/v3/services` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:34.158730 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5821d5-62a1-4534-a386-50fbb2542dc1 None admin] RBAC: Adding query filter params (type=image) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:34.159046 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5821d5-62a1-4534-a386-50fbb2542dc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:34.160453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5821d5-62a1-4534-a386-50fbb2542dc1 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:34.166166 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 493/1006] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:34 2022] GET /identity/v3/services?type=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:34.189112 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db6ccc-8452-4915-8047-3338b835a492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:34.189839 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db6ccc-8452-4915-8047-3338b835a492 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:34.190129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db6ccc-8452-4915-8047-3338b835a492 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:34.190410 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db6ccc-8452-4915-8047-3338b835a492 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:34.191119 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db6ccc-8452-4915-8047-3338b835a492 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:34.192590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52db6ccc-8452-4915-8047-3338b835a492 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:34.200224 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 514/1007] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 16 00:14:34 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:14:35.963070 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773666a-e697-4dcf-b445-c382130a02ff None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:35.963572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773666a-e697-4dcf-b445-c382130a02ff None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:35.963696 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773666a-e697-4dcf-b445-c382130a02ff None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:35.965153 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 494/1008] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:35.970063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cac01-9963-4a8a-bf6a-c57a2380a01a None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:35.970998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cac01-9963-4a8a-bf6a-c57a2380a01a None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:35.971139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6cac01-9963-4a8a-bf6a-c57a2380a01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:35.987857 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-4f6cac01-9963-4a8a-bf6a-c57a2380a01a None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:35.989028 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-4f6cac01-9963-4a8a-bf6a-c57a2380a01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:36.054634 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 515/1009] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:35 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:36.078046 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773666a-e697-4dcf-b445-c382130a02ff None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:36.175022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:36.185691 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773666a-e697-4dcf-b445-c382130a02ff None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:36.223097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37036388-6b8a-4967-9862-dda5126703a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:36.224506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37036388-6b8a-4967-9862-dda5126703a5 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:36.224994 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37036388-6b8a-4967-9862-dda5126703a5 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:36.225814 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37036388-6b8a-4967-9862-dda5126703a5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:36.226963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37036388-6b8a-4967-9862-dda5126703a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:36.228502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37036388-6b8a-4967-9862-dda5126703a5 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:36.230430 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 495/1010] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:36.236794 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cac01-9963-4a8a-bf6a-c57a2380a01a None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:36.291854 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:36.306997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e3550-875d-4b82-b200-81546b1df97c None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:36.307238 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e3550-875d-4b82-b200-81546b1df97c None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:36.307719 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e3550-875d-4b82-b200-81546b1df97c None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:36.309243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 496/1011] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:36.314308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f16e1a-c326-42bf-98c3-6ee4c9267675 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:36.314776 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f16e1a-c326-42bf-98c3-6ee4c9267675 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:36.315248 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f16e1a-c326-42bf-98c3-6ee4c9267675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:36.332777 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-c3f16e1a-c326-42bf-98c3-6ee4c9267675 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:36.333973 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-c3f16e1a-c326-42bf-98c3-6ee4c9267675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:36.348588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6cac01-9963-4a8a-bf6a-c57a2380a01a None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:36.391681 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ab650-868d-4241-b352-9aded4b1f45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:36.392380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ab650-868d-4241-b352-9aded4b1f45c None admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:36.392661 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ab650-868d-4241-b352-9aded4b1f45c None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:36.392935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ab650-868d-4241-b352-9aded4b1f45c None admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:36.393652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ab650-868d-4241-b352-9aded4b1f45c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:36.395074 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ab650-868d-4241-b352-9aded4b1f45c None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:36.402325 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 497/1012] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:36 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:14:36.403683 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d54df9-8c20-484b-ae7c-553297fe42ed None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:36.404033 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d54df9-8c20-484b-ae7c-553297fe42ed None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:36.404315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d54df9-8c20-484b-ae7c-553297fe42ed None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:36.405759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 498/1013] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:36.410797 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd5069-1974-4973-ba9e-1e33af17cfe1 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:36.411089 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd5069-1974-4973-ba9e-1e33af17cfe1 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:36.411373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd5069-1974-4973-ba9e-1e33af17cfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:36.433339 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 516/1014] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 00:14:36 2022] POST /identity/v3/projects => generated 311 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:36.433339 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ab650-868d-4241-b352-9aded4b1f45c None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:36.434836 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-2bfd5069-1974-4973-ba9e-1e33af17cfe1 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:36.436400 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-2bfd5069-1974-4973-ba9e-1e33af17cfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:36.539650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 499/1015] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:36 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:14:36.540553 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:36.545448 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ab650-868d-4241-b352-9aded4b1f45c None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:36.558271 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd5069-1974-4973-ba9e-1e33af17cfe1 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:36.581550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:36.589593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762c342-a3c7-4ea3-afa6-25376e70517e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:36.590266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762c342-a3c7-4ea3-afa6-25376e70517e None admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:36.590547 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762c342-a3c7-4ea3-afa6-25376e70517e None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:36.590822 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f762c342-a3c7-4ea3-afa6-25376e70517e None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:36.591551 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762c342-a3c7-4ea3-afa6-25376e70517e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:36.592950 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f762c342-a3c7-4ea3-afa6-25376e70517e None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:36.610212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 517/1016] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 00:14:36 2022] POST /identity/v3/services => generated 242 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:36.680185 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd5069-1974-4973-ba9e-1e33af17cfe1 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:36.724086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61a4b2-d267-4b3a-b641-b066b56330e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:36.724896 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61a4b2-d267-4b3a-b641-b066b56330e7 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:36.725181 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61a4b2-d267-4b3a-b641-b066b56330e7 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:36.725455 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f61a4b2-d267-4b3a-b641-b066b56330e7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:36.726118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f61a4b2-d267-4b3a-b641-b066b56330e7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:36.727512 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f61a4b2-d267-4b3a-b641-b066b56330e7 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:36.740782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-6f61a4b2-d267-4b3a-b641-b066b56330e7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:14:36.740782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:36.740782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:14:36.740782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:14:36.740782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:14:36.740782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:14:36.740782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:14:36.740782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:36.740782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:14:36.740782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:36.740782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:14:36.740782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:36.740782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:36.740782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:36.740782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:36.740782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:36.740782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:36.741868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:36.741868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:36.741868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:36.741868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:36.741868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:36.741868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:36.741868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:14:36.741868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:14:36.741868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:14:36.741868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:14:36.741868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:36.741868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:36.741868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:36.741868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:36.741868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:36.741868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:36.742725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:36.742725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:36.742725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:36.742725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:36.742725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:36.742725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:36.742725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:36.742725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:36.742725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:36.742725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:36.742725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:14:36.742725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:36.742725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 16 00:14:36.742725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:36.742725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 500/1017] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:36 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:36.748116 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762c342-a3c7-4ea3-afa6-25376e70517e None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:36.858538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f762c342-a3c7-4ea3-afa6-25376e70517e None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:36.894201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e8775-efd1-4a9e-a410-3c46b0e38ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:36.894866 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e8775-efd1-4a9e-a410-3c46b0e38ea8 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:36.895150 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e8775-efd1-4a9e-a410-3c46b0e38ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:36.895426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153e8775-efd1-4a9e-a410-3c46b0e38ea8 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:36.896161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e8775-efd1-4a9e-a410-3c46b0e38ea8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:36.896469 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e8775-efd1-4a9e-a410-3c46b0e38ea8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:36.897828 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153e8775-efd1-4a9e-a410-3c46b0e38ea8 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:36.902908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 518/1018] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 16 00:14:36 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:36.909226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61a4b2-d267-4b3a-b641-b066b56330e7 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:36.993446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:37.014726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f61a4b2-d267-4b3a-b641-b066b56330e7 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:37.048272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83520d7d-96aa-45df-9320-4696f094cc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:37.049457 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83520d7d-96aa-45df-9320-4696f094cc33 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:37.049737 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83520d7d-96aa-45df-9320-4696f094cc33 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:37.050007 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83520d7d-96aa-45df-9320-4696f094cc33 None admin] PATH_INFO: `/v3/services` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:37.050715 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83520d7d-96aa-45df-9320-4696f094cc33 None admin] RBAC: Adding query filter params (type=compute) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:37.051022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83520d7d-96aa-45df-9320-4696f094cc33 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:37.052428 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83520d7d-96aa-45df-9320-4696f094cc33 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:37.057555 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 501/1019] 10.222.0.44 () {56 vars in 1112 bytes} [Thu Jun 16 00:14:36 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:37.063057 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e8775-efd1-4a9e-a410-3c46b0e38ea8 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:37.088811 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:37.169452 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153e8775-efd1-4a9e-a410-3c46b0e38ea8 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:37.202058 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5fb3d1-5a10-40cd-b963-bae15ed1c73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:37.202726 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fb3d1-5a10-40cd-b963-bae15ed1c73f None admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:37.203009 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fb3d1-5a10-40cd-b963-bae15ed1c73f None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:37.203286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5fb3d1-5a10-40cd-b963-bae15ed1c73f None admin] PATH_INFO: `/v3/endpoints` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:37.204068 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fb3d1-5a10-40cd-b963-bae15ed1c73f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:37.205971 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5fb3d1-5a10-40cd-b963-bae15ed1c73f None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:37.224694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 519/1020] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 16 00:14:37 2022] POST /identity/v3/endpoints => generated 334 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:14:38.637822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc47f6-c5ea-4f6b-891c-7c3d97fa63a5 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:38.638351 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc47f6-c5ea-4f6b-891c-7c3d97fa63a5 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:38.638351 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cc47f6-c5ea-4f6b-891c-7c3d97fa63a5 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:38.640072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 502/1021] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:38.645748 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323371a3-f0fd-4bd0-ade2-e3266671a6ef None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:38.646163 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323371a3-f0fd-4bd0-ade2-e3266671a6ef None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:38.646363 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323371a3-f0fd-4bd0-ade2-e3266671a6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:38.663517 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-323371a3-f0fd-4bd0-ade2-e3266671a6ef None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:38.664711 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-323371a3-f0fd-4bd0-ade2-e3266671a6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:38.743346 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 520/1022] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:38.761959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad4d51-5abe-4532-8627-cbd10604617e None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:38.762254 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad4d51-5abe-4532-8627-cbd10604617e None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:38.762536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ad4d51-5abe-4532-8627-cbd10604617e None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:38.763960 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 503/1023] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:38.768865 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323371a3-f0fd-4bd0-ade2-e3266671a6ef None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:38.769134 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae43642-97f0-46b1-a169-9e1ea2bb3dcd None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:38.769423 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae43642-97f0-46b1-a169-9e1ea2bb3dcd None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:38.769701 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae43642-97f0-46b1-a169-9e1ea2bb3dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:38.771903 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:38.786984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-bae43642-97f0-46b1-a169-9e1ea2bb3dcd None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:38.788207 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-bae43642-97f0-46b1-a169-9e1ea2bb3dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:38.862021 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 504/1024] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:38 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:38.879478 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323371a3-f0fd-4bd0-ade2-e3266671a6ef None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:38.885373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae43642-97f0-46b1-a169-9e1ea2bb3dcd None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:38.917667 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeef06a-f206-4657-a93a-faae2cadf8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:38.918385 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeef06a-f206-4657-a93a-faae2cadf8dd None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:38.918670 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeef06a-f206-4657-a93a-faae2cadf8dd None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:38.918948 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdeef06a-f206-4657-a93a-faae2cadf8dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:38.920723 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeef06a-f206-4657-a93a-faae2cadf8dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:38.921742 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdeef06a-f206-4657-a93a-faae2cadf8dd None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:38.928411 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 521/1025] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:38.929318 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeef06a-f206-4657-a93a-faae2cadf8dd None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:38.966381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:38.993934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae43642-97f0-46b1-a169-9e1ea2bb3dcd None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:39.003950 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:39.029069 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b94b9-8c43-491b-84b9-60edfc5c470f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:39.029862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b94b9-8c43-491b-84b9-60edfc5c470f None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:39.030145 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b94b9-8c43-491b-84b9-60edfc5c470f None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:39.030420 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762b94b9-8c43-491b-84b9-60edfc5c470f None admin] PATH_INFO: `/v3/services/image` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:39.031070 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b94b9-8c43-491b-84b9-60edfc5c470f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:39.032470 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762b94b9-8c43-491b-84b9-60edfc5c470f None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:39.041538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdeef06a-f206-4657-a93a-faae2cadf8dd None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:39.045848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-762b94b9-8c43-491b-84b9-60edfc5c470f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:14:39.045848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:39.045848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:14:39.045848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:14:39.045848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:14:39.045848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:14:39.045848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:14:39.045848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:39.045848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:14:39.045848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:39.045848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:14:39.045848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:39.045848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:39.045848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:39.045848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:39.045848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:39.045848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:39.046833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:39.046833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:39.046833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:39.046833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:39.046833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:39.046833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:39.046833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:14:39.046833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:14:39.046833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:14:39.046833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:14:39.046833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:39.046833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:39.046833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:39.046833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:39.046833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:39.046833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:39.047728 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:39.047728 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:39.047728 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:39.047728 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:39.047728 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:39.047728 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:39.047728 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:39.047728 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:39.047728 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:39.047728 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:39.047728 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:14:39.047728 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:39.047728 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:14:39.047728 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:39.052578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 505/1026] 10.222.0.44 () {56 vars in 1105 bytes} [Thu Jun 16 00:14:38 2022] GET /identity/v3/services/image => generated 86 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:39.053237 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b94b9-8c43-491b-84b9-60edfc5c470f None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:39.078809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fc523-d9f6-42bb-bbf9-2e76e9b16dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:39.079814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fc523-d9f6-42bb-bbf9-2e76e9b16dd9 None admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:39.080138 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fc523-d9f6-42bb-bbf9-2e76e9b16dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:39.080408 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fc523-d9f6-42bb-bbf9-2e76e9b16dd9 None admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:39.081099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fc523-d9f6-42bb-bbf9-2e76e9b16dd9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:39.082538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fc523-d9f6-42bb-bbf9-2e76e9b16dd9 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:39.104963 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 522/1027] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 00:14:38 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:39.161171 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762b94b9-8c43-491b-84b9-60edfc5c470f None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:39.198138 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23102c00-3921-4458-9af0-9efb54272746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:39.198734 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23102c00-3921-4458-9af0-9efb54272746 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:39.199017 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23102c00-3921-4458-9af0-9efb54272746 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:39.199294 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23102c00-3921-4458-9af0-9efb54272746 None admin] PATH_INFO: `/v3/services` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:39.200046 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23102c00-3921-4458-9af0-9efb54272746 None admin] RBAC: Adding query filter params (name=image) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:39.200360 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23102c00-3921-4458-9af0-9efb54272746 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:39.201758 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23102c00-3921-4458-9af0-9efb54272746 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:39.212093 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 506/1028] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:39.213805 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fc523-d9f6-42bb-bbf9-2e76e9b16dd9 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:39.321922 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fc523-d9f6-42bb-bbf9-2e76e9b16dd9 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:39.348975 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:39.359400 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453388e-a27b-4f28-9165-f4c452dfea27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:39.360108 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453388e-a27b-4f28-9165-f4c452dfea27 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:39.360393 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453388e-a27b-4f28-9165-f4c452dfea27 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:39.360678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453388e-a27b-4f28-9165-f4c452dfea27 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:39.361927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453388e-a27b-4f28-9165-f4c452dfea27 None admin] RBAC: Adding query filter params (type=image) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:39.362237 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453388e-a27b-4f28-9165-f4c452dfea27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:39.363605 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453388e-a27b-4f28-9165-f4c452dfea27 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:39.369173 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 523/1029] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:39.375165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23102c00-3921-4458-9af0-9efb54272746 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:39.379029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:39.447300 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e6a55-b8f0-4c66-b75b-a513b7636029 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:39.448093 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e6a55-b8f0-4c66-b75b-a513b7636029 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:39.448424 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25e6a55-b8f0-4c66-b75b-a513b7636029 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:39.449772 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 524/1030] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:39.454998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1a0fd-4cda-4032-99d5-a4312f023025 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:39.455287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1a0fd-4cda-4032-99d5-a4312f023025 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:39.455567 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb1a0fd-4cda-4032-99d5-a4312f023025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:39.472167 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-3fb1a0fd-4cda-4032-99d5-a4312f023025 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:39.473353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-3fb1a0fd-4cda-4032-99d5-a4312f023025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:39.489148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23102c00-3921-4458-9af0-9efb54272746 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:39.524170 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db596cf5-ade7-4de8-b5be-2df8b644db22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:39.524821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db596cf5-ade7-4de8-b5be-2df8b644db22 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:39.525115 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db596cf5-ade7-4de8-b5be-2df8b644db22 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:39.525392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db596cf5-ade7-4de8-b5be-2df8b644db22 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:39.526178 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db596cf5-ade7-4de8-b5be-2df8b644db22 None admin] RBAC: Adding query filter params (interface=public, service_id=f137a4ec78e246bd96e252e37dbc886b, region_id=RegionOne) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:39.526494 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db596cf5-ade7-4de8-b5be-2df8b644db22 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:39.527903 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db596cf5-ade7-4de8-b5be-2df8b644db22 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:39.537776 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 507/1031] 10.222.0.44 () {56 vars in 1251 bytes} [Thu Jun 16 00:14:39 2022] GET /identity/v3/endpoints?service_id=f137a4ec78e246bd96e252e37dbc886b&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:39.538745 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db596cf5-ade7-4de8-b5be-2df8b644db22 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:39.551654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 525/1032] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:39 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:39.572368 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1a0fd-4cda-4032-99d5-a4312f023025 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:39.613877 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:39.651756 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db596cf5-ade7-4de8-b5be-2df8b644db22 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:39.677146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb1a0fd-4cda-4032-99d5-a4312f023025 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:39.687867 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ce35d-c4ea-444b-be4d-37ea446eb4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:39.688851 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ce35d-c4ea-444b-be4d-37ea446eb4fd None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:39.689682 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ce35d-c4ea-444b-be4d-37ea446eb4fd None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:39.689960 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5ce35d-c4ea-444b-be4d-37ea446eb4fd None admin] PATH_INFO: `/v3/services` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:39.690640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ce35d-c4ea-444b-be4d-37ea446eb4fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:39.692025 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5ce35d-c4ea-444b-be4d-37ea446eb4fd None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:39.707751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 508/1033] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 16 00:14:39 2022] GET /identity/v3/services => generated 1957 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:14:39.710499 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:39.725233 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfe239-f3f4-4130-af42-21aa155f4159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:39.726082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfe239-f3f4-4130-af42-21aa155f4159 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:39.726370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfe239-f3f4-4130-af42-21aa155f4159 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:39.726652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bfe239-f3f4-4130-af42-21aa155f4159 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:39.739242 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bfe239-f3f4-4130-af42-21aa155f4159 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:39.747660 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-61bfe239-f3f4-4130-af42-21aa155f4159 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:14:39.747660 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:39.747660 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:39.747660 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:39.747660 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:39.747660 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:39.747660 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:39.747660 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:39.747660 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:39.747660 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:39.747660 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:39.747660 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:39.747660 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:39.747660 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:39.747660 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:39.747660 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:39.748849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:39.748849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:39.748849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:39.748849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:39.748849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:39.748849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:39.748849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:39.748849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:39.748849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:39.748849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:39.748849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:39.748849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:39.748849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:39.748849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:39.748849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:39.748849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:39.749719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:39.749719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:39.749719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:39.749719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:39.749719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:39.749719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:39.749719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:39.749719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:39.749719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:39.749719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:39.749719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:14:39.749719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:39.749719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 526/1034] 10.222.0.44 () {56 vars in 1120 bytes} [Thu Jun 16 00:14:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:39.756336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ce35d-c4ea-444b-be4d-37ea446eb4fd None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:39.874661 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5ce35d-c4ea-444b-be4d-37ea446eb4fd None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:39.904304 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:39.912705 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c5098-8d40-492e-b495-6b8032ac60f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:39.913378 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c5098-8d40-492e-b495-6b8032ac60f5 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:39.913656 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c5098-8d40-492e-b495-6b8032ac60f5 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:39.913925 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542c5098-8d40-492e-b495-6b8032ac60f5 None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:39.914721 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c5098-8d40-492e-b495-6b8032ac60f5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:39.915035 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c5098-8d40-492e-b495-6b8032ac60f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:39.916434 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542c5098-8d40-492e-b495-6b8032ac60f5 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:39.925052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 509/1035] 10.222.0.44 () {56 vars in 1115 bytes} [Thu Jun 16 00:14:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:39.931755 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfe239-f3f4-4130-af42-21aa155f4159 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:40.034377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bfe239-f3f4-4130-af42-21aa155f4159 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:40.068070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbf46c-a173-4b5b-b902-0fd816c3a0fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:40.068887 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbf46c-a173-4b5b-b902-0fd816c3a0fc None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:40.069179 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbf46c-a173-4b5b-b902-0fd816c3a0fc None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:40.069468 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dbf46c-a173-4b5b-b902-0fd816c3a0fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:40.080574 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbf46c-a173-4b5b-b902-0fd816c3a0fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:40.082041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dbf46c-a173-4b5b-b902-0fd816c3a0fc None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:40.099460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-a7dbf46c-a173-4b5b-b902-0fd816c3a0fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:40.099460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:40.099460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:40.099460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:40.099460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:40.099460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:40.099460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:40.099460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:40.099460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:40.099460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:40.099460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:40.099460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:40.099460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:40.099460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:40.099460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:40.100489 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:40.100489 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:40.100489 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:40.100489 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:40.100489 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:40.100489 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:40.100489 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:40.100489 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:40.100489 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:40.100489 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:40.100489 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:40.100489 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:40.100489 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:40.100489 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:40.100489 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:40.100489 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:40.100489 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:40.101421 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:40.101421 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:40.101421 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:40.101421 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:40.103698 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 527/1036] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:40.106719 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c5098-8d40-492e-b495-6b8032ac60f5 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:40.208590 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542c5098-8d40-492e-b495-6b8032ac60f5 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:40.242303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccaff8-755f-4673-8ad1-98cf094e4ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:40.242968 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccaff8-755f-4673-8ad1-98cf094e4ba5 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:40.243247 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccaff8-755f-4673-8ad1-98cf094e4ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:40.243517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ccaff8-755f-4673-8ad1-98cf094e4ba5 None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:40.244261 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ccaff8-755f-4673-8ad1-98cf094e4ba5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:40.244566 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ccaff8-755f-4673-8ad1-98cf094e4ba5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:40.245933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ccaff8-755f-4673-8ad1-98cf094e4ba5 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:40.262927 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 510/1037] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:40.264572 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbf46c-a173-4b5b-b902-0fd816c3a0fc None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:40.302776 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:40.371381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dbf46c-a173-4b5b-b902-0fd816c3a0fc None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:40.406884 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d9ca2-9b42-44ab-a593-11ab09e338d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:40.408237 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d9ca2-9b42-44ab-a593-11ab09e338d8 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:40.408531 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d9ca2-9b42-44ab-a593-11ab09e338d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:40.408803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40d9ca2-9b42-44ab-a593-11ab09e338d8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:40.416245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d9ca2-9b42-44ab-a593-11ab09e338d8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:40.417792 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40d9ca2-9b42-44ab-a593-11ab09e338d8 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:40.432263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-c40d9ca2-9b42-44ab-a593-11ab09e338d8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:14:40.432263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:40.432263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:40.432263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:40.432263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:40.432263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:40.432263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:40.432263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:40.432263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:40.432263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:40.432263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:40.432263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:40.432263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:14:40.432263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:14:40.432263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:14:40.432263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:14:40.433230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:40.433230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:40.433230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:14:40.433230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:40.433230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:14:40.433230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:40.433230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:40.433230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:40.433230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:40.433230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:40.433230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:40.433230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:40.433230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:40.433230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:40.433230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:40.433230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:40.433230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:40.433230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:40.434250 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:40.434250 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:40.434250 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:14:40.434250 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:14:40.434250 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:14:40.434250 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:14:40.434250 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:14:40.434250 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:14:40.434250 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:14:40.434250 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:40.434250 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 528/1038] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 16 00:14:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:40.439688 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccaff8-755f-4673-8ad1-98cf094e4ba5 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:40.494556 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:40.544209 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ccaff8-755f-4673-8ad1-98cf094e4ba5 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:40.577814 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086de18-d0ca-41b7-bdcd-e9b963c8218c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:40.578411 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086de18-d0ca-41b7-bdcd-e9b963c8218c None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:40.578690 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086de18-d0ca-41b7-bdcd-e9b963c8218c None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:40.578958 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3086de18-d0ca-41b7-bdcd-e9b963c8218c None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:40.579911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086de18-d0ca-41b7-bdcd-e9b963c8218c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:40.580220 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086de18-d0ca-41b7-bdcd-e9b963c8218c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:40.581645 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3086de18-d0ca-41b7-bdcd-e9b963c8218c None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:40.603229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 511/1039] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 16 00:14:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:40.604945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d9ca2-9b42-44ab-a593-11ab09e338d8 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:40.698692 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:40.706826 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40d9ca2-9b42-44ab-a593-11ab09e338d8 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:40.741458 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c9f79-3fed-4f46-906e-695038e3e1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:40.742111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c9f79-3fed-4f46-906e-695038e3e1b3 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:40.742399 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c9f79-3fed-4f46-906e-695038e3e1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:40.742682 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266c9f79-3fed-4f46-906e-695038e3e1b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:40.820225 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c9f79-3fed-4f46-906e-695038e3e1b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:40.821691 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266c9f79-3fed-4f46-906e-695038e3e1b3 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:40.916014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:40.929579 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 529/1040] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:40 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:14:40.931074 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086de18-d0ca-41b7-bdcd-e9b963c8218c None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:41.031507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3086de18-d0ca-41b7-bdcd-e9b963c8218c None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:41.042325 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:41.067314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb30b2-93a4-4058-a756-1d5113b327a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:41.068142 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb30b2-93a4-4058-a756-1d5113b327a8 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:41.068432 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb30b2-93a4-4058-a756-1d5113b327a8 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:41.068711 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb30b2-93a4-4058-a756-1d5113b327a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:41.078570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb30b2-93a4-4058-a756-1d5113b327a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:41.080077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb30b2-93a4-4058-a756-1d5113b327a8 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:41.097199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-30fb30b2-93a4-4058-a756-1d5113b327a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:41.097199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:41.097199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:41.097199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:41.097199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:41.097199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:41.097199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:41.097199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:41.097199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:41.097199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:41.097199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:41.097199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:41.097199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:41.097199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:41.097199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:41.098071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:41.098071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:41.098071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:41.098071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:41.098071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:41.098071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:41.098071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:41.098071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:41.098071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:41.098071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:41.098071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:41.098071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:41.098071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:41.098071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:41.098071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:41.098071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:41.098071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:41.104071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:41.104071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:41.104071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:41.104071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:41.104071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 512/1041] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:41.104360 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c9f79-3fed-4f46-906e-695038e3e1b3 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:41.206961 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266c9f79-3fed-4f46-906e-695038e3e1b3 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:41.241155 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1addb405-3075-4a70-abdb-3e6f54c99882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:41.241830 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addb405-3075-4a70-abdb-3e6f54c99882 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:41.242118 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addb405-3075-4a70-abdb-3e6f54c99882 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:41.242396 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1addb405-3075-4a70-abdb-3e6f54c99882 None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:41.243115 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1addb405-3075-4a70-abdb-3e6f54c99882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:41.243428 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1addb405-3075-4a70-abdb-3e6f54c99882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:41.244833 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1addb405-3075-4a70-abdb-3e6f54c99882 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:41.262452 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 530/1042] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:41.264119 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb30b2-93a4-4058-a756-1d5113b327a8 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:41.328351 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1b7cc-a785-4097-b2fc-e80ff4ca6fe0 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:41.328647 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1b7cc-a785-4097-b2fc-e80ff4ca6fe0 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:41.328929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a1b7cc-a785-4097-b2fc-e80ff4ca6fe0 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:41.330865 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 531/1043] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:41.335565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d1563-eeaf-4a51-850c-77f218ea961f None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:41.335879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d1563-eeaf-4a51-850c-77f218ea961f None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:41.336168 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d1563-eeaf-4a51-850c-77f218ea961f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:41.352524 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-7b0d1563-eeaf-4a51-850c-77f218ea961f None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:41.353718 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-7b0d1563-eeaf-4a51-850c-77f218ea961f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:41.369416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb30b2-93a4-4058-a756-1d5113b327a8 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:41.405267 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:41.405790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3c300-492c-4ea4-aa1e-198b04045add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:41.406595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3c300-492c-4ea4-aa1e-198b04045add None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:41.406881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3c300-492c-4ea4-aa1e-198b04045add None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:41.407156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f3c300-492c-4ea4-aa1e-198b04045add None admin] PATH_INFO: `/v3/projects/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:41.414160 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f3c300-492c-4ea4-aa1e-198b04045add None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:41.415638 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f3c300-492c-4ea4-aa1e-198b04045add None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:41.425555 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 532/1044] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:14:41.430121 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-17f3c300-492c-4ea4-aa1e-198b04045add None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:41.430121 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:41.430121 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:41.430121 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:41.430121 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:41.430121 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:41.430121 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:41.430121 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:41.430121 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:41.430121 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:41.430121 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:41.430121 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:41.430121 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:14:41.430121 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:14:41.430121 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:14:41.431005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:14:41.431005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:41.431005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:41.431005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:41.431005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:41.431005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:41.431005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:41.431005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:41.431005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:41.431005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:41.431005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:41.431005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:41.431005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:41.431005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:41.431005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:41.431005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:41.431005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:41.436516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:14:41.436516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:14:41.436516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:14:41.436516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:14:41.436516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:14:41.436516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:14:41.436516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:41.436516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:41.436516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 513/1045] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:41.438287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d1563-eeaf-4a51-850c-77f218ea961f None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:41.450142 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3c300-492c-4ea4-aa1e-198b04045add None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:41.476706 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:41.549140 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d1563-eeaf-4a51-850c-77f218ea961f None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:41.556993 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f3c300-492c-4ea4-aa1e-198b04045add None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:41.584898 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6fff0-58bf-4f55-89dd-896d9d2f85c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:41.585562 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6fff0-58bf-4f55-89dd-896d9d2f85c9 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:41.585849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6fff0-58bf-4f55-89dd-896d9d2f85c9 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:41.586128 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de6fff0-58bf-4f55-89dd-896d9d2f85c9 None admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:41.586926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6fff0-58bf-4f55-89dd-896d9d2f85c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:41.587238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6fff0-58bf-4f55-89dd-896d9d2f85c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:41.588728 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de6fff0-58bf-4f55-89dd-896d9d2f85c9 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:41.592766 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94cb5d-1a5c-4493-afdd-0cff9eb5fd32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:41.593551 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94cb5d-1a5c-4493-afdd-0cff9eb5fd32 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:41.593829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94cb5d-1a5c-4493-afdd-0cff9eb5fd32 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:41.594096 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94cb5d-1a5c-4493-afdd-0cff9eb5fd32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:41.601262 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 533/1046] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:14:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:41.606690 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6fff0-58bf-4f55-89dd-896d9d2f85c9 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:41.607670 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94cb5d-1a5c-4493-afdd-0cff9eb5fd32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:41.616157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-ae94cb5d-1a5c-4493-afdd-0cff9eb5fd32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:41.616157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:41.616157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:41.616157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:41.616157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:41.616157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:41.616157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:41.616157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:41.616157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:41.616157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:41.616157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:41.616157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:41.616157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:41.616157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:41.616157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:41.616157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:41.617140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:41.617140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:41.617140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:41.617140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:41.617140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:41.617140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:41.617140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:41.617140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:41.617140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:41.617140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:41.617140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:41.617140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:41.617140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:41.617140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:41.617140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:41.617140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:41.618013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:41.618013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:41.618013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:41.618013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:41.618013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:41.618013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:41.618013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:41.618013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:41.618013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:41.618013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:41.618013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:41.618013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:41.619770 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 514/1047] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:14:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:41.624414 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94cb5d-1a5c-4493-afdd-0cff9eb5fd32 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:41.658909 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:41.714688 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:41.727570 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de6fff0-58bf-4f55-89dd-896d9d2f85c9 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:41.733697 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94cb5d-1a5c-4493-afdd-0cff9eb5fd32 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:41.765159 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85610ee9-efc2-4296-8b27-89d0fb62f567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:41.765820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85610ee9-efc2-4296-8b27-89d0fb62f567 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:41.766102 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85610ee9-efc2-4296-8b27-89d0fb62f567 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:41.766379 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85610ee9-efc2-4296-8b27-89d0fb62f567 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:41.767248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85610ee9-efc2-4296-8b27-89d0fb62f567 None admin] RBAC: Adding query filter params (role.id=0876003b49cc4c678dc978764ef54594, scope.project.id=320d79ecbc2342af8031103e7308c10d, user.id=40432493f16b4df681daf5a1af87832a) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:41.767580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85610ee9-efc2-4296-8b27-89d0fb62f567 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:41.768244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef18fdc-a11a-444b-8efe-892efb1ef2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:41.768925 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef18fdc-a11a-444b-8efe-892efb1ef2fa None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:41.769135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85610ee9-efc2-4296-8b27-89d0fb62f567 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:41.769256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef18fdc-a11a-444b-8efe-892efb1ef2fa None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:41.769471 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef18fdc-a11a-444b-8efe-892efb1ef2fa None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:41.770231 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef18fdc-a11a-444b-8efe-892efb1ef2fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:41.770540 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef18fdc-a11a-444b-8efe-892efb1ef2fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:41.771981 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef18fdc-a11a-444b-8efe-892efb1ef2fa None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:41.780057 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 534/1048] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:41 2022] GET /identity/v3/role_assignments?user.id=40432493f16b4df681daf5a1af87832a&scope.project.id=320d79ecbc2342af8031103e7308c10d&role.id=0876003b49cc4c678dc978764ef54594 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:41.781588 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 515/1049] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:41.788181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85610ee9-efc2-4296-8b27-89d0fb62f567 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:41.849177 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea14d6-313a-4f23-b133-c64a23f99203 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:41.849517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea14d6-313a-4f23-b133-c64a23f99203 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:41.849753 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cea14d6-313a-4f23-b133-c64a23f99203 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:41.851334 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 516/1050] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:41.856846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f07031-6fe4-4c03-b907-f6c682674045 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:41.857130 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f07031-6fe4-4c03-b907-f6c682674045 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:41.857409 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f07031-6fe4-4c03-b907-f6c682674045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:41.875541 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-12f07031-6fe4-4c03-b907-f6c682674045 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:41.876870 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-12f07031-6fe4-4c03-b907-f6c682674045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:41.912410 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85610ee9-efc2-4296-8b27-89d0fb62f567 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:41.925360 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:41.952860 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 517/1051] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:41 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:14:41.965613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9165abc-eae8-4f63-a2d6-84fdc4c158d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:41.966593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9165abc-eae8-4f63-a2d6-84fdc4c158d8 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:41.966950 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9165abc-eae8-4f63-a2d6-84fdc4c158d8 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:41.967300 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9165abc-eae8-4f63-a2d6-84fdc4c158d8 None admin] PATH_INFO: `/v3/users/f07e70d0a2924c88bacff95924627eba` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:41.976196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f07031-6fe4-4c03-b907-f6c682674045 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:41.982891 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9165abc-eae8-4f63-a2d6-84fdc4c158d8 None admin] RBAC: Authorizing `identity:get_user(user_id=f07e70d0a2924c88bacff95924627eba)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:41.984332 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9165abc-eae8-4f63-a2d6-84fdc4c158d8 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:41.986089 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 535/1052] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:41 2022] GET /identity/v3/users/f07e70d0a2924c88bacff95924627eba => generated 285 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:41.991893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9165abc-eae8-4f63-a2d6-84fdc4c158d8 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:42.054557 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:42.081425 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f07031-6fe4-4c03-b907-f6c682674045 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:42.103766 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9165abc-eae8-4f63-a2d6-84fdc4c158d8 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:42.118810 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106c280-74f1-4f3c-962c-bbd099f90bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:42.119605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106c280-74f1-4f3c-962c-bbd099f90bc6 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:42.119912 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106c280-74f1-4f3c-962c-bbd099f90bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:42.120183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106c280-74f1-4f3c-962c-bbd099f90bc6 None admin] PATH_INFO: `/v3/services/image` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:42.120832 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106c280-74f1-4f3c-962c-bbd099f90bc6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:42.122206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c106c280-74f1-4f3c-962c-bbd099f90bc6 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:42.134052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-c106c280-74f1-4f3c-962c-bbd099f90bc6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:14:42.134052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:42.134052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:14:42.134052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:14:42.134052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:14:42.134052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:14:42.134052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:14:42.134052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:42.134052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:14:42.134052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:42.134052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:14:42.134052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:42.134052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:42.134052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:42.134052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:42.134052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:42.134052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:42.135063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:42.135063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:42.135063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:42.135063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:42.135063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:42.135063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:42.135063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:14:42.135063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:14:42.135063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:14:42.135063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:14:42.135063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:42.135063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:42.135063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:42.135063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:42.135063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:42.135063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:42.135938 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:42.135938 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:42.135938 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:42.135938 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:42.135938 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:42.135938 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:42.135938 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:42.135938 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:42.135938 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:42.135938 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:42.135938 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:14:42.135938 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:14:42.135938 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 16 00:14:42.135938 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:42.135938 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 518/1053] 10.222.0.44 () {56 vars in 1105 bytes} [Thu Jun 16 00:14:41 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:42.140989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106c280-74f1-4f3c-962c-bbd099f90bc6 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:42.143235 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100569a-91ee-41bc-a416-2cbeaf36207e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:42.144038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100569a-91ee-41bc-a416-2cbeaf36207e None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:42.145116 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100569a-91ee-41bc-a416-2cbeaf36207e None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:42.145116 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100569a-91ee-41bc-a416-2cbeaf36207e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:42.178379 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:42.215347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100569a-91ee-41bc-a416-2cbeaf36207e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:42.216872 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100569a-91ee-41bc-a416-2cbeaf36207e None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:42.251817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106c280-74f1-4f3c-962c-bbd099f90bc6 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:42.283891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084e6ad-09d9-4cf6-8198-97e29ed7569b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:42.284564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084e6ad-09d9-4cf6-8198-97e29ed7569b None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:42.284849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084e6ad-09d9-4cf6-8198-97e29ed7569b None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:42.285125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c084e6ad-09d9-4cf6-8198-97e29ed7569b None admin] PATH_INFO: `/v3/services` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:42.285850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084e6ad-09d9-4cf6-8198-97e29ed7569b None admin] RBAC: Adding query filter params (name=image) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:42.286139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084e6ad-09d9-4cf6-8198-97e29ed7569b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:42.287524 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c084e6ad-09d9-4cf6-8198-97e29ed7569b None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:42.292816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 519/1054] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:42 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:42.299541 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084e6ad-09d9-4cf6-8198-97e29ed7569b None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:42.302997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:42.330971 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 536/1055] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:41 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 00:14:42.336348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100569a-91ee-41bc-a416-2cbeaf36207e None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:42.403125 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:42.411651 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c084e6ad-09d9-4cf6-8198-97e29ed7569b None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:42.439970 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100569a-91ee-41bc-a416-2cbeaf36207e None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:42.448863 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7981b-dc1d-4f74-8c2e-5e436d5b8b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:42.449529 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7981b-dc1d-4f74-8c2e-5e436d5b8b6a None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:42.449817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7981b-dc1d-4f74-8c2e-5e436d5b8b6a None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:42.450212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7981b-dc1d-4f74-8c2e-5e436d5b8b6a None admin] PATH_INFO: `/v3/services` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:42.450930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7981b-dc1d-4f74-8c2e-5e436d5b8b6a None admin] RBAC: Adding query filter params (type=image) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:42.451243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7981b-dc1d-4f74-8c2e-5e436d5b8b6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:42.452775 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7981b-dc1d-4f74-8c2e-5e436d5b8b6a None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:42.463959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 520/1056] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:42 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:42.465575 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7981b-dc1d-4f74-8c2e-5e436d5b8b6a None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:42.475954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebe3a7-5055-4103-8cdb-3e3d8372d063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:42.476819 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebe3a7-5055-4103-8cdb-3e3d8372d063 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:42.477327 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebe3a7-5055-4103-8cdb-3e3d8372d063 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:42.477448 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ebe3a7-5055-4103-8cdb-3e3d8372d063 None admin] PATH_INFO: `/v3/projects/d1d05dc43f2e490e8365d1a69ae9c1bb` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:42.478523 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebe3a7-5055-4103-8cdb-3e3d8372d063 None admin] RBAC: Authorizing `identity:get_project(project_id=d1d05dc43f2e490e8365d1a69ae9c1bb)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:42.479977 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ebe3a7-5055-4103-8cdb-3e3d8372d063 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:42.481646 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 537/1057] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:42 2022] GET /identity/v3/projects/d1d05dc43f2e490e8365d1a69ae9c1bb => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:42.488006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebe3a7-5055-4103-8cdb-3e3d8372d063 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:42.535465 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:42.575238 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7981b-dc1d-4f74-8c2e-5e436d5b8b6a None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:42.594196 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ebe3a7-5055-4103-8cdb-3e3d8372d063 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:42.608376 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6b222-ebce-4175-a65a-43d2b4f7eb53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:42.609143 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6b222-ebce-4175-a65a-43d2b4f7eb53 None admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:42.609424 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6b222-ebce-4175-a65a-43d2b4f7eb53 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:42.609715 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6b222-ebce-4175-a65a-43d2b4f7eb53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:42.610422 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea6b222-ebce-4175-a65a-43d2b4f7eb53 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:42.612553 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea6b222-ebce-4175-a65a-43d2b4f7eb53 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:42.631821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654bc23d-8ec9-41ba-83a4-94e172ce74ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:42.632484 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bc23d-8ec9-41ba-83a4-94e172ce74ec None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:42.632771 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bc23d-8ec9-41ba-83a4-94e172ce74ec None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:42.633050 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654bc23d-8ec9-41ba-83a4-94e172ce74ec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:42.633879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bc23d-8ec9-41ba-83a4-94e172ce74ec None admin] RBAC: Adding query filter params (role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab, scope.project.id=d1d05dc43f2e490e8365d1a69ae9c1bb, user.id=f07e70d0a2924c88bacff95924627eba) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:42.639892 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bc23d-8ec9-41ba-83a4-94e172ce74ec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:42.640067 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 521/1058] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 16 00:14:42 2022] POST /identity/v3/endpoints => generated 327 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:42.640169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654bc23d-8ec9-41ba-83a4-94e172ce74ec None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:42.640169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:42.651323 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 538/1059] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:42 2022] GET /identity/v3/role_assignments?user.id=f07e70d0a2924c88bacff95924627eba&scope.project.id=d1d05dc43f2e490e8365d1a69ae9c1bb&role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:43.895663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0337650-eab6-4b56-985d-14bde01e3d45 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:43.895663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0337650-eab6-4b56-985d-14bde01e3d45 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:43.895663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0337650-eab6-4b56-985d-14bde01e3d45 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:43.896367 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 522/1060] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:43.901542 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b512f-f058-4d0a-9acc-2202ed1c228c None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:43.902367 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b512f-f058-4d0a-9acc-2202ed1c228c None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:43.902844 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7b512f-f058-4d0a-9acc-2202ed1c228c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:43.920080 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-5f7b512f-f058-4d0a-9acc-2202ed1c228c None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:43.921600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-5f7b512f-f058-4d0a-9acc-2202ed1c228c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:43.999862 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 539/1061] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:44.017937 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0337650-eab6-4b56-985d-14bde01e3d45 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:44.131738 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0337650-eab6-4b56-985d-14bde01e3d45 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:44.154144 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:44.168694 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a038a-f502-49ff-8e7b-7faddb86837d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:44.169508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a038a-f502-49ff-8e7b-7faddb86837d None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:44.169788 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a038a-f502-49ff-8e7b-7faddb86837d None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:44.170172 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a038a-f502-49ff-8e7b-7faddb86837d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:44.180850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a038a-f502-49ff-8e7b-7faddb86837d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:44.188977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-1f1a038a-f502-49ff-8e7b-7faddb86837d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:14:44.188977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:44.188977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:44.188977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:44.188977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:44.188977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:44.188977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:44.188977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:44.188977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:44.188977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:44.188977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:44.188977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:44.188977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:44.188977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:44.188977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:44.188977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:44.189900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:44.189900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:44.189900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:44.189900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:44.189900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:44.189900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:44.189900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:44.189900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:44.189900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:44.189900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:44.189900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:44.189900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:44.189900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:44.189900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:44.189900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:44.189900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:44.190746 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:44.190746 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:44.190746 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:44.190746 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:44.190746 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:44.190746 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:44.190746 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:44.190746 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:44.190746 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:44.190746 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:44.190746 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:14:44.190746 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:44.195293 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 523/1062] 10.222.0.44 () {56 vars in 1120 bytes} [Thu Jun 16 00:14:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:44.196321 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b512f-f058-4d0a-9acc-2202ed1c228c None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:44.295173 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7b512f-f058-4d0a-9acc-2202ed1c228c None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:44.319102 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:44.331200 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e9062-949f-4f99-bd15-4007ded83f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:44.331902 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e9062-949f-4f99-bd15-4007ded83f7b None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:44.332186 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e9062-949f-4f99-bd15-4007ded83f7b None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:44.332460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162e9062-949f-4f99-bd15-4007ded83f7b None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:44.333199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e9062-949f-4f99-bd15-4007ded83f7b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:44.333507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e9062-949f-4f99-bd15-4007ded83f7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:44.334868 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162e9062-949f-4f99-bd15-4007ded83f7b None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:44.347702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 540/1063] 10.222.0.44 () {56 vars in 1115 bytes} [Thu Jun 16 00:14:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:44.349767 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a038a-f502-49ff-8e7b-7faddb86837d None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:44.450625 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a038a-f502-49ff-8e7b-7faddb86837d None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:44.484755 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de1aa7-d66e-4d4c-9529-a73d8c49e345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:44.485629 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de1aa7-d66e-4d4c-9529-a73d8c49e345 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:44.486402 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de1aa7-d66e-4d4c-9529-a73d8c49e345 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:44.486674 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de1aa7-d66e-4d4c-9529-a73d8c49e345 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:44.497768 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de1aa7-d66e-4d4c-9529-a73d8c49e345 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:44.499214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0de1aa7-d66e-4d4c-9529-a73d8c49e345 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:44.516397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-b0de1aa7-d66e-4d4c-9529-a73d8c49e345 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:44.516397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:44.516397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:44.516397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:44.516397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:44.516397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:44.516397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:44.516397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:44.516397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:44.516397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:44.516397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:44.516397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:44.516397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:44.516397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:44.516397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:44.517328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:44.517328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:44.517328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:44.517328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:44.517328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:44.517328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:44.517328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:44.517328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:44.517328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:44.517328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:44.517328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:44.517328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:44.517328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:44.517328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:44.517328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:44.517328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:44.517328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:44.518242 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:44.518242 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:44.518242 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:44.518242 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:44.518242 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 524/1064] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:44.524231 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e9062-949f-4f99-bd15-4007ded83f7b None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:44.624876 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162e9062-949f-4f99-bd15-4007ded83f7b None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:44.658326 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d19bb9-cc92-4df0-b899-9f00da30472a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:44.658988 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d19bb9-cc92-4df0-b899-9f00da30472a None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:44.659272 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d19bb9-cc92-4df0-b899-9f00da30472a None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:44.659547 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d19bb9-cc92-4df0-b899-9f00da30472a None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:44.660288 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d19bb9-cc92-4df0-b899-9f00da30472a None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:44.660594 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d19bb9-cc92-4df0-b899-9f00da30472a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:44.661946 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d19bb9-cc92-4df0-b899-9f00da30472a None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:44.674341 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 541/1065] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:44.679737 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de1aa7-d66e-4d4c-9529-a73d8c49e345 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:44.713873 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:44.791097 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6de85f-1f77-4be4-a2a5-788b399ae113 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:44.791384 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6de85f-1f77-4be4-a2a5-788b399ae113 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:44.791697 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6de85f-1f77-4be4-a2a5-788b399ae113 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:44.793069 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 542/1066] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:44.794343 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de1aa7-d66e-4d4c-9529-a73d8c49e345 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:44.798424 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75825219-bbbc-46f3-9baa-74d70adfdf95 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:44.798716 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75825219-bbbc-46f3-9baa-74d70adfdf95 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:44.799000 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75825219-bbbc-46f3-9baa-74d70adfdf95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:44.815538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-75825219-bbbc-46f3-9baa-74d70adfdf95 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:44.816759 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-75825219-bbbc-46f3-9baa-74d70adfdf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:44.833984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f208aa-a7e4-4cbf-9c2a-f9c93d0f8b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:44.834782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f208aa-a7e4-4cbf-9c2a-f9c93d0f8b0a None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:44.835068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f208aa-a7e4-4cbf-9c2a-f9c93d0f8b0a None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:44.835347 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f208aa-a7e4-4cbf-9c2a-f9c93d0f8b0a None admin] PATH_INFO: `/v3/users/nova` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:44.843143 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f208aa-a7e4-4cbf-9c2a-f9c93d0f8b0a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:44.844615 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f208aa-a7e4-4cbf-9c2a-f9c93d0f8b0a None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:44.858954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-09f208aa-a7e4-4cbf-9c2a-f9c93d0f8b0a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:14:44.858954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:44.858954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:44.858954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:44.858954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:44.858954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:44.858954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:44.858954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:44.858954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:44.858954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:44.858954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:44.858954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:44.858954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:14:44.858954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:14:44.858954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:14:44.858954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:14:44.860183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:44.860183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:44.860183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:14:44.860183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:44.860183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:14:44.860183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:44.860183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:44.860183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:44.860183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:44.860183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:44.860183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:44.860183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:44.860183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:44.860183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:44.860183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:44.860183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:44.860183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:44.860183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:44.861563 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:44.861563 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:44.861563 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:14:44.861563 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:14:44.861563 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:14:44.861563 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:14:44.861563 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:14:44.861563 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:14:44.861563 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:14:44.861563 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:44.861563 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 525/1067] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 16 00:14:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:44.861563 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f33b74-463f-46d7-a5e1-1e13a91a7581 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:44.862393 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f33b74-463f-46d7-a5e1-1e13a91a7581 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:44.862393 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f33b74-463f-46d7-a5e1-1e13a91a7581 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:44.862606 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:44.863282 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 526/1068] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:44.865737 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f33b74-463f-46d7-a5e1-1e13a91a7581 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:44.890088 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 543/1069] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:14:44.891437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c42f34-13d0-4fe0-a4e3-7ec5cba22a31 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:44.892305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c42f34-13d0-4fe0-a4e3-7ec5cba22a31 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:44.892593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c42f34-13d0-4fe0-a4e3-7ec5cba22a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:44.909615 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-d3c42f34-13d0-4fe0-a4e3-7ec5cba22a31 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:44.910820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-d3c42f34-13d0-4fe0-a4e3-7ec5cba22a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:44.962833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:44.971659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f33b74-463f-46d7-a5e1-1e13a91a7581 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:44.977486 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 544/1070] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:44.978319 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c42f34-13d0-4fe0-a4e3-7ec5cba22a31 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:45.006422 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6de5f-8403-4e03-bd18-c85ebb455e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:45.007346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6de5f-8403-4e03-bd18-c85ebb455e38 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:45.007658 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6de5f-8403-4e03-bd18-c85ebb455e38 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:45.007948 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e6de5f-8403-4e03-bd18-c85ebb455e38 None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:45.008776 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6de5f-8403-4e03-bd18-c85ebb455e38 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:45.009091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6de5f-8403-4e03-bd18-c85ebb455e38 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:45.010535 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e6de5f-8403-4e03-bd18-c85ebb455e38 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:45.027417 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 527/1071] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 16 00:14:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:45.028234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6de5f-8403-4e03-bd18-c85ebb455e38 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:45.085809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c42f34-13d0-4fe0-a4e3-7ec5cba22a31 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:45.092988 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:45.120084 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a7cb1-bdc7-482b-88a6-070fcb66e4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:45.120881 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a7cb1-bdc7-482b-88a6-070fcb66e4a1 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:45.121173 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a7cb1-bdc7-482b-88a6-070fcb66e4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:45.121475 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04a7cb1-bdc7-482b-88a6-070fcb66e4a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:45.125753 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e6de5f-8403-4e03-bd18-c85ebb455e38 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:45.132709 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04a7cb1-bdc7-482b-88a6-070fcb66e4a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:45.140362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-f04a7cb1-bdc7-482b-88a6-070fcb66e4a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:45.140362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:45.140362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:45.140362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:45.140362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:45.140362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:45.140362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:45.140362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:45.140362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:45.140362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:45.140362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:45.140362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:45.140362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:45.140362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:45.140362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:45.140362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:45.141354 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:45.141354 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:45.141354 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:45.141354 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:45.141354 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:45.141354 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:45.141354 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:45.141354 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:45.141354 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:45.141354 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:45.141354 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:45.141354 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:45.141354 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:45.141354 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:45.141354 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:45.141354 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:45.142254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:45.142254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:45.142254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:45.142254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:45.142254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:45.142254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:45.142254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:45.142254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:45.142254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:45.142254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:45.142254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:45.142254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:45.142254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 545/1072] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:14:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:45.142962 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a7cb1-bdc7-482b-88a6-070fcb66e4a1 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:45.163634 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4604b-25a9-41f0-993a-9bd0cc2e00f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:45.164293 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4604b-25a9-41f0-993a-9bd0cc2e00f8 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:45.164576 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4604b-25a9-41f0-993a-9bd0cc2e00f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:45.164847 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4604b-25a9-41f0-993a-9bd0cc2e00f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:45.186122 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:45.232446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4604b-25a9-41f0-993a-9bd0cc2e00f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:45.233844 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4604b-25a9-41f0-993a-9bd0cc2e00f8 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:45.242535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04a7cb1-bdc7-482b-88a6-070fcb66e4a1 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:45.275366 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9c2f4-513f-4743-99e4-717faf6847ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:45.276185 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9c2f4-513f-4743-99e4-717faf6847ee None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:45.276474 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9c2f4-513f-4743-99e4-717faf6847ee None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:45.276750 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9c2f4-513f-4743-99e4-717faf6847ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:45.287540 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9c2f4-513f-4743-99e4-717faf6847ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:45.289001 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9c2f4-513f-4743-99e4-717faf6847ee None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:45.305807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-02a9c2f4-513f-4743-99e4-717faf6847ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:45.305807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:45.305807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:45.305807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:45.305807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:45.305807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:45.305807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:45.305807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:45.305807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:45.305807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:45.305807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:45.305807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:45.305807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:45.305807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:45.305807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:45.306812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:45.306812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:45.306812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:45.306812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:45.306812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:45.306812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:45.306812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:45.306812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:45.306812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:45.306812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:45.306812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:45.306812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:45.306812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:45.306812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:45.306812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:45.306812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:45.306812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:45.307951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:45.307951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:45.307951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:45.307951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:45.307951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 546/1073] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:45.307951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9c2f4-513f-4743-99e4-717faf6847ee None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:45.329731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:45.334762 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 528/1074] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:45 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:14:45.335578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4604b-25a9-41f0-993a-9bd0cc2e00f8 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:45.386274 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:45.416173 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9c2f4-513f-4743-99e4-717faf6847ee None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:45.435249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4604b-25a9-41f0-993a-9bd0cc2e00f8 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:45.448564 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5012e4b-6dde-4dea-9782-17eaf4eedbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:45.449233 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5012e4b-6dde-4dea-9782-17eaf4eedbac None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:45.449520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5012e4b-6dde-4dea-9782-17eaf4eedbac None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:45.449803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5012e4b-6dde-4dea-9782-17eaf4eedbac None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:45.450548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5012e4b-6dde-4dea-9782-17eaf4eedbac None admin] RBAC: Adding query filter params (name=admin) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:45.450862 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5012e4b-6dde-4dea-9782-17eaf4eedbac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:45.452282 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5012e4b-6dde-4dea-9782-17eaf4eedbac None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:45.461117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 547/1075] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:45.461914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5012e4b-6dde-4dea-9782-17eaf4eedbac None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:45.474214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f145b-6367-489c-8684-b1d0bf6c3093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:45.474973 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f145b-6367-489c-8684-b1d0bf6c3093 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:45.475259 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f145b-6367-489c-8684-b1d0bf6c3093 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:45.475536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6f145b-6367-489c-8684-b1d0bf6c3093 None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:45.476287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f145b-6367-489c-8684-b1d0bf6c3093 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:45.476600 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f145b-6367-489c-8684-b1d0bf6c3093 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:45.478221 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6f145b-6367-489c-8684-b1d0bf6c3093 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:45.489909 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 529/1076] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:45.490666 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f145b-6367-489c-8684-b1d0bf6c3093 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:45.547219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:45.566928 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5012e4b-6dde-4dea-9782-17eaf4eedbac None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:45.589246 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6f145b-6367-489c-8684-b1d0bf6c3093 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:45.600420 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31283d7-c3fb-45f1-a0c5-52890406af49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:45.601214 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31283d7-c3fb-45f1-a0c5-52890406af49 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:45.601505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31283d7-c3fb-45f1-a0c5-52890406af49 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:45.601687 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:45.601795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31283d7-c3fb-45f1-a0c5-52890406af49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:45.612989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31283d7-c3fb-45f1-a0c5-52890406af49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:45.614448 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31283d7-c3fb-45f1-a0c5-52890406af49 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:45.623397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3aff3d-3308-4a90-b9f2-bd0c7a3a89fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:45.624287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3aff3d-3308-4a90-b9f2-bd0c7a3a89fb None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:45.624569 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3aff3d-3308-4a90-b9f2-bd0c7a3a89fb None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:45.624840 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3aff3d-3308-4a90-b9f2-bd0c7a3a89fb None admin] PATH_INFO: `/v3/users/f07e70d0a2924c88bacff95924627eba` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:45.626048 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3aff3d-3308-4a90-b9f2-bd0c7a3a89fb None admin] RBAC: Authorizing `identity:get_user(user_id=f07e70d0a2924c88bacff95924627eba)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:45.627497 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3aff3d-3308-4a90-b9f2-bd0c7a3a89fb None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:45.629158 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 530/1077] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:45 2022] GET /identity/v3/users/f07e70d0a2924c88bacff95924627eba => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:45.629905 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3aff3d-3308-4a90-b9f2-bd0c7a3a89fb None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:45.631592 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-e31283d7-c3fb-45f1-a0c5-52890406af49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:45.631592 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:45.631592 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:45.631592 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:45.631592 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:45.631592 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:45.631592 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:45.631592 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:45.631592 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:45.631592 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:45.631592 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:45.631592 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:45.631592 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:45.631592 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:45.631592 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:45.632535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:45.632535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:45.632535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:45.632535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:45.632535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:45.632535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:45.632535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:45.632535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:45.632535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:45.632535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:45.632535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:45.632535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:45.632535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:45.632535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:45.632535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:45.632535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:45.632535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:45.633548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:45.633548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:45.633548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:45.633548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:45.633548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 548/1078] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:45.634959 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31283d7-c3fb-45f1-a0c5-52890406af49 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:45.729376 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3aff3d-3308-4a90-b9f2-bd0c7a3a89fb None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:45.732653 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31283d7-c3fb-45f1-a0c5-52890406af49 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:45.761168 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:45.763358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5a414-85c0-40d6-85ec-05b703ff21c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:45.764180 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5a414-85c0-40d6-85ec-05b703ff21c6 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:45.764463 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5a414-85c0-40d6-85ec-05b703ff21c6 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:45.764737 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5a414-85c0-40d6-85ec-05b703ff21c6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:45.767026 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba01d60-fc71-4f3e-960d-6dce65eabeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:45.767902 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba01d60-fc71-4f3e-960d-6dce65eabeea None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:45.768184 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba01d60-fc71-4f3e-960d-6dce65eabeea None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:45.768457 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba01d60-fc71-4f3e-960d-6dce65eabeea None admin] PATH_INFO: `/v3/projects/d1d05dc43f2e490e8365d1a69ae9c1bb` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:45.769623 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba01d60-fc71-4f3e-960d-6dce65eabeea None admin] RBAC: Authorizing `identity:get_project(project_id=d1d05dc43f2e490e8365d1a69ae9c1bb)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:45.771041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba01d60-fc71-4f3e-960d-6dce65eabeea None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:45.771380 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5a414-85c0-40d6-85ec-05b703ff21c6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:45.772743 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 549/1079] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:45 2022] GET /identity/v3/projects/d1d05dc43f2e490e8365d1a69ae9c1bb => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:45.772892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5a414-85c0-40d6-85ec-05b703ff21c6 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:45.776467 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba01d60-fc71-4f3e-960d-6dce65eabeea None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:45.787454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-ccd5a414-85c0-40d6-85ec-05b703ff21c6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:45.787454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:45.787454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:45.787454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:45.787454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:45.787454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:45.787454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:45.787454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:45.787454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:45.787454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:45.787454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:45.787454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:45.787454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:14:45.787454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:14:45.787454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:14:45.788633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:14:45.788633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:45.788633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:45.788633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:45.788633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:45.788633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:45.788633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:45.788633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:45.788633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:45.788633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:45.788633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:45.788633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:45.788633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:45.788633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:45.788633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:45.788633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:45.788633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:45.789742 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:14:45.789742 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:14:45.789742 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:14:45.789742 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:14:45.789742 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:14:45.789742 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:14:45.789742 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:45.789742 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:45.789742 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 531/1080] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:45.789742 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5a414-85c0-40d6-85ec-05b703ff21c6 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:45.832063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:45.880977 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba01d60-fc71-4f3e-960d-6dce65eabeea None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:45.888970 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5a414-85c0-40d6-85ec-05b703ff21c6 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:45.913674 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66f753-aa92-465b-9d54-4a0e5243d07b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:45.914340 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66f753-aa92-465b-9d54-4a0e5243d07b None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:45.914629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66f753-aa92-465b-9d54-4a0e5243d07b None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:45.914908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a66f753-aa92-465b-9d54-4a0e5243d07b None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:45.915643 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66f753-aa92-465b-9d54-4a0e5243d07b None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:45.915972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66f753-aa92-465b-9d54-4a0e5243d07b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:45.917331 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a66f753-aa92-465b-9d54-4a0e5243d07b None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:45.921933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7b1ff-8b2e-4a8e-b359-384f0ab54c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:45.922806 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7b1ff-8b2e-4a8e-b359-384f0ab54c3e None admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:45.923137 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7b1ff-8b2e-4a8e-b359-384f0ab54c3e None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:45.923406 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7b1ff-8b2e-4a8e-b359-384f0ab54c3e None admin] PATH_INFO: `/v3/projects/d1d05dc43f2e490e8365d1a69ae9c1bb/users/f07e70d0a2924c88bacff95924627eba/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:45.925411 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7b1ff-8b2e-4a8e-b359-384f0ab54c3e None admin] RBAC: Authorizing `identity:create_grant(project_id=d1d05dc43f2e490e8365d1a69ae9c1bb, user_id=f07e70d0a2924c88bacff95924627eba, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:45.926844 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7b1ff-8b2e-4a8e-b359-384f0ab54c3e None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:45.928846 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 550/1081] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:45.929634 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66f753-aa92-465b-9d54-4a0e5243d07b None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:45.949553 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 532/1082] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 00:14:45 2022] PUT /identity/v3/projects/d1d05dc43f2e490e8365d1a69ae9c1bb/users/f07e70d0a2924c88bacff95924627eba/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:14:46.008472 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:46.057925 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a66f753-aa92-465b-9d54-4a0e5243d07b None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:46.097988 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86177927-c70e-44a6-9e12-3738e78dfc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:46.098686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86177927-c70e-44a6-9e12-3738e78dfc6b None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:46.098974 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86177927-c70e-44a6-9e12-3738e78dfc6b None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:46.099254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86177927-c70e-44a6-9e12-3738e78dfc6b None admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:46.100112 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86177927-c70e-44a6-9e12-3738e78dfc6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:46.100433 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86177927-c70e-44a6-9e12-3738e78dfc6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:46.101960 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86177927-c70e-44a6-9e12-3738e78dfc6b None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:46.119637 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 551/1083] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:14:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:46.122120 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7b1ff-8b2e-4a8e-b359-384f0ab54c3e None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:46.227540 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:46.231419 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7b1ff-8b2e-4a8e-b359-384f0ab54c3e None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:46.276276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fa2597-e4a9-40ee-af78-90129a6d8208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:46.277176 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa2597-e4a9-40ee-af78-90129a6d8208 None admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:46.277456 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa2597-e4a9-40ee-af78-90129a6d8208 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:46.277730 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fa2597-e4a9-40ee-af78-90129a6d8208 None admin] PATH_INFO: `/v3/projects/320d79ecbc2342af8031103e7308c10d/users/40432493f16b4df681daf5a1af87832a/roles/0876003b49cc4c678dc978764ef54594` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:46.279955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa2597-e4a9-40ee-af78-90129a6d8208 None admin] RBAC: Authorizing `identity:create_grant(project_id=320d79ecbc2342af8031103e7308c10d, user_id=40432493f16b4df681daf5a1af87832a, role_id=0876003b49cc4c678dc978764ef54594)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:46.281400 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fa2597-e4a9-40ee-af78-90129a6d8208 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:46.294030 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 533/1084] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 00:14:46 2022] PUT /identity/v3/projects/320d79ecbc2342af8031103e7308c10d/users/40432493f16b4df681daf5a1af87832a/roles/0876003b49cc4c678dc978764ef54594 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:14:48.072268 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725178e-5d10-41e1-9447-bd2414e8f16a None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:48.072780 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725178e-5d10-41e1-9447-bd2414e8f16a None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:48.072780 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725178e-5d10-41e1-9447-bd2414e8f16a None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:48.074098 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 552/1085] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:48.079381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657b9fa-87c3-45c0-bee3-39556f2fa193 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:48.079822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657b9fa-87c3-45c0-bee3-39556f2fa193 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:48.080000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f657b9fa-87c3-45c0-bee3-39556f2fa193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:48.097210 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-f657b9fa-87c3-45c0-bee3-39556f2fa193 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:48.098416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-f657b9fa-87c3-45c0-bee3-39556f2fa193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:48.162223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 534/1086] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:48.185541 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725178e-5d10-41e1-9447-bd2414e8f16a None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:48.290547 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725178e-5d10-41e1-9447-bd2414e8f16a None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:48.311265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:48.327295 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5aee0e-3599-470c-9cac-118e1b56668c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:48.328055 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aee0e-3599-470c-9cac-118e1b56668c None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:48.328350 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aee0e-3599-470c-9cac-118e1b56668c None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:48.328628 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5aee0e-3599-470c-9cac-118e1b56668c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:48.341206 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5aee0e-3599-470c-9cac-118e1b56668c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:48.349548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-8e5aee0e-3599-470c-9cac-118e1b56668c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:48.349548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:48.349548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:48.349548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:48.349548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:48.349548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:48.349548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:48.349548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:48.349548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:48.349548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:48.349548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:48.349548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:48.349548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:48.349548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:48.349548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:48.349548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:48.350686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:48.350686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:48.350686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:48.350686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:48.350686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:48.350686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:48.350686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:48.350686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:48.350686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:48.350686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:48.350686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:48.350686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:48.350686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:48.350686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:48.350686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:48.350686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:48.351538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:48.351538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:48.351538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:48.351538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:48.351538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:48.351538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:48.351538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:48.351538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:48.351538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:48.351538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:48.351538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:14:48.351538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:48.351538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 553/1087] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:14:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:48.356964 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657b9fa-87c3-45c0-bee3-39556f2fa193 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:48.385498 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b4815-4306-4546-940b-cfa4f1d62e50 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:48.385784 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b4815-4306-4546-940b-cfa4f1d62e50 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:48.386174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133b4815-4306-4546-940b-cfa4f1d62e50 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:48.387701 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 554/1088] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:14:48.392849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e248a80-805a-4667-a3e9-511c926bc61a None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:48.393132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e248a80-805a-4667-a3e9-511c926bc61a None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:48.393402 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e248a80-805a-4667-a3e9-511c926bc61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:48.411949 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-3e248a80-805a-4667-a3e9-511c926bc61a None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:48.413127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-3e248a80-805a-4667-a3e9-511c926bc61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:48.445499 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:48.456588 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f657b9fa-87c3-45c0-bee3-39556f2fa193 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:48.480255 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 555/1089] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:14:48.490165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716d8ed-d3f9-4590-bd6b-2357f8fbdd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:48.490824 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716d8ed-d3f9-4590-bd6b-2357f8fbdd81 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:48.491106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716d8ed-d3f9-4590-bd6b-2357f8fbdd81 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:48.491379 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3716d8ed-d3f9-4590-bd6b-2357f8fbdd81 None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:48.492147 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716d8ed-d3f9-4590-bd6b-2357f8fbdd81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:48.492454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716d8ed-d3f9-4590-bd6b-2357f8fbdd81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:48.493805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3716d8ed-d3f9-4590-bd6b-2357f8fbdd81 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:48.506619 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 535/1090] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:14:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:48.506780 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e248a80-805a-4667-a3e9-511c926bc61a None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:48.507551 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716d8ed-d3f9-4590-bd6b-2357f8fbdd81 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:48.606856 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3716d8ed-d3f9-4590-bd6b-2357f8fbdd81 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:48.608072 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e248a80-805a-4667-a3e9-511c926bc61a None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:48.618940 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:48.641984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e0510-8f4b-4254-a9a0-468c226ae924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:48.642860 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e0510-8f4b-4254-a9a0-468c226ae924 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:48.643129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e16c4-2f8e-41f1-a566-b7d1ae67d89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:48.643238 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e0510-8f4b-4254-a9a0-468c226ae924 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:48.643403 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e0510-8f4b-4254-a9a0-468c226ae924 None admin] PATH_INFO: `/v3/users/f07e70d0a2924c88bacff95924627eba` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:48.643971 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e16c4-2f8e-41f1-a566-b7d1ae67d89d None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:48.644256 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e16c4-2f8e-41f1-a566-b7d1ae67d89d None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:48.644533 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72e16c4-2f8e-41f1-a566-b7d1ae67d89d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:48.644650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e0510-8f4b-4254-a9a0-468c226ae924 None admin] RBAC: Authorizing `identity:get_user(user_id=f07e70d0a2924c88bacff95924627eba)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:48.646079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e0510-8f4b-4254-a9a0-468c226ae924 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:48.647733 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 536/1091] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:48 2022] GET /identity/v3/users/f07e70d0a2924c88bacff95924627eba => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:48.653255 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e0510-8f4b-4254-a9a0-468c226ae924 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:48.654780 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72e16c4-2f8e-41f1-a566-b7d1ae67d89d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:14:48.662954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-c72e16c4-2f8e-41f1-a566-b7d1ae67d89d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:14:48.662954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:48.662954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:48.662954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:48.662954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:48.662954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:48.662954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:48.662954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:48.662954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:48.662954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:48.662954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:48.662954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:48.662954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:14:48.662954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:14:48.662954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:14:48.662954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:14:48.663955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:14:48.663955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:14:48.663955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:14:48.663955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:14:48.663955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:48.663955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:48.663955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:48.663955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:48.663955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:48.663955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:48.663955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:48.663955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:48.663955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:48.663955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:48.663955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:48.663955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:48.664816 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:48.664816 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:48.664816 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:48.664816 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:48.664816 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:14:48.664816 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:14:48.664816 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:14:48.664816 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:14:48.664816 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:14:48.664816 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:14:48.664816 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 16 00:14:48.664816 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:48.664816 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 556/1092] 10.222.0.44 () {56 vars in 1120 bytes} [Thu Jun 16 00:14:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:48.669956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e16c4-2f8e-41f1-a566-b7d1ae67d89d None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:48.678470 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:48.758370 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e0510-8f4b-4254-a9a0-468c226ae924 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:48.767703 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72e16c4-2f8e-41f1-a566-b7d1ae67d89d None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:48.791938 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e7e7d-71be-4490-bbe9-1e8be587cc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:48.792583 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e7e7d-71be-4490-bbe9-1e8be587cc78 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:48.792867 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e7e7d-71be-4490-bbe9-1e8be587cc78 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:48.793143 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e7e7d-71be-4490-bbe9-1e8be587cc78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:48.804887 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ec58c-1762-497d-bc8b-4133a3712b72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:48.805557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ec58c-1762-497d-bc8b-4133a3712b72 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:48.805846 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ec58c-1762-497d-bc8b-4133a3712b72 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:48.806123 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9ec58c-1762-497d-bc8b-4133a3712b72 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:48.806865 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ec58c-1762-497d-bc8b-4133a3712b72 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:48.807174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ec58c-1762-497d-bc8b-4133a3712b72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:48.808582 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9ec58c-1762-497d-bc8b-4133a3712b72 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:48.817275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 557/1093] 10.222.0.44 () {56 vars in 1115 bytes} [Thu Jun 16 00:14:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:48.822796 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ec58c-1762-497d-bc8b-4133a3712b72 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:48.853280 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:48.861591 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e7e7d-71be-4490-bbe9-1e8be587cc78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:48.863022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e7e7d-71be-4490-bbe9-1e8be587cc78 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:48.883576 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:48.920884 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9ec58c-1762-497d-bc8b-4133a3712b72 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:48.953495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5ba55-8589-43a0-a159-43ea09d7cb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:48.954278 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5ba55-8589-43a0-a159-43ea09d7cb5f None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:48.954567 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5ba55-8589-43a0-a159-43ea09d7cb5f None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:48.954839 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f5ba55-8589-43a0-a159-43ea09d7cb5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:48.961000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 537/1094] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:14:48.967868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e7e7d-71be-4490-bbe9-1e8be587cc78 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:48.971105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5ba55-8589-43a0-a159-43ea09d7cb5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:48.972596 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f5ba55-8589-43a0-a159-43ea09d7cb5f None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:48.990311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-a4f5ba55-8589-43a0-a159-43ea09d7cb5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:48.990311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:48.990311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:48.990311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:48.990311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:48.990311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:48.990311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:48.990311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:48.990311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:48.990311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:48.990311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:48.990311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:48.990311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:48.990311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:48.990311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:48.991222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:48.991222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:48.991222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:48.991222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:48.991222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:48.991222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:48.991222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:48.991222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:48.991222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:48.991222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:48.991222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:48.991222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:48.991222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:48.991222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:48.991222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:48.991222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:48.991222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:48.992196 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:48.992196 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:48.992196 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:48.992196 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:48.995756 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 558/1095] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:48.997038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5ba55-8589-43a0-a159-43ea09d7cb5f None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:49.064720 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e7e7d-71be-4490-bbe9-1e8be587cc78 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:49.078314 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:49.085953 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:49.095597 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f5ba55-8589-43a0-a159-43ea09d7cb5f None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:49.100448 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be339af-ebbc-4aa1-ba10-e7afdde13a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:49.101303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be339af-ebbc-4aa1-ba10-e7afdde13a48 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:49.101588 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be339af-ebbc-4aa1-ba10-e7afdde13a48 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:49.101866 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be339af-ebbc-4aa1-ba10-e7afdde13a48 None admin] PATH_INFO: `/v3/projects/d1d05dc43f2e490e8365d1a69ae9c1bb` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:49.103051 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be339af-ebbc-4aa1-ba10-e7afdde13a48 None admin] RBAC: Authorizing `identity:get_project(project_id=d1d05dc43f2e490e8365d1a69ae9c1bb)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:49.104545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be339af-ebbc-4aa1-ba10-e7afdde13a48 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:49.106228 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 538/1096] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:48 2022] GET /identity/v3/projects/d1d05dc43f2e490e8365d1a69ae9c1bb => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:49.112836 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be339af-ebbc-4aa1-ba10-e7afdde13a48 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:49.131080 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82537728-8d0a-4343-86b3-d5a5d40fc2c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:49.131779 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82537728-8d0a-4343-86b3-d5a5d40fc2c5 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:49.132072 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82537728-8d0a-4343-86b3-d5a5d40fc2c5 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:49.132353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82537728-8d0a-4343-86b3-d5a5d40fc2c5 None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:49.133430 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82537728-8d0a-4343-86b3-d5a5d40fc2c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:49.133430 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82537728-8d0a-4343-86b3-d5a5d40fc2c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:49.134755 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82537728-8d0a-4343-86b3-d5a5d40fc2c5 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:49.146808 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 559/1097] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:49.152253 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82537728-8d0a-4343-86b3-d5a5d40fc2c5 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:49.210526 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be339af-ebbc-4aa1-ba10-e7afdde13a48 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:49.243750 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded47d0-c365-4fa6-81ce-a9f005d2a761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:49.244400 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded47d0-c365-4fa6-81ce-a9f005d2a761 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:49.244681 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded47d0-c365-4fa6-81ce-a9f005d2a761 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:49.244956 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dded47d0-c365-4fa6-81ce-a9f005d2a761 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:49.245775 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded47d0-c365-4fa6-81ce-a9f005d2a761 None admin] RBAC: Adding query filter params (role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab, scope.project.id=d1d05dc43f2e490e8365d1a69ae9c1bb, user.id=f07e70d0a2924c88bacff95924627eba) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:49.246090 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded47d0-c365-4fa6-81ce-a9f005d2a761 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:49.247515 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dded47d0-c365-4fa6-81ce-a9f005d2a761 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:49.249605 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82537728-8d0a-4343-86b3-d5a5d40fc2c5 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:49.253477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 539/1098] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:49 2022] GET /identity/v3/role_assignments?user.id=f07e70d0a2924c88bacff95924627eba&scope.project.id=d1d05dc43f2e490e8365d1a69ae9c1bb&role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:49.286060 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee36f9-53e4-40b1-9304-30ce553c27cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:49.286877 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee36f9-53e4-40b1-9304-30ce553c27cd None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:49.287157 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee36f9-53e4-40b1-9304-30ce553c27cd None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:49.287429 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ee36f9-53e4-40b1-9304-30ce553c27cd None admin] PATH_INFO: `/v3/users/nova` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:49.295690 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee36f9-53e4-40b1-9304-30ce553c27cd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:49.297201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ee36f9-53e4-40b1-9304-30ce553c27cd None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:49.313735 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-d3ee36f9-53e4-40b1-9304-30ce553c27cd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:14:49.313735 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:49.313735 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:49.313735 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:49.313735 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:49.313735 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:49.313735 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:49.313735 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:49.313735 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:49.313735 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:49.313735 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:49.313735 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:49.313735 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:14:49.313735 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:14:49.313735 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:14:49.313735 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:14:49.314795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:49.314795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:49.314795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:14:49.314795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:49.314795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:14:49.314795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:14:49.314795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:49.314795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:49.314795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:49.314795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:49.314795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:49.314795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:49.314795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:49.314795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:49.314795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:49.314795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:49.314795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:49.314795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:49.315786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:49.315786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:49.315786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:14:49.315786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:14:49.315786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:14:49.315786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:14:49.315786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:14:49.315786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:14:49.315786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 16 00:14:49.315786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:14:49.315786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 560/1099] 10.222.0.44 () {56 vars in 1093 bytes} [Thu Jun 16 00:14:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:49.320935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded47d0-c365-4fa6-81ce-a9f005d2a761 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:49.376488 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:49.426549 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dded47d0-c365-4fa6-81ce-a9f005d2a761 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:49.460089 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bacdd7-73f7-4781-814d-58537f08a0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:49.460755 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bacdd7-73f7-4781-814d-58537f08a0f8 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:49.461036 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bacdd7-73f7-4781-814d-58537f08a0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:49.461312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bacdd7-73f7-4781-814d-58537f08a0f8 None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:49.462134 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bacdd7-73f7-4781-814d-58537f08a0f8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:49.462449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bacdd7-73f7-4781-814d-58537f08a0f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:49.463895 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bacdd7-73f7-4781-814d-58537f08a0f8 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:49.480758 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 540/1100] 10.222.0.44 () {56 vars in 1133 bytes} [Thu Jun 16 00:14:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:49.486624 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee36f9-53e4-40b1-9304-30ce553c27cd None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:49.490435 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:49.584151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ee36f9-53e4-40b1-9304-30ce553c27cd None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:49.618020 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd39487-9214-40af-a139-d39ceff02c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:49.618666 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd39487-9214-40af-a139-d39ceff02c8e None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:49.618952 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd39487-9214-40af-a139-d39ceff02c8e None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:49.619228 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd39487-9214-40af-a139-d39ceff02c8e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:49.684619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd39487-9214-40af-a139-d39ceff02c8e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:49.685985 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd39487-9214-40af-a139-d39ceff02c8e None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:49.689115 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:49.782908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 561/1101] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:14:49.788754 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bacdd7-73f7-4781-814d-58537f08a0f8 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:49.885055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bacdd7-73f7-4781-814d-58537f08a0f8 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:49.895227 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:49.918998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d7915-0129-42bd-8fb1-c60e1d1cab40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:49.919820 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d7915-0129-42bd-8fb1-c60e1d1cab40 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:49.920110 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d7915-0129-42bd-8fb1-c60e1d1cab40 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:49.920388 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0d7915-0129-42bd-8fb1-c60e1d1cab40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:49.930775 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d7915-0129-42bd-8fb1-c60e1d1cab40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:49.932266 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0d7915-0129-42bd-8fb1-c60e1d1cab40 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:49.949984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-8c0d7915-0129-42bd-8fb1-c60e1d1cab40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:49.949984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:49.949984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:49.949984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:49.949984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:49.949984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:49.949984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:49.949984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:49.949984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:49.949984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:49.949984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:49.949984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:49.949984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:14:49.949984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:14:49.949984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:14:49.950868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:14:49.950868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:49.950868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:49.950868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:49.950868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:49.950868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:49.950868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:49.950868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:49.950868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:49.950868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:49.950868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:49.950868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:49.950868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:49.950868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:49.950868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:49.950868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:49.950868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:49.951800 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:14:49.951800 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:14:49.951800 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:14:49.951800 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:49.955833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 541/1102] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:14:49.956822 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd39487-9214-40af-a139-d39ceff02c8e None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:50.053977 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd39487-9214-40af-a139-d39ceff02c8e None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:50.056328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:50.087999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13710596-887c-4a58-8d62-c53c6d1b1465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:50.088670 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13710596-887c-4a58-8d62-c53c6d1b1465 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:50.088950 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13710596-887c-4a58-8d62-c53c6d1b1465 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:50.089249 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13710596-887c-4a58-8d62-c53c6d1b1465 None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:50.089935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13710596-887c-4a58-8d62-c53c6d1b1465 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:50.090240 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13710596-887c-4a58-8d62-c53c6d1b1465 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:50.091598 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13710596-887c-4a58-8d62-c53c6d1b1465 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:50.102951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 562/1103] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:50.108485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d7915-0129-42bd-8fb1-c60e1d1cab40 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:50.206531 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0d7915-0129-42bd-8fb1-c60e1d1cab40 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:50.238632 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f9843-a5e5-4e54-afca-d7bf598d2fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:50.239399 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f9843-a5e5-4e54-afca-d7bf598d2fe4 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:50.239709 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f9843-a5e5-4e54-afca-d7bf598d2fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:50.239985 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672f9843-a5e5-4e54-afca-d7bf598d2fe4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:50.246391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f9843-a5e5-4e54-afca-d7bf598d2fe4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:50.247858 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672f9843-a5e5-4e54-afca-d7bf598d2fe4 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:50.261888 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-672f9843-a5e5-4e54-afca-d7bf598d2fe4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:50.261888 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:14:50.261888 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:14:50.261888 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:14:50.261888 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:14:50.261888 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:14:50.261888 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:14:50.261888 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:14:50.261888 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:14:50.261888 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:14:50.261888 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:14:50.261888 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:14:50.261888 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:14:50.261888 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:14:50.261888 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:14:50.262941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:14:50.262941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:14:50.262941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:14:50.262941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:14:50.262941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:14:50.262941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:14:50.262941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:14:50.262941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:14:50.262941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:14:50.262941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:14:50.262941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:14:50.262941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:14:50.262941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:14:50.262941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:14:50.262941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:14:50.262941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:14:50.262941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:14:50.263906 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:14:50.263906 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:14:50.263906 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:14:50.263906 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:14:50.263906 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:14:50.263906 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:14:50.263906 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:14:50.263906 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:14:50.263906 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 542/1104] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:14:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:14:50.269227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13710596-887c-4a58-8d62-c53c6d1b1465 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:50.368525 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13710596-887c-4a58-8d62-c53c6d1b1465 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:50.401983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f78b89-a587-42fd-ab96-7934da2a0b70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:50.402645 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f78b89-a587-42fd-ab96-7934da2a0b70 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:50.402928 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f78b89-a587-42fd-ab96-7934da2a0b70 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:50.403203 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f78b89-a587-42fd-ab96-7934da2a0b70 None admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:50.404026 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f78b89-a587-42fd-ab96-7934da2a0b70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:50.404341 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f78b89-a587-42fd-ab96-7934da2a0b70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:50.405768 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f78b89-a587-42fd-ab96-7934da2a0b70 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:50.418157 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 563/1105] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:14:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:50.424556 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f9843-a5e5-4e54-afca-d7bf598d2fe4 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:50.448791 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:50.523838 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672f9843-a5e5-4e54-afca-d7bf598d2fe4 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:50.558180 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bfc488-b0b6-4e7f-ad5c-2399e7040ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:50.558834 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfc488-b0b6-4e7f-ad5c-2399e7040ef8 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:50.559120 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfc488-b0b6-4e7f-ad5c-2399e7040ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:50.559399 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bfc488-b0b6-4e7f-ad5c-2399e7040ef8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:50.560265 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfc488-b0b6-4e7f-ad5c-2399e7040ef8 None admin] RBAC: Adding query filter params (role.id=0876003b49cc4c678dc978764ef54594, scope.project.id=320d79ecbc2342af8031103e7308c10d, user.id=40432493f16b4df681daf5a1af87832a) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:50.560585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfc488-b0b6-4e7f-ad5c-2399e7040ef8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:50.565362 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73bfc488-b0b6-4e7f-ad5c-2399e7040ef8 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:50.571354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 543/1106] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:50 2022] GET /identity/v3/role_assignments?user.id=40432493f16b4df681daf5a1af87832a&scope.project.id=320d79ecbc2342af8031103e7308c10d&role.id=0876003b49cc4c678dc978764ef54594 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:14:51.417053 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db2f8e-c683-4b3a-8c39-f94a9af5a11a None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:51.417571 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db2f8e-c683-4b3a-8c39-f94a9af5a11a None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:51.417665 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0db2f8e-c683-4b3a-8c39-f94a9af5a11a None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:51.418981 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 564/1107] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:51.424150 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15feb2f-bd5c-48a7-9b3d-545cb04b3171 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:51.424637 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15feb2f-bd5c-48a7-9b3d-545cb04b3171 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:51.424739 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15feb2f-bd5c-48a7-9b3d-545cb04b3171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:51.440849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-c15feb2f-bd5c-48a7-9b3d-545cb04b3171 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:51.442009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-c15feb2f-bd5c-48a7-9b3d-545cb04b3171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:51.506753 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 544/1108] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:51.531126 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db2f8e-c683-4b3a-8c39-f94a9af5a11a None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:51.556051 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:51.630649 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0db2f8e-c683-4b3a-8c39-f94a9af5a11a None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:51.664677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544b4565-8eb6-4cf1-be82-a25ebde459b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:51.665457 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b4565-8eb6-4cf1-be82-a25ebde459b9 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:51.665745 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b4565-8eb6-4cf1-be82-a25ebde459b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:51.666024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544b4565-8eb6-4cf1-be82-a25ebde459b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:51.667242 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b4565-8eb6-4cf1-be82-a25ebde459b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:51.668650 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544b4565-8eb6-4cf1-be82-a25ebde459b9 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:51.670231 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 565/1109] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:14:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:51.675830 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15feb2f-bd5c-48a7-9b3d-545cb04b3171 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:51.693373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:51.772635 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15feb2f-bd5c-48a7-9b3d-545cb04b3171 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:51.805434 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597bcdb1-d67e-441e-99f0-6e83b65c9cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:51.806099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bcdb1-d67e-441e-99f0-6e83b65c9cba None admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:51.806380 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bcdb1-d67e-441e-99f0-6e83b65c9cba None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:51.806652 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597bcdb1-d67e-441e-99f0-6e83b65c9cba None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:51.807345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bcdb1-d67e-441e-99f0-6e83b65c9cba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:51.808813 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597bcdb1-d67e-441e-99f0-6e83b65c9cba None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:51.828173 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 545/1110] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 00:14:51 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:14:53.964454 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc591a9-d3e3-4182-80d9-394adc4439cc None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:53.965033 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc591a9-d3e3-4182-80d9-394adc4439cc None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:53.965033 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc591a9-d3e3-4182-80d9-394adc4439cc None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:53.966378 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 566/1111] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:53.972030 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d0b92-1eab-41e2-8215-7c646c520193 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:53.972445 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d0b92-1eab-41e2-8215-7c646c520193 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:53.972600 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d0b92-1eab-41e2-8215-7c646c520193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:53.989469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-734d0b92-1eab-41e2-8215-7c646c520193 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:53.990653 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-734d0b92-1eab-41e2-8215-7c646c520193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:54.054873 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 546/1112] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:53 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:14:54.077835 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc591a9-d3e3-4182-80d9-394adc4439cc None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:54.167183 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:54.177435 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc591a9-d3e3-4182-80d9-394adc4439cc None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:54.209433 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307eb5e-ff89-455f-98ee-9d2b075c7242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:54.210262 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307eb5e-ff89-455f-98ee-9d2b075c7242 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:54.210539 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307eb5e-ff89-455f-98ee-9d2b075c7242 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:54.210810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e307eb5e-ff89-455f-98ee-9d2b075c7242 None admin] PATH_INFO: `/v3/roles/e6bcb832ed6d4843825263e23d8fb208` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:54.212281 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307eb5e-ff89-455f-98ee-9d2b075c7242 None admin] RBAC: Authorizing `identity:get_role(role_id=e6bcb832ed6d4843825263e23d8fb208)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:54.213639 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e307eb5e-ff89-455f-98ee-9d2b075c7242 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:54.214959 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 567/1113] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:54 2022] GET /identity/v3/roles/e6bcb832ed6d4843825263e23d8fb208 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:54.221037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d0b92-1eab-41e2-8215-7c646c520193 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:54.223172 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:54.317731 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d0b92-1eab-41e2-8215-7c646c520193 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:54.351044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c0c4a-901c-47e3-af19-36ec6997bc6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:54.352074 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c0c4a-901c-47e3-af19-36ec6997bc6b None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:54.352363 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c0c4a-901c-47e3-af19-36ec6997bc6b None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:54.352642 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999c0c4a-901c-47e3-af19-36ec6997bc6b None admin] PATH_INFO: `/v3/users/f79aa7af461242aab34cb23b64a34f44` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:54.365465 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c0c4a-901c-47e3-af19-36ec6997bc6b None admin] RBAC: Authorizing `identity:get_user(user_id=f79aa7af461242aab34cb23b64a34f44)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:54.366915 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999c0c4a-901c-47e3-af19-36ec6997bc6b None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:54.368587 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 547/1114] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:54 2022] GET /identity/v3/users/f79aa7af461242aab34cb23b64a34f44 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:54.374215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307eb5e-ff89-455f-98ee-9d2b075c7242 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:54.469040 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e307eb5e-ff89-455f-98ee-9d2b075c7242 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:54.501418 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f23b73-e7da-4cc0-9d5f-130604e34d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:54.502051 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f23b73-e7da-4cc0-9d5f-130604e34d3e None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:54.502330 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f23b73-e7da-4cc0-9d5f-130604e34d3e None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:54.502601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f23b73-e7da-4cc0-9d5f-130604e34d3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:54.529162 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:54.569743 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f23b73-e7da-4cc0-9d5f-130604e34d3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:54.571130 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f23b73-e7da-4cc0-9d5f-130604e34d3e None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:54.664702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 568/1115] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:14:54 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:14:54.670591 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c0c4a-901c-47e3-af19-36ec6997bc6b None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:54.727807 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:54.767334 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999c0c4a-901c-47e3-af19-36ec6997bc6b None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:54.800649 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30440df-1b84-4e16-b7c9-a4ade358da9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:54.801501 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30440df-1b84-4e16-b7c9-a4ade358da9e None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:54.801787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30440df-1b84-4e16-b7c9-a4ade358da9e None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:54.802064 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30440df-1b84-4e16-b7c9-a4ade358da9e None admin] PATH_INFO: `/v3/projects/d1d05dc43f2e490e8365d1a69ae9c1bb` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:54.803234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30440df-1b84-4e16-b7c9-a4ade358da9e None admin] RBAC: Authorizing `identity:get_project(project_id=d1d05dc43f2e490e8365d1a69ae9c1bb)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:54.804703 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30440df-1b84-4e16-b7c9-a4ade358da9e None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:54.806382 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 548/1116] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:54 2022] GET /identity/v3/projects/d1d05dc43f2e490e8365d1a69ae9c1bb => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:54.812793 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f23b73-e7da-4cc0-9d5f-130604e34d3e None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:54.869471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:54.909946 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f23b73-e7da-4cc0-9d5f-130604e34d3e None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:54.942813 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562a0f5c-2f79-4d55-bb16-b76e87b479ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:54.943454 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a0f5c-2f79-4d55-bb16-b76e87b479ff None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:54.943768 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a0f5c-2f79-4d55-bb16-b76e87b479ff None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:54.944048 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562a0f5c-2f79-4d55-bb16-b76e87b479ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:54.944874 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a0f5c-2f79-4d55-bb16-b76e87b479ff None admin] RBAC: Adding query filter params (role.id=e6bcb832ed6d4843825263e23d8fb208, scope.project.id=d1d05dc43f2e490e8365d1a69ae9c1bb, user.id=f79aa7af461242aab34cb23b64a34f44) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:14:54.945192 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a0f5c-2f79-4d55-bb16-b76e87b479ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:54.946609 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562a0f5c-2f79-4d55-bb16-b76e87b479ff None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:54.952020 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 569/1117] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:14:54 2022] GET /identity/v3/role_assignments?user.id=f79aa7af461242aab34cb23b64a34f44&scope.project.id=d1d05dc43f2e490e8365d1a69ae9c1bb&role.id=e6bcb832ed6d4843825263e23d8fb208 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:57.016165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24336590-2a1e-4fd5-a6e5-cfa112f1de54 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:57.016708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24336590-2a1e-4fd5-a6e5-cfa112f1de54 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:57.016708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24336590-2a1e-4fd5-a6e5-cfa112f1de54 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:57.018062 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 549/1118] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:57.023671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fdcff-9150-494a-b342-4db9e4413385 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:57.024038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fdcff-9150-494a-b342-4db9e4413385 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:57.024237 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3fdcff-9150-494a-b342-4db9e4413385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:57.041348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-9b3fdcff-9150-494a-b342-4db9e4413385 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:57.042527 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-9b3fdcff-9150-494a-b342-4db9e4413385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:57.106996 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 570/1119] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:57.129383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24336590-2a1e-4fd5-a6e5-cfa112f1de54 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:57.227419 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24336590-2a1e-4fd5-a6e5-cfa112f1de54 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:57.252660 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:57.260638 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f0bbe-eecb-4cdf-8066-2818c6ed9e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:57.261467 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f0bbe-eecb-4cdf-8066-2818c6ed9e4d None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:57.261746 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f0bbe-eecb-4cdf-8066-2818c6ed9e4d None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:57.262016 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414f0bbe-eecb-4cdf-8066-2818c6ed9e4d None admin] PATH_INFO: `/v3/roles/e6bcb832ed6d4843825263e23d8fb208` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:57.263455 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f0bbe-eecb-4cdf-8066-2818c6ed9e4d None admin] RBAC: Authorizing `identity:get_role(role_id=e6bcb832ed6d4843825263e23d8fb208)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:57.264844 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414f0bbe-eecb-4cdf-8066-2818c6ed9e4d None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:57.266741 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 550/1120] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:57 2022] GET /identity/v3/roles/e6bcb832ed6d4843825263e23d8fb208 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:57.272521 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fdcff-9150-494a-b342-4db9e4413385 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:57.326159 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:57.369026 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3fdcff-9150-494a-b342-4db9e4413385 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:57.401837 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dd064-4d53-4adb-9f10-f8310f80b26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:57.402699 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dd064-4d53-4adb-9f10-f8310f80b26d None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:57.402983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dd064-4d53-4adb-9f10-f8310f80b26d None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:57.403260 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0dd064-4d53-4adb-9f10-f8310f80b26d None admin] PATH_INFO: `/v3/users/f79aa7af461242aab34cb23b64a34f44` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:57.404469 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0dd064-4d53-4adb-9f10-f8310f80b26d None admin] RBAC: Authorizing `identity:get_user(user_id=f79aa7af461242aab34cb23b64a34f44)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:57.405887 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0dd064-4d53-4adb-9f10-f8310f80b26d None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:57.407474 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 571/1121] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:57 2022] GET /identity/v3/users/f79aa7af461242aab34cb23b64a34f44 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:57.413068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f0bbe-eecb-4cdf-8066-2818c6ed9e4d None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:57.507100 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414f0bbe-eecb-4cdf-8066-2818c6ed9e4d None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:57.539033 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4646b5-318d-44fc-92ea-7989974415bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:57.539887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4646b5-318d-44fc-92ea-7989974415bc None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:57.540168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4646b5-318d-44fc-92ea-7989974415bc None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:57.540439 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4646b5-318d-44fc-92ea-7989974415bc None admin] PATH_INFO: `/v3/projects/d1d05dc43f2e490e8365d1a69ae9c1bb` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:57.541584 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4646b5-318d-44fc-92ea-7989974415bc None admin] RBAC: Authorizing `identity:get_project(project_id=d1d05dc43f2e490e8365d1a69ae9c1bb)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:57.542991 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4646b5-318d-44fc-92ea-7989974415bc None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:57.544650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 551/1122] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:14:57 2022] GET /identity/v3/projects/d1d05dc43f2e490e8365d1a69ae9c1bb => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:14:57.550733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dd064-4d53-4adb-9f10-f8310f80b26d None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:57.647539 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0dd064-4d53-4adb-9f10-f8310f80b26d None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:14:57.669561 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:57.681480 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678ec0b-8480-4878-b019-40a2fe78bbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:14:57.682352 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678ec0b-8480-4878-b019-40a2fe78bbe9 None admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:57.682634 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678ec0b-8480-4878-b019-40a2fe78bbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:57.682910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678ec0b-8480-4878-b019-40a2fe78bbe9 None admin] PATH_INFO: `/v3/projects/d1d05dc43f2e490e8365d1a69ae9c1bb/users/f79aa7af461242aab34cb23b64a34f44/roles/e6bcb832ed6d4843825263e23d8fb208` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:57.685119 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678ec0b-8480-4878-b019-40a2fe78bbe9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d1d05dc43f2e490e8365d1a69ae9c1bb, user_id=f79aa7af461242aab34cb23b64a34f44, role_id=e6bcb832ed6d4843825263e23d8fb208)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:14:57.686539 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678ec0b-8480-4878-b019-40a2fe78bbe9 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:14:57.698852 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 572/1123] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 00:14:57 2022] PUT /identity/v3/projects/d1d05dc43f2e490e8365d1a69ae9c1bb/users/f79aa7af461242aab34cb23b64a34f44/roles/e6bcb832ed6d4843825263e23d8fb208 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:14:59.772419 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86948cee-bef0-4804-b864-af7d3f57866e None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:59.772971 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86948cee-bef0-4804-b864-af7d3f57866e None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:59.772971 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86948cee-bef0-4804-b864-af7d3f57866e None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:59.774331 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 552/1124] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:14:59.779518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd367a60-0f74-4036-91bb-0941b31bf6ab None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:14:59.779963 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd367a60-0f74-4036-91bb-0941b31bf6ab None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:14:59.780128 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd367a60-0f74-4036-91bb-0941b31bf6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:14:59.797049 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-fd367a60-0f74-4036-91bb-0941b31bf6ab None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:14:59.798263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-fd367a60-0f74-4036-91bb-0941b31bf6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:14:59.862758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 573/1125] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:14:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:14:59.886677 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86948cee-bef0-4804-b864-af7d3f57866e None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:14:59.948148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:14:59.985697 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86948cee-bef0-4804-b864-af7d3f57866e None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:00.018189 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bf73b-5eb6-44e4-a85d-a60d64bc0dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:00.019029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bf73b-5eb6-44e4-a85d-a60d64bc0dfc None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:00.019314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bf73b-5eb6-44e4-a85d-a60d64bc0dfc None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:00.019590 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554bf73b-5eb6-44e4-a85d-a60d64bc0dfc None admin] PATH_INFO: `/v3/roles/e6bcb832ed6d4843825263e23d8fb208` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:00.021071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554bf73b-5eb6-44e4-a85d-a60d64bc0dfc None admin] RBAC: Authorizing `identity:get_role(role_id=e6bcb832ed6d4843825263e23d8fb208)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:00.022493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554bf73b-5eb6-44e4-a85d-a60d64bc0dfc None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:00.023805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 553/1126] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:14:59 2022] GET /identity/v3/roles/e6bcb832ed6d4843825263e23d8fb208 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:00.029493 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd367a60-0f74-4036-91bb-0941b31bf6ab None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:00.124866 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd367a60-0f74-4036-91bb-0941b31bf6ab None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:00.138017 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:00.159620 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e191030-bd49-45d4-836e-e3a2cfad9e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:00.160486 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e191030-bd49-45d4-836e-e3a2cfad9e1d None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:00.160768 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e191030-bd49-45d4-836e-e3a2cfad9e1d None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:00.161041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e191030-bd49-45d4-836e-e3a2cfad9e1d None admin] PATH_INFO: `/v3/users/f79aa7af461242aab34cb23b64a34f44` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:00.162201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e191030-bd49-45d4-836e-e3a2cfad9e1d None admin] RBAC: Authorizing `identity:get_user(user_id=f79aa7af461242aab34cb23b64a34f44)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:00.163642 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e191030-bd49-45d4-836e-e3a2cfad9e1d None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:00.165221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 574/1127] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:15:00 2022] GET /identity/v3/users/f79aa7af461242aab34cb23b64a34f44 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:00.170750 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bf73b-5eb6-44e4-a85d-a60d64bc0dfc None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:00.265910 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554bf73b-5eb6-44e4-a85d-a60d64bc0dfc None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:00.294067 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:00.299115 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a223d18-753e-4e32-81f2-3adbe7a53d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:00.299773 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a223d18-753e-4e32-81f2-3adbe7a53d59 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:00.300055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a223d18-753e-4e32-81f2-3adbe7a53d59 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:00.300328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a223d18-753e-4e32-81f2-3adbe7a53d59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:00.363583 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a223d18-753e-4e32-81f2-3adbe7a53d59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:00.365036 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a223d18-753e-4e32-81f2-3adbe7a53d59 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:00.458872 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 554/1128] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:15:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:15:00.464727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e191030-bd49-45d4-836e-e3a2cfad9e1d None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:00.567139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e191030-bd49-45d4-836e-e3a2cfad9e1d None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:00.599186 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80284da1-74a1-42ad-a017-afbe5203ac51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:00.600065 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80284da1-74a1-42ad-a017-afbe5203ac51 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:00.600350 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80284da1-74a1-42ad-a017-afbe5203ac51 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:00.600625 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80284da1-74a1-42ad-a017-afbe5203ac51 None admin] PATH_INFO: `/v3/projects/d1d05dc43f2e490e8365d1a69ae9c1bb` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:00.601804 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80284da1-74a1-42ad-a017-afbe5203ac51 None admin] RBAC: Authorizing `identity:get_project(project_id=d1d05dc43f2e490e8365d1a69ae9c1bb)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:00.603236 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80284da1-74a1-42ad-a017-afbe5203ac51 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:00.604934 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 575/1129] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:15:00 2022] GET /identity/v3/projects/d1d05dc43f2e490e8365d1a69ae9c1bb => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:00.611507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a223d18-753e-4e32-81f2-3adbe7a53d59 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:00.641139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:00.706643 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a223d18-753e-4e32-81f2-3adbe7a53d59 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:00.739495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441674ca-925f-47d2-98cf-2354ab5e4bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:00.740156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441674ca-925f-47d2-98cf-2354ab5e4bae None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:00.740439 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441674ca-925f-47d2-98cf-2354ab5e4bae None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:00.740712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441674ca-925f-47d2-98cf-2354ab5e4bae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:00.741517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441674ca-925f-47d2-98cf-2354ab5e4bae None admin] RBAC: Adding query filter params (role.id=e6bcb832ed6d4843825263e23d8fb208, scope.project.id=d1d05dc43f2e490e8365d1a69ae9c1bb, user.id=f79aa7af461242aab34cb23b64a34f44) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:00.741825 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441674ca-925f-47d2-98cf-2354ab5e4bae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:00.743235 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441674ca-925f-47d2-98cf-2354ab5e4bae None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:00.748857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 555/1130] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:15:00 2022] GET /identity/v3/role_assignments?user.id=f79aa7af461242aab34cb23b64a34f44&scope.project.id=d1d05dc43f2e490e8365d1a69ae9c1bb&role.id=e6bcb832ed6d4843825263e23d8fb208 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:02.873609 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e2191-f3d4-4831-9d18-b9c4afea003f None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:02.874129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e2191-f3d4-4831-9d18-b9c4afea003f None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:02.874239 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372e2191-f3d4-4831-9d18-b9c4afea003f None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:02.876146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 576/1131] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:15:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:02.881429 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c474b-99d6-4989-8f72-291a615d1ebe None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:02.881879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c474b-99d6-4989-8f72-291a615d1ebe None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:02.881976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99c474b-99d6-4989-8f72-291a615d1ebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:02.898164 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-d99c474b-99d6-4989-8f72-291a615d1ebe None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:02.899328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d99c474b-99d6-4989-8f72-291a615d1ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:02.962619 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 556/1132] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:02.986509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e2191-f3d4-4831-9d18-b9c4afea003f None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:03.035036 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:03.086135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372e2191-f3d4-4831-9d18-b9c4afea003f None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:03.119135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520b4aa-2c71-47c0-a09c-9a7f5e1c30a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:03.119942 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520b4aa-2c71-47c0-a09c-9a7f5e1c30a4 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:03.120227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520b4aa-2c71-47c0-a09c-9a7f5e1c30a4 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:03.120503 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520b4aa-2c71-47c0-a09c-9a7f5e1c30a4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:03.121669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520b4aa-2c71-47c0-a09c-9a7f5e1c30a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:03.123097 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520b4aa-2c71-47c0-a09c-9a7f5e1c30a4 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:03.124707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 577/1133] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:15:03.130608 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c474b-99d6-4989-8f72-291a615d1ebe None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:03.156837 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:03.227266 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99c474b-99d6-4989-8f72-291a615d1ebe None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:03.260524 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a76dfcb-8333-4514-ad85-471edec2ab08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:03.261175 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76dfcb-8333-4514-ad85-471edec2ab08 None admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:03.261457 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76dfcb-8333-4514-ad85-471edec2ab08 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:03.261735 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a76dfcb-8333-4514-ad85-471edec2ab08 None admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:03.262431 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76dfcb-8333-4514-ad85-471edec2ab08 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:03.263887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a76dfcb-8333-4514-ad85-471edec2ab08 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:03.289001 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 557/1134] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 00:15:03 2022] POST /identity/v3/projects => generated 311 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:15:05.387735 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f58b97-97b3-4177-88a6-bbc21a8ecab5 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:05.388264 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f58b97-97b3-4177-88a6-bbc21a8ecab5 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:05.388357 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f58b97-97b3-4177-88a6-bbc21a8ecab5 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:05.389658 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 578/1135] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:05.395441 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16826f6e-71bd-4147-939f-52c13bfe4493 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:05.395888 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16826f6e-71bd-4147-939f-52c13bfe4493 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:05.396032 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16826f6e-71bd-4147-939f-52c13bfe4493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:05.412340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-16826f6e-71bd-4147-939f-52c13bfe4493 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:05.413518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-16826f6e-71bd-4147-939f-52c13bfe4493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:05.477609 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 558/1136] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:15:05.502339 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f58b97-97b3-4177-88a6-bbc21a8ecab5 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:05.603451 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f58b97-97b3-4177-88a6-bbc21a8ecab5 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:05.618960 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:05.636052 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ff18b1-8a2b-451e-80d0-28cae17a83c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:05.636827 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff18b1-8a2b-451e-80d0-28cae17a83c8 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:05.637109 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff18b1-8a2b-451e-80d0-28cae17a83c8 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:05.637383 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ff18b1-8a2b-451e-80d0-28cae17a83c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:05.638573 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff18b1-8a2b-451e-80d0-28cae17a83c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:05.639990 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ff18b1-8a2b-451e-80d0-28cae17a83c8 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:05.642094 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 579/1137] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:15:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:05.647877 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16826f6e-71bd-4147-939f-52c13bfe4493 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:05.658366 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:05.743229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16826f6e-71bd-4147-939f-52c13bfe4493 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:05.775915 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd5c3a4-2107-4571-8480-4ac799ef6b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:05.776571 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5c3a4-2107-4571-8480-4ac799ef6b51 None admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:05.776854 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5c3a4-2107-4571-8480-4ac799ef6b51 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:05.777131 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd5c3a4-2107-4571-8480-4ac799ef6b51 None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:05.777832 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5c3a4-2107-4571-8480-4ac799ef6b51 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:05.779259 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd5c3a4-2107-4571-8480-4ac799ef6b51 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:05.799247 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 559/1138] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 00:15:05 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:15:07.915503 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6e593-0a8b-441b-8df4-825b81945abe None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:07.916044 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6e593-0a8b-441b-8df4-825b81945abe None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:07.916138 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6e593-0a8b-441b-8df4-825b81945abe None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:07.917442 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 580/1139] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:07.923150 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69975e42-5f9b-421b-a05c-1eb1c6ff20c3 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:07.923542 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69975e42-5f9b-421b-a05c-1eb1c6ff20c3 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:07.923741 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69975e42-5f9b-421b-a05c-1eb1c6ff20c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:07.940460 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-69975e42-5f9b-421b-a05c-1eb1c6ff20c3 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:07.941650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-69975e42-5f9b-421b-a05c-1eb1c6ff20c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:07.997055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:08.006771 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 560/1140] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:08.030254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6e593-0a8b-441b-8df4-825b81945abe None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:08.127587 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6e593-0a8b-441b-8df4-825b81945abe None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:08.160743 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850f1e0-719a-4d60-a281-d30ddfce4361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:08.161519 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850f1e0-719a-4d60-a281-d30ddfce4361 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:08.161803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850f1e0-719a-4d60-a281-d30ddfce4361 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:08.162081 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c850f1e0-719a-4d60-a281-d30ddfce4361 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:08.171947 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c850f1e0-719a-4d60-a281-d30ddfce4361 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:08.179456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-c850f1e0-719a-4d60-a281-d30ddfce4361 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:08.179456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:08.179456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:08.179456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:08.179456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:08.179456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:08.179456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:08.179456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:08.179456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:08.179456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:08.179456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:08.179456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:08.179456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:08.179456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:08.179456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:08.179456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:08.180656 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:08.180656 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:08.180656 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:08.180656 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:08.180656 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:08.180656 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:08.180656 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:08.180656 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:08.180656 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:08.180656 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:08.180656 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:08.180656 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:08.180656 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:08.180656 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:08.180656 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:08.180656 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:08.181801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:08.181801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:08.181801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:08.181801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:08.181801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:08.181801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:08.181801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:08.181801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:08.181801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:08.181801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:08.181801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:08.181801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:15:08.181801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 581/1141] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:15:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:08.186431 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69975e42-5f9b-421b-a05c-1eb1c6ff20c3 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:08.282863 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69975e42-5f9b-421b-a05c-1eb1c6ff20c3 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:08.316546 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c62cd-686a-4be2-be35-d72f2dc1a3fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:08.317201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c62cd-686a-4be2-be35-d72f2dc1a3fd None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:08.317482 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c62cd-686a-4be2-be35-d72f2dc1a3fd None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:08.317756 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c62cd-686a-4be2-be35-d72f2dc1a3fd None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:08.318493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c62cd-686a-4be2-be35-d72f2dc1a3fd None admin] RBAC: Adding query filter params (name=admin) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:08.318803 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c62cd-686a-4be2-be35-d72f2dc1a3fd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:08.320203 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c62cd-686a-4be2-be35-d72f2dc1a3fd None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:08.328588 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 561/1142] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:15:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:08.334159 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850f1e0-719a-4d60-a281-d30ddfce4361 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:08.378272 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:08.431400 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c850f1e0-719a-4d60-a281-d30ddfce4361 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:08.462714 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f2c51-0b54-4199-85c9-325b81167cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:08.463564 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f2c51-0b54-4199-85c9-325b81167cbd None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:08.463874 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f2c51-0b54-4199-85c9-325b81167cbd None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:08.464148 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7f2c51-0b54-4199-85c9-325b81167cbd None admin] PATH_INFO: `/v3/users/fdcbcb7b0bf4496f94e79c7fdaa9e685` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:08.477175 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f2c51-0b54-4199-85c9-325b81167cbd None admin] RBAC: Authorizing `identity:get_user(user_id=fdcbcb7b0bf4496f94e79c7fdaa9e685)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:08.478606 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7f2c51-0b54-4199-85c9-325b81167cbd None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:08.485671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 582/1143] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:15:08 2022] GET /identity/v3/users/fdcbcb7b0bf4496f94e79c7fdaa9e685 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:08.486568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c62cd-686a-4be2-be35-d72f2dc1a3fd None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:08.540638 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:08.584494 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c62cd-686a-4be2-be35-d72f2dc1a3fd None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:08.617016 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8faf66-962e-4cf4-8745-ea1de7e6aa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:08.617660 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8faf66-962e-4cf4-8745-ea1de7e6aa0d None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:08.617944 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8faf66-962e-4cf4-8745-ea1de7e6aa0d None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:08.618228 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8faf66-962e-4cf4-8745-ea1de7e6aa0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:08.683269 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8faf66-962e-4cf4-8745-ea1de7e6aa0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:08.684689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8faf66-962e-4cf4-8745-ea1de7e6aa0d None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:08.736313 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:08.779535 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 562/1144] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:15:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:15:08.786083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f2c51-0b54-4199-85c9-325b81167cbd None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:08.882749 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7f2c51-0b54-4199-85c9-325b81167cbd None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:08.884274 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:08.915986 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd23052-8930-4671-8227-3f75e667378f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:08.916840 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd23052-8930-4671-8227-3f75e667378f None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:08.917121 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd23052-8930-4671-8227-3f75e667378f None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:08.917392 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd23052-8930-4671-8227-3f75e667378f None admin] PATH_INFO: `/v3/projects/f5ea96ad616b4ab5927d74210325ecbe` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:08.918563 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd23052-8930-4671-8227-3f75e667378f None admin] RBAC: Authorizing `identity:get_project(project_id=f5ea96ad616b4ab5927d74210325ecbe)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:08.920037 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd23052-8930-4671-8227-3f75e667378f None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:08.922280 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 583/1145] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:15:08 2022] GET /identity/v3/projects/f5ea96ad616b4ab5927d74210325ecbe => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:08.928266 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8faf66-962e-4cf4-8745-ea1de7e6aa0d None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:09.023447 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8faf66-962e-4cf4-8745-ea1de7e6aa0d None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:09.056697 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f0498-10f9-4a6b-8c59-115f4a80b6be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:09.057330 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f0498-10f9-4a6b-8c59-115f4a80b6be None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:09.057621 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f0498-10f9-4a6b-8c59-115f4a80b6be None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:09.057898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f0498-10f9-4a6b-8c59-115f4a80b6be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:09.058713 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f0498-10f9-4a6b-8c59-115f4a80b6be None admin] RBAC: Adding query filter params (role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab, scope.project.id=f5ea96ad616b4ab5927d74210325ecbe, user.id=fdcbcb7b0bf4496f94e79c7fdaa9e685) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:09.059048 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f0498-10f9-4a6b-8c59-115f4a80b6be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:09.060495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f0498-10f9-4a6b-8c59-115f4a80b6be None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:09.065854 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 563/1146] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:15:08 2022] GET /identity/v3/role_assignments?user.id=fdcbcb7b0bf4496f94e79c7fdaa9e685&scope.project.id=f5ea96ad616b4ab5927d74210325ecbe&role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:11.118270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48090f6-b4f8-45ca-8dbe-af0146154196 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:11.118783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48090f6-b4f8-45ca-8dbe-af0146154196 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:11.118783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48090f6-b4f8-45ca-8dbe-af0146154196 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:11.120150 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 584/1147] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:11.126045 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a2908-51e7-4521-bda0-dc941144726f None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:11.126462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a2908-51e7-4521-bda0-dc941144726f None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:11.126606 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472a2908-51e7-4521-bda0-dc941144726f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:11.143045 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-472a2908-51e7-4521-bda0-dc941144726f None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:11.144240 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-472a2908-51e7-4521-bda0-dc941144726f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:11.157566 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:11.209286 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 564/1148] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:15:11.232052 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48090f6-b4f8-45ca-8dbe-af0146154196 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:11.330006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48090f6-b4f8-45ca-8dbe-af0146154196 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:11.363204 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2d905-e5c6-4be2-bdbc-b54950bf88ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:11.364004 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2d905-e5c6-4be2-bdbc-b54950bf88ae None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:11.364291 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2d905-e5c6-4be2-bdbc-b54950bf88ae None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:11.364568 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2d905-e5c6-4be2-bdbc-b54950bf88ae None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:11.374434 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c2d905-e5c6-4be2-bdbc-b54950bf88ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:11.382218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-d3c2d905-e5c6-4be2-bdbc-b54950bf88ae None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:11.382218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:11.382218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:11.382218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:11.382218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:11.382218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:11.382218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:11.382218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:11.382218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:11.382218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:11.382218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:11.382218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:11.382218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:11.382218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:11.382218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:11.382218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:11.383301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:11.383301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:11.383301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:11.383301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:11.383301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:11.383301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:11.383301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:11.383301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:11.383301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:11.383301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:11.383301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:11.383301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:11.383301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:11.383301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:11.383301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:11.383301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:11.384374 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:11.384374 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:11.384374 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:11.384374 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:11.384374 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:11.384374 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:11.384374 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:11.384374 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:11.384374 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:11.384374 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:11.384374 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:11.384374 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:15:11.387750 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 585/1149] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:15:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:11.389323 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a2908-51e7-4521-bda0-dc941144726f None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:11.483068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472a2908-51e7-4521-bda0-dc941144726f None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:11.515814 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656fb32-ff7e-46d3-a5eb-a71a27d9bf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:11.516467 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656fb32-ff7e-46d3-a5eb-a71a27d9bf3e None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:11.516749 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656fb32-ff7e-46d3-a5eb-a71a27d9bf3e None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:11.517024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9656fb32-ff7e-46d3-a5eb-a71a27d9bf3e None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:11.517752 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656fb32-ff7e-46d3-a5eb-a71a27d9bf3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:11.518058 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656fb32-ff7e-46d3-a5eb-a71a27d9bf3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:11.519432 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9656fb32-ff7e-46d3-a5eb-a71a27d9bf3e None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:11.527081 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 565/1150] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:15:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:11.533070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2d905-e5c6-4be2-bdbc-b54950bf88ae None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:11.563661 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:11.631761 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2d905-e5c6-4be2-bdbc-b54950bf88ae None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:11.664189 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb53ea-b95f-4b6b-9915-1a183263769a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:11.665037 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb53ea-b95f-4b6b-9915-1a183263769a None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:11.665317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb53ea-b95f-4b6b-9915-1a183263769a None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:11.665591 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdb53ea-b95f-4b6b-9915-1a183263769a None admin] PATH_INFO: `/v3/users/fdcbcb7b0bf4496f94e79c7fdaa9e685` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:11.666753 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb53ea-b95f-4b6b-9915-1a183263769a None admin] RBAC: Authorizing `identity:get_user(user_id=fdcbcb7b0bf4496f94e79c7fdaa9e685)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:11.668205 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdb53ea-b95f-4b6b-9915-1a183263769a None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:11.669786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 586/1151] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:15:11 2022] GET /identity/v3/users/fdcbcb7b0bf4496f94e79c7fdaa9e685 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:11.675379 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656fb32-ff7e-46d3-a5eb-a71a27d9bf3e None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:11.690641 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:11.771596 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9656fb32-ff7e-46d3-a5eb-a71a27d9bf3e None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:11.803693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a836f5c-dbfb-4410-8c3b-4fb538eb8aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:11.804545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a836f5c-dbfb-4410-8c3b-4fb538eb8aae None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:11.804824 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a836f5c-dbfb-4410-8c3b-4fb538eb8aae None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:11.805095 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a836f5c-dbfb-4410-8c3b-4fb538eb8aae None admin] PATH_INFO: `/v3/projects/f5ea96ad616b4ab5927d74210325ecbe` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:11.806237 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a836f5c-dbfb-4410-8c3b-4fb538eb8aae None admin] RBAC: Authorizing `identity:get_project(project_id=f5ea96ad616b4ab5927d74210325ecbe)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:11.807686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a836f5c-dbfb-4410-8c3b-4fb538eb8aae None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:11.809353 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 566/1152] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:15:11 2022] GET /identity/v3/projects/f5ea96ad616b4ab5927d74210325ecbe => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:11.815157 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb53ea-b95f-4b6b-9915-1a183263769a None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:11.909340 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:11.913133 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdb53ea-b95f-4b6b-9915-1a183263769a None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:11.945812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afab234f-af41-497c-8432-1fc398ae3252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:11.946692 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab234f-af41-497c-8432-1fc398ae3252 None admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:11.946982 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab234f-af41-497c-8432-1fc398ae3252 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:11.947261 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afab234f-af41-497c-8432-1fc398ae3252 None admin] PATH_INFO: `/v3/projects/f5ea96ad616b4ab5927d74210325ecbe/users/fdcbcb7b0bf4496f94e79c7fdaa9e685/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:11.949242 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab234f-af41-497c-8432-1fc398ae3252 None admin] RBAC: Authorizing `identity:create_grant(project_id=f5ea96ad616b4ab5927d74210325ecbe, user_id=fdcbcb7b0bf4496f94e79c7fdaa9e685, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:11.950679 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afab234f-af41-497c-8432-1fc398ae3252 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:11.963476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 587/1153] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 00:15:11 2022] PUT /identity/v3/projects/f5ea96ad616b4ab5927d74210325ecbe/users/fdcbcb7b0bf4496f94e79c7fdaa9e685/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:15:14.035345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3924c16-4d12-4ebd-ad15-a321206c2ef0 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:14.035918 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3924c16-4d12-4ebd-ad15-a321206c2ef0 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:14.036014 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3924c16-4d12-4ebd-ad15-a321206c2ef0 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:14.037312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 567/1154] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:14.042319 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304a9e6-282e-40ec-a4da-c1667efa4dff None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:14.042732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304a9e6-282e-40ec-a4da-c1667efa4dff None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:14.042909 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b304a9e6-282e-40ec-a4da-c1667efa4dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:14.059851 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-b304a9e6-282e-40ec-a4da-c1667efa4dff None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:14.061002 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-b304a9e6-282e-40ec-a4da-c1667efa4dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:14.125672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 588/1155] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:14.148563 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3924c16-4d12-4ebd-ad15-a321206c2ef0 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:14.228186 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:14.247494 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3924c16-4d12-4ebd-ad15-a321206c2ef0 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:14.280593 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ea81b-c194-4a00-8021-23144824f6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:14.281366 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ea81b-c194-4a00-8021-23144824f6fc None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:14.281650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ea81b-c194-4a00-8021-23144824f6fc None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:14.281926 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4ea81b-c194-4a00-8021-23144824f6fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:14.291598 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4ea81b-c194-4a00-8021-23144824f6fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:14.299261 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-4a4ea81b-c194-4a00-8021-23144824f6fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:14.299261 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:14.299261 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:14.299261 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:14.299261 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:14.299261 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:14.299261 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:14.299261 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:14.299261 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:14.299261 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:14.299261 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:14.299261 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:14.299261 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:14.299261 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:14.299261 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:14.299261 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:14.300381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:14.300381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:14.300381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:14.300381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:14.300381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:14.300381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:14.300381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:14.300381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:14.300381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:14.300381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:14.300381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:14.300381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:14.300381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:14.300381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:14.300381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:14.300381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:14.301416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:14.301416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:14.301416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:14.301416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:14.301416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:14.301416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:14.301416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:14.301416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:14.301416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:14.301416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:14.301416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:14.301416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:15:14.301416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 568/1156] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:15:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:14.306227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304a9e6-282e-40ec-a4da-c1667efa4dff None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:14.390359 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:14.403099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b304a9e6-282e-40ec-a4da-c1667efa4dff None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:14.434863 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd255f8-24cd-4808-a02b-6cc73464b6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:14.435512 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd255f8-24cd-4808-a02b-6cc73464b6c0 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:14.435821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd255f8-24cd-4808-a02b-6cc73464b6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:14.436096 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd255f8-24cd-4808-a02b-6cc73464b6c0 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:14.437327 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd255f8-24cd-4808-a02b-6cc73464b6c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:14.437631 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd255f8-24cd-4808-a02b-6cc73464b6c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:14.438984 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd255f8-24cd-4808-a02b-6cc73464b6c0 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:14.446688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 589/1157] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:15:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:14.452814 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ea81b-c194-4a00-8021-23144824f6fc None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:14.551228 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4ea81b-c194-4a00-8021-23144824f6fc None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:14.583976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29dea9-5da4-4979-a2ea-395687e43910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:14.584835 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29dea9-5da4-4979-a2ea-395687e43910 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:14.585117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29dea9-5da4-4979-a2ea-395687e43910 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:14.585395 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29dea9-5da4-4979-a2ea-395687e43910 None admin] PATH_INFO: `/v3/users/fdcbcb7b0bf4496f94e79c7fdaa9e685` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:14.586563 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b29dea9-5da4-4979-a2ea-395687e43910 None admin] RBAC: Authorizing `identity:get_user(user_id=fdcbcb7b0bf4496f94e79c7fdaa9e685)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:14.588049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b29dea9-5da4-4979-a2ea-395687e43910 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:14.589650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 569/1158] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:15:14 2022] GET /identity/v3/users/fdcbcb7b0bf4496f94e79c7fdaa9e685 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:14.595297 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd255f8-24cd-4808-a02b-6cc73464b6c0 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:14.693029 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd255f8-24cd-4808-a02b-6cc73464b6c0 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:14.724434 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3ee7e-f9b4-4ed2-8634-c873dddbdca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:14.725066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3ee7e-f9b4-4ed2-8634-c873dddbdca9 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:14.725347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3ee7e-f9b4-4ed2-8634-c873dddbdca9 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:14.725619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d3ee7e-f9b4-4ed2-8634-c873dddbdca9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:14.743446 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:14.791068 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3ee7e-f9b4-4ed2-8634-c873dddbdca9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:14.792540 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d3ee7e-f9b4-4ed2-8634-c873dddbdca9 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:14.886802 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 590/1159] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:15:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:15:14.892619 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29dea9-5da4-4979-a2ea-395687e43910 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:14.903573 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:14.989474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29dea9-5da4-4979-a2ea-395687e43910 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:15.021481 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b18a2-1674-4770-847b-ca8c26c95a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:15.022326 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b18a2-1674-4770-847b-ca8c26c95a66 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:15.022608 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b18a2-1674-4770-847b-ca8c26c95a66 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:15.022881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b18a2-1674-4770-847b-ca8c26c95a66 None admin] PATH_INFO: `/v3/projects/f5ea96ad616b4ab5927d74210325ecbe` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:15.024184 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b18a2-1674-4770-847b-ca8c26c95a66 None admin] RBAC: Authorizing `identity:get_project(project_id=f5ea96ad616b4ab5927d74210325ecbe)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:15.025619 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b18a2-1674-4770-847b-ca8c26c95a66 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:15.027281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 570/1160] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:15:14 2022] GET /identity/v3/projects/f5ea96ad616b4ab5927d74210325ecbe => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:15.033840 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3ee7e-f9b4-4ed2-8634-c873dddbdca9 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:15.082711 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:15.131238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d3ee7e-f9b4-4ed2-8634-c873dddbdca9 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:15.163938 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f6d74d-c163-437b-be4d-c91ee906249a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:15.164584 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6d74d-c163-437b-be4d-c91ee906249a None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:15.164871 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6d74d-c163-437b-be4d-c91ee906249a None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:15.165151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f6d74d-c163-437b-be4d-c91ee906249a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:15.165981 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6d74d-c163-437b-be4d-c91ee906249a None admin] RBAC: Adding query filter params (role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab, scope.project.id=f5ea96ad616b4ab5927d74210325ecbe, user.id=fdcbcb7b0bf4496f94e79c7fdaa9e685) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:15.166299 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6d74d-c163-437b-be4d-c91ee906249a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:15.167748 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f6d74d-c163-437b-be4d-c91ee906249a None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:15.174134 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 591/1161] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:15:15 2022] GET /identity/v3/role_assignments?user.id=fdcbcb7b0bf4496f94e79c7fdaa9e685&scope.project.id=f5ea96ad616b4ab5927d74210325ecbe&role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:17.271951 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdfe42-9f88-415d-ab6e-5776e7e1f563 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:17.272516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdfe42-9f88-415d-ab6e-5776e7e1f563 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:17.272516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cdfe42-9f88-415d-ab6e-5776e7e1f563 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:17.273849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 571/1162] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:17.278970 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6da203-7618-44d6-9fa7-a8c04c9ba9dd None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:17.279330 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6da203-7618-44d6-9fa7-a8c04c9ba9dd None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:17.279537 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6da203-7618-44d6-9fa7-a8c04c9ba9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:17.295759 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-ed6da203-7618-44d6-9fa7-a8c04c9ba9dd None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:17.296937 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-ed6da203-7618-44d6-9fa7-a8c04c9ba9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:17.361143 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 592/1163] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:17.383741 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdfe42-9f88-415d-ab6e-5776e7e1f563 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:17.458550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:17.481511 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cdfe42-9f88-415d-ab6e-5776e7e1f563 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:17.514006 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d843fc-8054-492d-9f82-c43aaf060860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:17.515173 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d843fc-8054-492d-9f82-c43aaf060860 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:17.515453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d843fc-8054-492d-9f82-c43aaf060860 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:17.515758 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d843fc-8054-492d-9f82-c43aaf060860 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:17.579787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d843fc-8054-492d-9f82-c43aaf060860 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:17.581170 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d843fc-8054-492d-9f82-c43aaf060860 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:17.652042 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:17.675304 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 572/1164] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:15:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:15:17.681102 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6da203-7618-44d6-9fa7-a8c04c9ba9dd None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:17.724526 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:17.776968 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6da203-7618-44d6-9fa7-a8c04c9ba9dd None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:17.809855 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53f101c-4ed2-4fdb-ba43-2bc905e8d3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:17.810651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f101c-4ed2-4fdb-ba43-2bc905e8d3ef None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:17.810937 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f101c-4ed2-4fdb-ba43-2bc905e8d3ef None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:17.811241 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53f101c-4ed2-4fdb-ba43-2bc905e8d3ef None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:17.818324 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f101c-4ed2-4fdb-ba43-2bc905e8d3ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:17.819792 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a53f101c-4ed2-4fdb-ba43-2bc905e8d3ef None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:17.833809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-a53f101c-4ed2-4fdb-ba43-2bc905e8d3ef None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 00:15:17.833809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:17.833809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 16 00:15:17.833809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 16 00:15:17.833809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:15:17.833809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:15:17.833809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:15:17.833809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:15:17.833809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 16 00:15:17.833809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:15:17.833809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:15:17.833809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:15:17.833809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:17.833809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:17.833809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:17.833809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:17.833809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:17.834998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:17.834998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:17.834998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:17.834998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:17.834998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:17.834998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:17.834998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:15:17.834998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:15:17.834998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:15:17.834998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:15:17.834998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:17.834998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:17.834998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:17.834998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:17.834998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:17.834998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:17.836071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:17.836071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:17.836071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:17.836071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:17.836071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:17.836071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:17.836071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:17.836071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:17.836071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:17.836071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:17.836071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 16 00:15:17.836071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:15:17.836071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 16 00:15:17.836071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:15:17.836071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 593/1165] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 16 00:15:17 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:17.840801 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d843fc-8054-492d-9f82-c43aaf060860 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:17.934713 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d843fc-8054-492d-9f82-c43aaf060860 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:17.967297 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c30c72-123f-4752-af2f-b0d56c7fec34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:17.968477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c30c72-123f-4752-af2f-b0d56c7fec34 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:17.968759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c30c72-123f-4752-af2f-b0d56c7fec34 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:17.969030 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c30c72-123f-4752-af2f-b0d56c7fec34 None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:17.969737 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c30c72-123f-4752-af2f-b0d56c7fec34 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:17.970040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c30c72-123f-4752-af2f-b0d56c7fec34 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:17.971396 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c30c72-123f-4752-af2f-b0d56c7fec34 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:17.978287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 573/1166] 10.222.0.44 () {56 vars in 1115 bytes} [Thu Jun 16 00:15:17 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:20.056583 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cbca0-f784-410f-8f04-1f0035ac97d6 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:20.057092 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cbca0-f784-410f-8f04-1f0035ac97d6 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:20.057092 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561cbca0-f784-410f-8f04-1f0035ac97d6 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:20.058457 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 594/1167] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:20.064035 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7315ff-c7ee-4604-8607-406bb387e223 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:20.064455 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7315ff-c7ee-4604-8607-406bb387e223 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:20.064590 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7315ff-c7ee-4604-8607-406bb387e223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:20.080789 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-df7315ff-c7ee-4604-8607-406bb387e223 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:20.081956 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-df7315ff-c7ee-4604-8607-406bb387e223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:20.114393 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:20.146868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 574/1168] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:20.169542 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cbca0-f784-410f-8f04-1f0035ac97d6 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:20.269413 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561cbca0-f784-410f-8f04-1f0035ac97d6 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:20.271702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:20.303120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f52becf-6b58-4dd6-b28a-802274233bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:20.303799 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52becf-6b58-4dd6-b28a-802274233bec None admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:20.304084 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52becf-6b58-4dd6-b28a-802274233bec None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:20.304360 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f52becf-6b58-4dd6-b28a-802274233bec None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:20.305116 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52becf-6b58-4dd6-b28a-802274233bec None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:20.306482 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f52becf-6b58-4dd6-b28a-802274233bec None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:20.320796 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 595/1169] 10.222.0.44 () {60 vars in 1138 bytes} [Thu Jun 16 00:15:20 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:15:22.438201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2171a-388e-43ff-9352-4d5db71ea7fa None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:22.438727 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2171a-388e-43ff-9352-4d5db71ea7fa None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:22.438727 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f2171a-388e-43ff-9352-4d5db71ea7fa None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:22.440151 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 575/1170] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:22.445271 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10782c6e-5963-4c19-8920-7835646cf88d None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:22.445674 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10782c6e-5963-4c19-8920-7835646cf88d None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:22.445827 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10782c6e-5963-4c19-8920-7835646cf88d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:22.462657 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-10782c6e-5963-4c19-8920-7835646cf88d None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:22.463858 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-10782c6e-5963-4c19-8920-7835646cf88d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:22.528781 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 596/1171] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:22.553804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2171a-388e-43ff-9352-4d5db71ea7fa None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:22.652341 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f2171a-388e-43ff-9352-4d5db71ea7fa None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:22.685247 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5148e7-0756-482c-8770-921ed7904365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:22.686625 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5148e7-0756-482c-8770-921ed7904365 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:22.686906 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5148e7-0756-482c-8770-921ed7904365 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:22.687180 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5148e7-0756-482c-8770-921ed7904365 None admin] PATH_INFO: `/v3/domains/56e864ef4f3c47e9a9e4281c5c4faaf9` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:22.697233 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5148e7-0756-482c-8770-921ed7904365 None admin] RBAC: Authorizing `identity:get_domain(domain_id=56e864ef4f3c47e9a9e4281c5c4faaf9)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:22.698623 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5148e7-0756-482c-8770-921ed7904365 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:22.700256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 576/1172] 10.222.0.44 () {56 vars in 1183 bytes} [Thu Jun 16 00:15:22 2022] GET /identity/v3/domains/56e864ef4f3c47e9a9e4281c5c4faaf9 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:22.706492 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10782c6e-5963-4c19-8920-7835646cf88d None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:22.794983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:22.803244 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10782c6e-5963-4c19-8920-7835646cf88d None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:22.836708 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47763f9-447b-41d0-a9d4-bb2757b89dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:22.837358 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47763f9-447b-41d0-a9d4-bb2757b89dde None admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:22.837639 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47763f9-447b-41d0-a9d4-bb2757b89dde None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:22.837913 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47763f9-447b-41d0-a9d4-bb2757b89dde None admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:22.838629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47763f9-447b-41d0-a9d4-bb2757b89dde None admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:22.840224 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47763f9-447b-41d0-a9d4-bb2757b89dde None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:22.864128 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 597/1173] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 00:15:22 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:15:24.975878 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25593227-04dc-4068-88e8-c9a098514abc None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:24.976442 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25593227-04dc-4068-88e8-c9a098514abc None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:24.976442 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25593227-04dc-4068-88e8-c9a098514abc None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:24.977797 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 577/1174] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:24.983036 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf3e7f-85de-4ed2-8e79-b4a728e4a0b1 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:24.983420 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf3e7f-85de-4ed2-8e79-b4a728e4a0b1 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:24.983598 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf3e7f-85de-4ed2-8e79-b4a728e4a0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:25.000296 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-deaf3e7f-85de-4ed2-8e79-b4a728e4a0b1 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:25.001456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-deaf3e7f-85de-4ed2-8e79-b4a728e4a0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:25.065821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 598/1175] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:25.089924 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25593227-04dc-4068-88e8-c9a098514abc None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:25.120066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:25.189377 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25593227-04dc-4068-88e8-c9a098514abc None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:25.222434 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952880e9-bb01-4dce-a0ee-062593780e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:25.223277 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952880e9-bb01-4dce-a0ee-062593780e0a None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:25.223560 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952880e9-bb01-4dce-a0ee-062593780e0a None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:25.223857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952880e9-bb01-4dce-a0ee-062593780e0a None admin] PATH_INFO: `/v3/domains/56e864ef4f3c47e9a9e4281c5c4faaf9` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:25.225016 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952880e9-bb01-4dce-a0ee-062593780e0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=56e864ef4f3c47e9a9e4281c5c4faaf9)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:25.226443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952880e9-bb01-4dce-a0ee-062593780e0a None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:25.228061 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 578/1176] 10.222.0.44 () {56 vars in 1183 bytes} [Thu Jun 16 00:15:25 2022] GET /identity/v3/domains/56e864ef4f3c47e9a9e4281c5c4faaf9 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:25.233716 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf3e7f-85de-4ed2-8e79-b4a728e4a0b1 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:25.307057 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:25.330673 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf3e7f-85de-4ed2-8e79-b4a728e4a0b1 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:25.363092 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468bdc7c-4825-4208-b13f-41afd2dcd72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:25.363766 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bdc7c-4825-4208-b13f-41afd2dcd72a None admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:25.364049 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bdc7c-4825-4208-b13f-41afd2dcd72a None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:25.364323 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468bdc7c-4825-4208-b13f-41afd2dcd72a None admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:25.365019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bdc7c-4825-4208-b13f-41afd2dcd72a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:25.366433 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468bdc7c-4825-4208-b13f-41afd2dcd72a None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:25.385806 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 599/1177] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 00:15:25 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:15:27.528996 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a277d17-0cfe-4f49-b808-70205660d728 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:27.530096 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a277d17-0cfe-4f49-b808-70205660d728 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:27.530096 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a277d17-0cfe-4f49-b808-70205660d728 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:27.531463 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 579/1178] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:15:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:27.536517 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c3ffe-1f4b-4b6b-9baf-97dfb1c1564e None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:27.536894 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c3ffe-1f4b-4b6b-9baf-97dfb1c1564e None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:27.537075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76c3ffe-1f4b-4b6b-9baf-97dfb1c1564e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:27.553702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-d76c3ffe-1f4b-4b6b-9baf-97dfb1c1564e None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:27.554869 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-d76c3ffe-1f4b-4b6b-9baf-97dfb1c1564e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:27.618446 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 600/1179] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:15:27.642146 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a277d17-0cfe-4f49-b808-70205660d728 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:27.736181 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:27.741060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a277d17-0cfe-4f49-b808-70205660d728 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:27.774208 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3ef20-b793-4ddd-90d3-9e3964a670e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:27.774983 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3ef20-b793-4ddd-90d3-9e3964a670e2 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:27.775264 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3ef20-b793-4ddd-90d3-9e3964a670e2 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:27.775537 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f3ef20-b793-4ddd-90d3-9e3964a670e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:27.785523 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f3ef20-b793-4ddd-90d3-9e3964a670e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:27.793099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-83f3ef20-b793-4ddd-90d3-9e3964a670e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:27.793099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:27.793099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:27.793099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:27.793099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:27.793099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:27.793099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:27.793099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:27.793099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:27.793099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:27.793099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:27.793099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:27.793099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:27.793099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:27.793099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:27.793099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:27.794276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:27.794276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:27.794276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:27.794276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:27.794276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:27.794276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:27.794276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:27.794276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:27.794276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:27.794276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:27.794276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:27.794276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:27.794276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:27.794276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:27.794276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:27.794276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:27.795408 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:27.795408 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:27.795408 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:27.795408 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:27.795408 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:27.795408 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:27.795408 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:27.795408 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:27.795408 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:27.795408 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:27.795408 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:27.795408 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:15:27.795408 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 580/1180] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:15:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:27.800456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c3ffe-1f4b-4b6b-9baf-97dfb1c1564e None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:27.859287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:27.898085 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76c3ffe-1f4b-4b6b-9baf-97dfb1c1564e None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:27.930270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dab87e-57ec-4209-b80d-52e34107ec7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:27.930927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dab87e-57ec-4209-b80d-52e34107ec7c None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:27.931211 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dab87e-57ec-4209-b80d-52e34107ec7c None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:27.931488 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92dab87e-57ec-4209-b80d-52e34107ec7c None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:27.932256 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dab87e-57ec-4209-b80d-52e34107ec7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:27.932566 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dab87e-57ec-4209-b80d-52e34107ec7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:27.933927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92dab87e-57ec-4209-b80d-52e34107ec7c None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:27.942675 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 601/1181] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:15:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:27.948484 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3ef20-b793-4ddd-90d3-9e3964a670e2 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:28.044306 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f3ef20-b793-4ddd-90d3-9e3964a670e2 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:28.076779 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d3a06-4a55-4667-abe1-4051bc6dd3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:28.077627 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d3a06-4a55-4667-abe1-4051bc6dd3a3 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:28.077905 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d3a06-4a55-4667-abe1-4051bc6dd3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:28.078176 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901d3a06-4a55-4667-abe1-4051bc6dd3a3 None admin] PATH_INFO: `/v3/users/b4e080bb8ad64685b0bac68195f7d5b9` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:28.090701 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d3a06-4a55-4667-abe1-4051bc6dd3a3 None admin] RBAC: Authorizing `identity:get_user(user_id=b4e080bb8ad64685b0bac68195f7d5b9)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:28.092227 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901d3a06-4a55-4667-abe1-4051bc6dd3a3 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:28.093837 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 581/1182] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:15:27 2022] GET /identity/v3/users/b4e080bb8ad64685b0bac68195f7d5b9 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:28.099349 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dab87e-57ec-4209-b80d-52e34107ec7c None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:28.196142 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92dab87e-57ec-4209-b80d-52e34107ec7c None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:28.218073 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:28.228662 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b8f35-b5d6-4835-a95e-9b156898c016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:28.229303 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b8f35-b5d6-4835-a95e-9b156898c016 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:28.229590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b8f35-b5d6-4835-a95e-9b156898c016 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:28.229867 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296b8f35-b5d6-4835-a95e-9b156898c016 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:28.295174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b8f35-b5d6-4835-a95e-9b156898c016 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:28.296606 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296b8f35-b5d6-4835-a95e-9b156898c016 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:28.391510 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 602/1183] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:15:28 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:15:28.397318 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d3a06-4a55-4667-abe1-4051bc6dd3a3 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:28.414788 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:28.493693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901d3a06-4a55-4667-abe1-4051bc6dd3a3 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:28.526089 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006252c-fcae-496a-a90c-00d9eae91713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:28.526929 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006252c-fcae-496a-a90c-00d9eae91713 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:28.527213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006252c-fcae-496a-a90c-00d9eae91713 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:28.527486 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006252c-fcae-496a-a90c-00d9eae91713 None admin] PATH_INFO: `/v3/projects/e7be3d39a68a47709fdf27c4eaf8ae26` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:28.528680 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006252c-fcae-496a-a90c-00d9eae91713 None admin] RBAC: Authorizing `identity:get_project(project_id=e7be3d39a68a47709fdf27c4eaf8ae26)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:28.530608 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006252c-fcae-496a-a90c-00d9eae91713 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:28.532303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 582/1184] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:15:28 2022] GET /identity/v3/projects/e7be3d39a68a47709fdf27c4eaf8ae26 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:28.538129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b8f35-b5d6-4835-a95e-9b156898c016 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:28.562124 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:28.634653 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296b8f35-b5d6-4835-a95e-9b156898c016 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:28.667632 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ab0d9e-6d80-4f12-9d4a-54fa5269e62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:28.668296 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab0d9e-6d80-4f12-9d4a-54fa5269e62d None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:28.668583 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab0d9e-6d80-4f12-9d4a-54fa5269e62d None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:28.668863 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ab0d9e-6d80-4f12-9d4a-54fa5269e62d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:28.670603 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab0d9e-6d80-4f12-9d4a-54fa5269e62d None admin] RBAC: Adding query filter params (role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab, scope.project.id=e7be3d39a68a47709fdf27c4eaf8ae26, user.id=b4e080bb8ad64685b0bac68195f7d5b9) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:28.670917 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab0d9e-6d80-4f12-9d4a-54fa5269e62d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:28.672368 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ab0d9e-6d80-4f12-9d4a-54fa5269e62d None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:28.677836 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 603/1185] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:15:28 2022] GET /identity/v3/role_assignments?user.id=b4e080bb8ad64685b0bac68195f7d5b9&scope.project.id=e7be3d39a68a47709fdf27c4eaf8ae26&role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:30.733543 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec6c52-0460-402d-b4bd-1ac3a6478ac5 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:30.734578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec6c52-0460-402d-b4bd-1ac3a6478ac5 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:30.734689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dec6c52-0460-402d-b4bd-1ac3a6478ac5 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:30.736141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 583/1186] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:15:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:30.741352 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215f7a5-00a7-4c48-b18d-bdd384d3ecda None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:30.741795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215f7a5-00a7-4c48-b18d-bdd384d3ecda None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:30.741915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2215f7a5-00a7-4c48-b18d-bdd384d3ecda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:30.758413 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-2215f7a5-00a7-4c48-b18d-bdd384d3ecda None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:30.759594 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-2215f7a5-00a7-4c48-b18d-bdd384d3ecda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:30.824413 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 604/1187] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:15:30.847305 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec6c52-0460-402d-b4bd-1ac3a6478ac5 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:30.929247 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:30.945541 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dec6c52-0460-402d-b4bd-1ac3a6478ac5 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:30.977578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd0f2c-b362-452d-a45a-820019394b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:30.978348 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd0f2c-b362-452d-a45a-820019394b60 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:30.978627 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd0f2c-b362-452d-a45a-820019394b60 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:30.978898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd0f2c-b362-452d-a45a-820019394b60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:30.989131 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd0f2c-b362-452d-a45a-820019394b60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:30.996564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-c6cd0f2c-b362-452d-a45a-820019394b60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:30.996564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:30.996564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:30.996564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:30.996564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:30.996564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:30.996564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:30.996564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:30.996564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:30.996564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:30.996564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:30.996564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:30.996564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:30.996564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:30.996564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:30.996564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:30.997671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:30.997671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:30.997671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:30.997671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:30.997671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:30.997671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:30.997671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:30.997671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:30.997671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:30.997671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:30.997671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:30.997671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:30.997671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:30.997671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:30.997671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:30.997671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:30.998774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:30.998774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:30.998774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:30.998774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:30.998774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:30.998774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:30.998774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:30.998774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:30.998774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:30.998774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:30.998774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:30.998774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:15:30.998774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 584/1188] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:15:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:31.004197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215f7a5-00a7-4c48-b18d-bdd384d3ecda None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:31.021953 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:31.100347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2215f7a5-00a7-4c48-b18d-bdd384d3ecda None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:31.132576 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452c70d-e210-4a8d-9c76-5c6b407ff9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:31.133230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452c70d-e210-4a8d-9c76-5c6b407ff9d3 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:31.133524 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452c70d-e210-4a8d-9c76-5c6b407ff9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:31.133795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6452c70d-e210-4a8d-9c76-5c6b407ff9d3 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:31.134532 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452c70d-e210-4a8d-9c76-5c6b407ff9d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:31.134845 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452c70d-e210-4a8d-9c76-5c6b407ff9d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:31.136247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6452c70d-e210-4a8d-9c76-5c6b407ff9d3 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:31.144518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 605/1189] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:15:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:31.150109 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd0f2c-b362-452d-a45a-820019394b60 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:31.246536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd0f2c-b362-452d-a45a-820019394b60 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:31.278522 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24300fc8-16d8-4a8d-87e5-90054815fb46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:31.279929 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24300fc8-16d8-4a8d-87e5-90054815fb46 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:31.280208 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24300fc8-16d8-4a8d-87e5-90054815fb46 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:31.280478 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24300fc8-16d8-4a8d-87e5-90054815fb46 None admin] PATH_INFO: `/v3/users/b4e080bb8ad64685b0bac68195f7d5b9` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:31.281637 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24300fc8-16d8-4a8d-87e5-90054815fb46 None admin] RBAC: Authorizing `identity:get_user(user_id=b4e080bb8ad64685b0bac68195f7d5b9)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:31.283057 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24300fc8-16d8-4a8d-87e5-90054815fb46 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:31.284674 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 585/1190] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:15:31 2022] GET /identity/v3/users/b4e080bb8ad64685b0bac68195f7d5b9 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:31.290398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452c70d-e210-4a8d-9c76-5c6b407ff9d3 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:31.369509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:31.389230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6452c70d-e210-4a8d-9c76-5c6b407ff9d3 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:31.421486 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f904c0-83b1-4c3d-a4bb-dcfa675ba37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:31.422334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f904c0-83b1-4c3d-a4bb-dcfa675ba37f None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:31.422620 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f904c0-83b1-4c3d-a4bb-dcfa675ba37f None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:31.422898 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f904c0-83b1-4c3d-a4bb-dcfa675ba37f None admin] PATH_INFO: `/v3/projects/e7be3d39a68a47709fdf27c4eaf8ae26` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:31.424094 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f904c0-83b1-4c3d-a4bb-dcfa675ba37f None admin] RBAC: Authorizing `identity:get_project(project_id=e7be3d39a68a47709fdf27c4eaf8ae26)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:31.425518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f904c0-83b1-4c3d-a4bb-dcfa675ba37f None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:31.427171 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 606/1191] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:15:31 2022] GET /identity/v3/projects/e7be3d39a68a47709fdf27c4eaf8ae26 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:31.432964 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24300fc8-16d8-4a8d-87e5-90054815fb46 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:31.448412 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:31.531863 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24300fc8-16d8-4a8d-87e5-90054815fb46 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:31.563765 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220c793-a9aa-4efc-8836-efe735df6d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:31.564651 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220c793-a9aa-4efc-8836-efe735df6d4b None admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:31.564927 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220c793-a9aa-4efc-8836-efe735df6d4b None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:31.565195 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220c793-a9aa-4efc-8836-efe735df6d4b None admin] PATH_INFO: `/v3/projects/e7be3d39a68a47709fdf27c4eaf8ae26/users/b4e080bb8ad64685b0bac68195f7d5b9/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:31.567113 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220c793-a9aa-4efc-8836-efe735df6d4b None admin] RBAC: Authorizing `identity:create_grant(project_id=e7be3d39a68a47709fdf27c4eaf8ae26, user_id=b4e080bb8ad64685b0bac68195f7d5b9, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:31.568556 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220c793-a9aa-4efc-8836-efe735df6d4b None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:31.580854 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 586/1192] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 00:15:31 2022] PUT /identity/v3/projects/e7be3d39a68a47709fdf27c4eaf8ae26/users/b4e080bb8ad64685b0bac68195f7d5b9/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:15:33.658180 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e3b49-5fc7-4367-9c7d-2f9d37a6626e None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:33.658737 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e3b49-5fc7-4367-9c7d-2f9d37a6626e None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:33.658737 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e3b49-5fc7-4367-9c7d-2f9d37a6626e None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:33.660122 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 607/1193] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:15:33.665276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e099e1-055d-4c0f-bf3f-f6ed56965254 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:33.665647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e099e1-055d-4c0f-bf3f-f6ed56965254 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:33.665833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e099e1-055d-4c0f-bf3f-f6ed56965254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:33.682190 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-58e099e1-055d-4c0f-bf3f-f6ed56965254 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:15:33.683369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-58e099e1-055d-4c0f-bf3f-f6ed56965254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:15:33.746752 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 587/1194] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:15:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:15:33.769764 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e3b49-5fc7-4367-9c7d-2f9d37a6626e None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:33.869519 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e3b49-5fc7-4367-9c7d-2f9d37a6626e None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:33.902648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc19bb-88b4-4016-8c23-00481fbdb4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:33.903429 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc19bb-88b4-4016-8c23-00481fbdb4ab None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:33.904237 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc19bb-88b4-4016-8c23-00481fbdb4ab None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:33.904517 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fc19bb-88b4-4016-8c23-00481fbdb4ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:33.914410 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fc19bb-88b4-4016-8c23-00481fbdb4ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:15:33.922471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-51fc19bb-88b4-4016-8c23-00481fbdb4ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:33.922471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:15:33.922471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:15:33.922471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:15:33.922471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:15:33.922471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:15:33.922471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:15:33.922471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:15:33.922471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:15:33.922471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:15:33.922471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:15:33.922471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:15:33.922471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:15:33.922471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:15:33.922471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:15:33.922471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:15:33.923565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:15:33.923565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:15:33.923565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:15:33.923565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:15:33.923565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:15:33.923565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:15:33.923565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:15:33.923565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:15:33.923565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:15:33.923565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:15:33.923565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:15:33.923565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:15:33.923565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:15:33.923565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:15:33.923565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:15:33.923565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:15:33.924502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:15:33.924502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:15:33.924502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:15:33.924502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:15:33.924502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:15:33.924502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:15:33.924502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:15:33.924502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:15:33.924502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:15:33.924502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:15:33.924502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:15:33.924502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:15:33.924502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 608/1195] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:15:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:15:33.929673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e099e1-055d-4c0f-bf3f-f6ed56965254 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:33.931864 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:34.026218 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e099e1-055d-4c0f-bf3f-f6ed56965254 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:34.059248 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624ea7a-6161-49fd-ad32-ebe1dedeabcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:34.059943 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624ea7a-6161-49fd-ad32-ebe1dedeabcf None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:34.060230 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624ea7a-6161-49fd-ad32-ebe1dedeabcf None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:34.060508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9624ea7a-6161-49fd-ad32-ebe1dedeabcf None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:34.061248 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624ea7a-6161-49fd-ad32-ebe1dedeabcf None admin] RBAC: Adding query filter params (name=admin) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:34.061557 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624ea7a-6161-49fd-ad32-ebe1dedeabcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:34.062954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9624ea7a-6161-49fd-ad32-ebe1dedeabcf None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:34.070860 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 588/1196] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:15:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:34.077073 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc19bb-88b4-4016-8c23-00481fbdb4ab None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:34.088146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:34.174998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fc19bb-88b4-4016-8c23-00481fbdb4ab None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:34.207213 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27361a8a-e99d-4032-b694-79a35efd95c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:34.208094 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27361a8a-e99d-4032-b694-79a35efd95c4 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:34.208383 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27361a8a-e99d-4032-b694-79a35efd95c4 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:34.208662 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27361a8a-e99d-4032-b694-79a35efd95c4 None admin] PATH_INFO: `/v3/users/b4e080bb8ad64685b0bac68195f7d5b9` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:34.209845 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27361a8a-e99d-4032-b694-79a35efd95c4 None admin] RBAC: Authorizing `identity:get_user(user_id=b4e080bb8ad64685b0bac68195f7d5b9)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:34.211277 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27361a8a-e99d-4032-b694-79a35efd95c4 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:34.212900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 609/1197] 10.222.0.44 () {56 vars in 1177 bytes} [Thu Jun 16 00:15:34 2022] GET /identity/v3/users/b4e080bb8ad64685b0bac68195f7d5b9 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:34.219440 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624ea7a-6161-49fd-ad32-ebe1dedeabcf None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:34.279527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:34.315596 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9624ea7a-6161-49fd-ad32-ebe1dedeabcf None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:34.348091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2c401-fe1a-44a1-b5b6-be1207f5896e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:34.348721 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2c401-fe1a-44a1-b5b6-be1207f5896e None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:34.349005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2c401-fe1a-44a1-b5b6-be1207f5896e None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:34.349281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f2c401-fe1a-44a1-b5b6-be1207f5896e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:34.413529 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2c401-fe1a-44a1-b5b6-be1207f5896e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:34.414995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f2c401-fe1a-44a1-b5b6-be1207f5896e None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:34.472353 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:34.509641 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 589/1198] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:15:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:15:34.515954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27361a8a-e99d-4032-b694-79a35efd95c4 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:34.590993 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:34.613734 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27361a8a-e99d-4032-b694-79a35efd95c4 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:34.646910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d0c86-4d52-433f-a0e5-16ae759d9a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:34.647789 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d0c86-4d52-433f-a0e5-16ae759d9a5b None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:34.648077 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d0c86-4d52-433f-a0e5-16ae759d9a5b None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:34.648357 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d0c86-4d52-433f-a0e5-16ae759d9a5b None admin] PATH_INFO: `/v3/projects/e7be3d39a68a47709fdf27c4eaf8ae26` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:34.649525 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d0c86-4d52-433f-a0e5-16ae759d9a5b None admin] RBAC: Authorizing `identity:get_project(project_id=e7be3d39a68a47709fdf27c4eaf8ae26)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:34.650951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d0c86-4d52-433f-a0e5-16ae759d9a5b None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:34.652638 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 610/1199] 10.222.0.44 () {56 vars in 1186 bytes} [Thu Jun 16 00:15:34 2022] GET /identity/v3/projects/e7be3d39a68a47709fdf27c4eaf8ae26 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:34.658716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2c401-fe1a-44a1-b5b6-be1207f5896e None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:15:34.754892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f2c401-fe1a-44a1-b5b6-be1207f5896e None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:15:34.787418 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a6ece9-3c91-4d0e-909d-45c0c4d2e2ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:15:34.788099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6ece9-3c91-4d0e-909d-45c0c4d2e2ae None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:15:34.788383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6ece9-3c91-4d0e-909d-45c0c4d2e2ae None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:15:34.788656 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6ece9-3c91-4d0e-909d-45c0c4d2e2ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:15:34.789474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6ece9-3c91-4d0e-909d-45c0c4d2e2ae None admin] RBAC: Adding query filter params (role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab, scope.project.id=e7be3d39a68a47709fdf27c4eaf8ae26, user.id=b4e080bb8ad64685b0bac68195f7d5b9) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:15:34.789787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6ece9-3c91-4d0e-909d-45c0c4d2e2ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:15:34.791216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a6ece9-3c91-4d0e-909d-45c0c4d2e2ae None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:15:34.797539 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 590/1200] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:15:34 2022] GET /identity/v3/role_assignments?user.id=b4e080bb8ad64685b0bac68195f7d5b9&scope.project.id=e7be3d39a68a47709fdf27c4eaf8ae26&role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:15:44.642864 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=28 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:15:44.794348 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=86 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:30.139909 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5aa14-3869-489d-8d9a-42feb18dfec1 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:30.139909 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5aa14-3869-489d-8d9a-42feb18dfec1 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:30.139909 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d5aa14-3869-489d-8d9a-42feb18dfec1 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:30.139909 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 611/1201] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:16:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:30.148233 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031db6a-e41b-4c21-9070-adbed5d69ee6 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:30.149119 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031db6a-e41b-4c21-9070-adbed5d69ee6 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:30.149659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d031db6a-e41b-4c21-9070-adbed5d69ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:30.168382 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-d031db6a-e41b-4c21-9070-adbed5d69ee6 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:30.169829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d031db6a-e41b-4c21-9070-adbed5d69ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:30.264494 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 591/1202] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:16:30.292609 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5aa14-3869-489d-8d9a-42feb18dfec1 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:30.441505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d5aa14-3869-489d-8d9a-42feb18dfec1 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:30.488991 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2878a0-e3af-4651-a61f-2f01e3a584f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:30.489855 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2878a0-e3af-4651-a61f-2f01e3a584f3 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:30.490153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2878a0-e3af-4651-a61f-2f01e3a584f3 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:30.490493 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2878a0-e3af-4651-a61f-2f01e3a584f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:30.503245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2878a0-e3af-4651-a61f-2f01e3a584f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:30.504915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2878a0-e3af-4651-a61f-2f01e3a584f3 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:30.526907 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-ce2878a0-e3af-4651-a61f-2f01e3a584f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:30.526907 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:30.526907 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:30.526907 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:30.526907 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:30.526907 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:30.526907 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:30.526907 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:30.526907 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:30.526907 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:30.526907 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:30.526907 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:30.526907 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:16:30.526907 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:16:30.526907 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:16:30.528220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:16:30.528220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:30.528220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:30.528220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:30.528220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:30.528220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:30.528220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:30.528220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:30.528220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:30.528220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:30.528220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:30.528220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:30.528220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:30.528220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:30.528220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:30.528220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:30.528220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:30.529205 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:16:30.529205 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:16:30.529205 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:30.529205 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:16:30.534719 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031db6a-e41b-4c21-9070-adbed5d69ee6 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:30.535746 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 612/1203] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:16:30.674329 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d031db6a-e41b-4c21-9070-adbed5d69ee6 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:30.712080 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:30.718604 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f014c8-119a-4ba6-a02b-ae62a74a5a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:30.719300 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f014c8-119a-4ba6-a02b-ae62a74a5a6f None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:30.719581 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f014c8-119a-4ba6-a02b-ae62a74a5a6f None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:30.719887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f014c8-119a-4ba6-a02b-ae62a74a5a6f None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:30.720610 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f014c8-119a-4ba6-a02b-ae62a74a5a6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:30.720915 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f014c8-119a-4ba6-a02b-ae62a74a5a6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:30.722287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f014c8-119a-4ba6-a02b-ae62a74a5a6f None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:30.737134 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 592/1204] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:30.744091 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2878a0-e3af-4651-a61f-2f01e3a584f3 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:30.825668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:30.904279 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2878a0-e3af-4651-a61f-2f01e3a584f3 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:30.948633 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a7a3d-dac9-45d7-8ad2-24d1ed7711bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:30.949322 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a7a3d-dac9-45d7-8ad2-24d1ed7711bc None admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:30.949704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a7a3d-dac9-45d7-8ad2-24d1ed7711bc None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:30.950000 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a7a3d-dac9-45d7-8ad2-24d1ed7711bc None admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:30.950719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a7a3d-dac9-45d7-8ad2-24d1ed7711bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:30.952286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a7a3d-dac9-45d7-8ad2-24d1ed7711bc None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:30.978961 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 613/1205] 10.222.0.44 () {60 vars in 1132 bytes} [Thu Jun 16 00:16:30 2022] POST /identity/v3/users => generated 251 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:16:33.379084 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746b0eb-6dbd-42be-999f-9c1bdc767af4 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:33.379084 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746b0eb-6dbd-42be-999f-9c1bdc767af4 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:33.379084 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3746b0eb-6dbd-42be-999f-9c1bdc767af4 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:33.379084 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 593/1206] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:33.385470 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ec8c3-593b-46b5-b4cb-cf65147a0f42 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:33.386157 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ec8c3-593b-46b5-b4cb-cf65147a0f42 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:33.386157 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5ec8c3-593b-46b5-b4cb-cf65147a0f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:33.404167 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-7f5ec8c3-593b-46b5-b4cb-cf65147a0f42 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:33.405496 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-7f5ec8c3-593b-46b5-b4cb-cf65147a0f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:33.503534 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 614/1207] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:16:33.530697 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746b0eb-6dbd-42be-999f-9c1bdc767af4 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:33.651515 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3746b0eb-6dbd-42be-999f-9c1bdc767af4 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:33.691593 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95500330-cfa1-40d6-9d4c-cb0de6db2659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:33.692581 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95500330-cfa1-40d6-9d4c-cb0de6db2659 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:33.692978 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95500330-cfa1-40d6-9d4c-cb0de6db2659 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:33.693350 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95500330-cfa1-40d6-9d4c-cb0de6db2659 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:33.707933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95500330-cfa1-40d6-9d4c-cb0de6db2659 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:16:33.716729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-95500330-cfa1-40d6-9d4c-cb0de6db2659 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:16:33.716729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:33.716729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:33.716729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:33.716729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:33.716729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:33.716729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:33.716729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:33.716729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:33.716729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:33.716729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:33.716729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:33.716729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:16:33.716729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:16:33.716729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:16:33.716729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:16:33.717930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:16:33.717930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:16:33.717930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:16:33.717930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:16:33.717930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:33.717930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:33.717930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:33.717930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:33.717930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:33.717930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:33.717930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:33.717930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:33.717930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:33.717930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:33.717930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:33.717930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:33.719043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:33.719043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:33.719043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:33.719043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:33.719043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:16:33.719043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:16:33.719043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:16:33.719043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:16:33.719043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:16:33.719043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:16:33.719043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:16:33.719043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:16:33.720719 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 594/1208] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 00:16:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:33.727729 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ec8c3-593b-46b5-b4cb-cf65147a0f42 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:33.775405 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:33.857595 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5ec8c3-593b-46b5-b4cb-cf65147a0f42 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:33.901305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6b218-adb7-4977-ae6d-a4a7e22fda19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:33.902128 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6b218-adb7-4977-ae6d-a4a7e22fda19 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:33.902356 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6b218-adb7-4977-ae6d-a4a7e22fda19 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:33.902683 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6b218-adb7-4977-ae6d-a4a7e22fda19 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:33.903491 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6b218-adb7-4977-ae6d-a4a7e22fda19 None admin] RBAC: Adding query filter params (name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:33.903831 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6b218-adb7-4977-ae6d-a4a7e22fda19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:33.905367 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6b218-adb7-4977-ae6d-a4a7e22fda19 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:33.914725 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 615/1209] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 00:16:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:33.920720 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95500330-cfa1-40d6-9d4c-cb0de6db2659 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:33.980190 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:34.036365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95500330-cfa1-40d6-9d4c-cb0de6db2659 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:34.072201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6dae0-81b0-45c5-9f97-1ba66bd97a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:34.073399 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6dae0-81b0-45c5-9f97-1ba66bd97a80 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:34.073399 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6dae0-81b0-45c5-9f97-1ba66bd97a80 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:34.073581 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6dae0-81b0-45c5-9f97-1ba66bd97a80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:34.085759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6dae0-81b0-45c5-9f97-1ba66bd97a80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:34.087258 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6dae0-81b0-45c5-9f97-1ba66bd97a80 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:34.105933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-b6b6dae0-81b0-45c5-9f97-1ba66bd97a80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:34.105933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:34.105933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:34.105933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:34.105933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:34.105933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:34.105933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:34.105933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:34.105933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:34.105933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:34.105933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:34.105933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:34.105933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:16:34.105933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:16:34.105933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:16:34.106934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:16:34.106934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:34.106934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:34.106934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:34.106934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:34.106934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:34.106934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:34.106934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:34.106934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:34.106934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:34.106934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:34.106934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:34.106934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:34.106934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:34.106934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:34.106934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:34.106934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:34.108295 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:16:34.108295 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:16:34.108295 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:34.108295 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:16:34.108295 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 595/1210] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:34.113187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6b218-adb7-4977-ae6d-a4a7e22fda19 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:34.223712 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:34.227467 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6b218-adb7-4977-ae6d-a4a7e22fda19 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:34.267082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65dd57-3c1f-4ab0-8685-4bf85d86ef08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:34.267801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65dd57-3c1f-4ab0-8685-4bf85d86ef08 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:34.268092 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65dd57-3c1f-4ab0-8685-4bf85d86ef08 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:34.268369 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c65dd57-3c1f-4ab0-8685-4bf85d86ef08 None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:34.269126 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65dd57-3c1f-4ab0-8685-4bf85d86ef08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:34.269439 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65dd57-3c1f-4ab0-8685-4bf85d86ef08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:34.270858 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c65dd57-3c1f-4ab0-8685-4bf85d86ef08 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:34.285723 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 616/1211] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:34.292904 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6dae0-81b0-45c5-9f97-1ba66bd97a80 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:34.409300 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6dae0-81b0-45c5-9f97-1ba66bd97a80 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:34.410891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:34.447030 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde30fc-87e8-42e1-ae83-3f35938debc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:34.447955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde30fc-87e8-42e1-ae83-3f35938debc9 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:34.448370 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde30fc-87e8-42e1-ae83-3f35938debc9 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:34.448683 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fde30fc-87e8-42e1-ae83-3f35938debc9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:34.458773 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde30fc-87e8-42e1-ae83-3f35938debc9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:34.461211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fde30fc-87e8-42e1-ae83-3f35938debc9 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:34.477815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-0fde30fc-87e8-42e1-ae83-3f35938debc9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:16:34.477815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:34.477815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:34.477815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:34.477815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:34.477815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:34.477815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:34.477815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:34.477815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:34.477815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:34.477815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:34.477815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:34.477815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:16:34.477815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:16:34.477815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:16:34.477815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:16:34.478817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:34.478817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:34.478817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:16:34.478817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:16:34.478817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:16:34.478817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:16:34.478817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:34.478817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:34.478817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:34.478817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:34.478817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:34.478817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:34.478817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:34.478817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:34.478817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:34.478817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:34.478817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:34.478817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:34.480013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:34.480013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:34.480013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:16:34.480013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:16:34.480013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:16:34.480013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:16:34.480013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:16:34.480013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:16:34.480013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:16:34.480013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:16:34.480013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 596/1212] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:16:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:34.492180 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65dd57-3c1f-4ab0-8685-4bf85d86ef08 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:34.616274 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c65dd57-3c1f-4ab0-8685-4bf85d86ef08 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:34.673713 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010befd-1dd9-4924-9c88-4f97c065f11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:34.674735 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010befd-1dd9-4924-9c88-4f97c065f11b None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:34.675227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010befd-1dd9-4924-9c88-4f97c065f11b None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:34.675679 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3010befd-1dd9-4924-9c88-4f97c065f11b None admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:34.677215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010befd-1dd9-4924-9c88-4f97c065f11b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:34.677713 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010befd-1dd9-4924-9c88-4f97c065f11b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:34.680258 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3010befd-1dd9-4924-9c88-4f97c065f11b None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:34.709181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 617/1213] 10.222.0.44 () {56 vars in 1143 bytes} [Thu Jun 16 00:16:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:34.716206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde30fc-87e8-42e1-ae83-3f35938debc9 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:34.844439 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fde30fc-87e8-42e1-ae83-3f35938debc9 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:34.887311 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99aaa0-6be7-4121-ba1e-1b1554b6bf6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:34.888026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99aaa0-6be7-4121-ba1e-1b1554b6bf6f None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:34.888366 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99aaa0-6be7-4121-ba1e-1b1554b6bf6f None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:34.888608 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99aaa0-6be7-4121-ba1e-1b1554b6bf6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:34.923802 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:34.967926 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99aaa0-6be7-4121-ba1e-1b1554b6bf6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:34.967926 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99aaa0-6be7-4121-ba1e-1b1554b6bf6f None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:35.103581 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 597/1214] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:16:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 00:16:35.109779 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010befd-1dd9-4924-9c88-4f97c065f11b None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:35.133311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:35.220996 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3010befd-1dd9-4924-9c88-4f97c065f11b None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:35.261987 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce65752-5bf3-4811-a932-4b0e8f364a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:35.262891 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce65752-5bf3-4811-a932-4b0e8f364a99 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:35.263242 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce65752-5bf3-4811-a932-4b0e8f364a99 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:35.263640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce65752-5bf3-4811-a932-4b0e8f364a99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:35.274378 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce65752-5bf3-4811-a932-4b0e8f364a99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:35.275983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce65752-5bf3-4811-a932-4b0e8f364a99 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:35.295201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-5ce65752-5bf3-4811-a932-4b0e8f364a99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:35.295201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:35.295201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:35.295201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:35.295201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:35.295201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:35.295201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:35.295201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:35.295201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:35.295201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:35.295201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:35.295201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:35.295201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:16:35.295201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:16:35.295201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:16:35.296586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:16:35.296586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:35.296586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:35.296586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:35.296586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:35.296586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:35.296586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:35.296586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:35.296586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:35.296586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:35.296586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:35.296586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:35.296586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:35.296586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:35.296586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:35.296586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:35.296586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:35.297959 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:16:35.297959 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:16:35.297959 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:35.297959 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:16:35.297959 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 618/1215] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:35.302350 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99aaa0-6be7-4121-ba1e-1b1554b6bf6f None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:35.376376 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:35.430227 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99aaa0-6be7-4121-ba1e-1b1554b6bf6f None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:35.473340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d02df2-ac6f-4fd5-b28d-3de308a860ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:35.474010 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d02df2-ac6f-4fd5-b28d-3de308a860ef None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:35.474490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d02df2-ac6f-4fd5-b28d-3de308a860ef None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:35.474892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d02df2-ac6f-4fd5-b28d-3de308a860ef None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:35.475294 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d02df2-ac6f-4fd5-b28d-3de308a860ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:35.475771 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d02df2-ac6f-4fd5-b28d-3de308a860ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:35.477675 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d02df2-ac6f-4fd5-b28d-3de308a860ef None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:35.496217 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 598/1216] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:35.496425 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce65752-5bf3-4811-a932-4b0e8f364a99 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:35.585056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:35.618100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce65752-5bf3-4811-a932-4b0e8f364a99 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:35.655165 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05785728-cec4-4918-befe-158b46a6f55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:35.655946 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05785728-cec4-4918-befe-158b46a6f55f None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:35.656173 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05785728-cec4-4918-befe-158b46a6f55f None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:35.656447 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05785728-cec4-4918-befe-158b46a6f55f None admin] PATH_INFO: `/v3/projects/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:35.664211 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05785728-cec4-4918-befe-158b46a6f55f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:35.665657 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05785728-cec4-4918-befe-158b46a6f55f None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:35.679976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-05785728-cec4-4918-befe-158b46a6f55f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:16:35.679976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:35.679976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:35.679976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:35.679976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:35.679976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:35.679976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:35.679976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:35.679976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:35.679976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:35.679976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:35.679976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:35.679976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:16:35.679976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:16:35.679976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:16:35.680944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:16:35.680944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:35.680944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:35.680944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:35.680944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:35.680944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:35.680944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:35.680944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:35.680944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:35.680944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:35.680944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:35.680944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:35.680944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:35.680944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:35.680944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:35.680944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:35.680944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:35.681870 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:16:35.681870 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:16:35.681870 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:16:35.681870 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:16:35.681870 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:16:35.681870 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:16:35.681870 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:16:35.681870 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:16:35.683991 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 619/1217] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:16:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:16:35.687076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d02df2-ac6f-4fd5-b28d-3de308a860ef None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:35.813956 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d02df2-ac6f-4fd5-b28d-3de308a860ef None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:35.839593 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:35.854034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf2771-7a94-471a-a48d-6566c31f0731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:35.854697 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf2771-7a94-471a-a48d-6566c31f0731 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:35.854979 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf2771-7a94-471a-a48d-6566c31f0731 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:35.855256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf2771-7a94-471a-a48d-6566c31f0731 None admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:35.856086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf2771-7a94-471a-a48d-6566c31f0731 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:35.856401 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf2771-7a94-471a-a48d-6566c31f0731 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:35.857853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf2771-7a94-471a-a48d-6566c31f0731 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:35.875341 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 599/1218] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:16:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:16:35.876889 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05785728-cec4-4918-befe-158b46a6f55f None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:35.990918 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05785728-cec4-4918-befe-158b46a6f55f None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:36.021761 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:36.028807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492bf34a-4dcc-4dfa-b550-f1af5d30a373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:36.029478 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bf34a-4dcc-4dfa-b550-f1af5d30a373 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:36.029763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bf34a-4dcc-4dfa-b550-f1af5d30a373 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:36.030039 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492bf34a-4dcc-4dfa-b550-f1af5d30a373 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:36.030868 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bf34a-4dcc-4dfa-b550-f1af5d30a373 None admin] RBAC: Adding query filter params (role.id=338a913607974d379aad3249b3d0402d, scope.project.id=320d79ecbc2342af8031103e7308c10d, user.id=9164f14fe6894daba1a9f2d8f1f4929c) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:36.031187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bf34a-4dcc-4dfa-b550-f1af5d30a373 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:36.032645 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492bf34a-4dcc-4dfa-b550-f1af5d30a373 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:36.039166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 620/1219] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:16:35 2022] GET /identity/v3/role_assignments?user.id=9164f14fe6894daba1a9f2d8f1f4929c&scope.project.id=320d79ecbc2342af8031103e7308c10d&role.id=338a913607974d379aad3249b3d0402d => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:38.146706 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbac70-58aa-483e-a390-7ea486f282bb None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:38.147209 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbac70-58aa-483e-a390-7ea486f282bb None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:38.147346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbac70-58aa-483e-a390-7ea486f282bb None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:38.149615 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 600/1220] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:38.155581 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455ed88-c6ca-4fd3-8f07-9aa7538c224d None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:38.156064 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455ed88-c6ca-4fd3-8f07-9aa7538c224d None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:38.156174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5455ed88-c6ca-4fd3-8f07-9aa7538c224d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:38.175940 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-5455ed88-c6ca-4fd3-8f07-9aa7538c224d None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:38.177360 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-5455ed88-c6ca-4fd3-8f07-9aa7538c224d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:38.254871 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 621/1221] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:16:38.281337 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbac70-58aa-483e-a390-7ea486f282bb None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:38.387907 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbac70-58aa-483e-a390-7ea486f282bb None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:38.429143 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0366b-dae8-4ae0-9d82-9ac9f571f5be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:38.429961 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0366b-dae8-4ae0-9d82-9ac9f571f5be None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:38.430254 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0366b-dae8-4ae0-9d82-9ac9f571f5be None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:38.430580 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc0366b-dae8-4ae0-9d82-9ac9f571f5be None admin] PATH_INFO: `/v3/roles/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:38.442449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc0366b-dae8-4ae0-9d82-9ac9f571f5be None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:16:38.450226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-efc0366b-dae8-4ae0-9d82-9ac9f571f5be None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:16:38.450226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:38.450226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:38.450226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:38.450226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:38.450226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:38.450226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:38.450226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:38.450226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:38.450226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:38.450226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:38.450226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:38.450226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:16:38.450226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:16:38.450226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:16:38.450226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:16:38.451234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:16:38.451234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:16:38.451234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:16:38.451234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:16:38.451234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:38.451234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:38.451234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:38.451234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:38.451234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:38.451234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:38.451234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:38.451234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:38.451234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:38.451234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:38.451234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:38.451234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:38.452107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:38.452107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:38.452107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:38.452107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:38.452107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:16:38.452107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:16:38.452107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:16:38.452107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:16:38.452107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:16:38.452107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:16:38.452107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:16:38.452107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:16:38.452107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 601/1222] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 00:16:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:38.458297 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455ed88-c6ca-4fd3-8f07-9aa7538c224d None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:38.566541 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5455ed88-c6ca-4fd3-8f07-9aa7538c224d None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:38.593288 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:38.605097 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565b5da-7d69-4365-bc66-34f6af10ecaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:38.605774 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565b5da-7d69-4365-bc66-34f6af10ecaa None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:38.606062 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565b5da-7d69-4365-bc66-34f6af10ecaa None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:38.606343 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5565b5da-7d69-4365-bc66-34f6af10ecaa None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:38.607259 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565b5da-7d69-4365-bc66-34f6af10ecaa None admin] RBAC: Adding query filter params (name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:38.607695 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565b5da-7d69-4365-bc66-34f6af10ecaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:38.609317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5565b5da-7d69-4365-bc66-34f6af10ecaa None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:38.619625 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 622/1223] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 00:16:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:38.625558 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0366b-dae8-4ae0-9d82-9ac9f571f5be None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:38.671556 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:38.732699 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc0366b-dae8-4ae0-9d82-9ac9f571f5be None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:38.768326 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91990ef-53b9-44ce-b804-26e927483f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:38.769114 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91990ef-53b9-44ce-b804-26e927483f6f None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:38.769426 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91990ef-53b9-44ce-b804-26e927483f6f None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:38.769701 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91990ef-53b9-44ce-b804-26e927483f6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:38.780821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91990ef-53b9-44ce-b804-26e927483f6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:38.782278 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91990ef-53b9-44ce-b804-26e927483f6f None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:38.802076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-e91990ef-53b9-44ce-b804-26e927483f6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:38.802076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:38.802076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:38.802076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:38.802076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:38.802076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:38.802076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:38.802076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:38.802076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:38.802076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:38.802076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:38.802076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:38.802076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:16:38.802076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:16:38.802076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:16:38.803148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:16:38.803148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:38.803148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:38.803148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:38.803148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:38.803148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:38.803148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:38.803148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:38.803148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:38.803148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:38.803148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:38.803148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:38.803148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:38.803148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:38.803148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:38.803148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:38.803148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:38.804287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:16:38.804287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:16:38.804287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:38.804287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:16:38.807943 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 602/1224] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:38.809115 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565b5da-7d69-4365-bc66-34f6af10ecaa None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:38.918919 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5565b5da-7d69-4365-bc66-34f6af10ecaa None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:38.956896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f950f2d-292c-47c6-8eaa-bf02558add14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:38.957560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f950f2d-292c-47c6-8eaa-bf02558add14 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:38.957892 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f950f2d-292c-47c6-8eaa-bf02558add14 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:38.958178 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f950f2d-292c-47c6-8eaa-bf02558add14 None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:38.958905 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f950f2d-292c-47c6-8eaa-bf02558add14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:38.959215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f950f2d-292c-47c6-8eaa-bf02558add14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:38.961308 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f950f2d-292c-47c6-8eaa-bf02558add14 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:38.973240 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 623/1225] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:38.979502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91990ef-53b9-44ce-b804-26e927483f6f None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:39.086231 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:39.093827 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91990ef-53b9-44ce-b804-26e927483f6f None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:39.133069 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7e72f-99f0-4940-a7bc-1be4e7818efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:39.133912 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7e72f-99f0-4940-a7bc-1be4e7818efe None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:39.134198 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7e72f-99f0-4940-a7bc-1be4e7818efe None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:39.134548 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e7e72f-99f0-4940-a7bc-1be4e7818efe None admin] PATH_INFO: `/v3/users/placement` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:39.142844 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7e72f-99f0-4940-a7bc-1be4e7818efe None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:39.144361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e7e72f-99f0-4940-a7bc-1be4e7818efe None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:39.159206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-b5e7e72f-99f0-4940-a7bc-1be4e7818efe None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:16:39.159206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:39.159206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:39.159206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:39.159206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:39.159206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:39.159206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:39.159206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:39.159206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:39.159206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:39.159206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:39.159206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:39.159206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:16:39.159206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:16:39.159206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:16:39.159206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:16:39.160883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:39.160883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:39.160883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:16:39.160883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:16:39.160883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:16:39.160883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:16:39.160883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:39.160883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:39.160883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:39.160883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:39.160883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:39.160883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:39.160883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:39.160883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:39.160883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:39.160883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:39.160883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:39.160883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:39.162241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:39.162241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:39.162241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:16:39.162241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:16:39.162241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:16:39.162241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:16:39.162241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:16:39.162241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:16:39.162241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:16:39.162241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:16:39.162241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 603/1226] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:16:38 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:39.167034 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f950f2d-292c-47c6-8eaa-bf02558add14 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:39.218308 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:39.278943 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f950f2d-292c-47c6-8eaa-bf02558add14 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:39.317054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83886526-17aa-492e-8efe-25082fcc421c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:39.317844 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83886526-17aa-492e-8efe-25082fcc421c None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:39.318160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83886526-17aa-492e-8efe-25082fcc421c None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:39.318488 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83886526-17aa-492e-8efe-25082fcc421c None admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:39.319966 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83886526-17aa-492e-8efe-25082fcc421c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:39.320287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83886526-17aa-492e-8efe-25082fcc421c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:39.321741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83886526-17aa-492e-8efe-25082fcc421c None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:39.346844 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 624/1227] 10.222.0.44 () {56 vars in 1143 bytes} [Thu Jun 16 00:16:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:39.348696 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7e72f-99f0-4940-a7bc-1be4e7818efe None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:39.456654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e7e72f-99f0-4940-a7bc-1be4e7818efe None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:39.495266 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d8396-7985-4c24-98ce-5a3e363cec10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:39.496161 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d8396-7985-4c24-98ce-5a3e363cec10 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:39.496445 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d8396-7985-4c24-98ce-5a3e363cec10 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:39.496722 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287d8396-7985-4c24-98ce-5a3e363cec10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:39.507846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d8396-7985-4c24-98ce-5a3e363cec10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:39.509300 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287d8396-7985-4c24-98ce-5a3e363cec10 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:39.526212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-287d8396-7985-4c24-98ce-5a3e363cec10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:39.526212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:39.526212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:39.526212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:39.526212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:39.526212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:39.526212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:39.526212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:39.526212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:39.526212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:39.526212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:39.526212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:39.526212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:16:39.526212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:16:39.526212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:16:39.527135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:16:39.527135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:39.527135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:39.527135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:39.527135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:39.527135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:39.527135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:39.527135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:39.527135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:39.527135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:39.527135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:39.527135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:39.527135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:39.527135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:39.527135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:39.527135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:39.527135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:39.528139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:16:39.528139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:16:39.528139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:39.528139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:16:39.528139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 604/1228] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:39.533040 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83886526-17aa-492e-8efe-25082fcc421c None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:39.642614 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83886526-17aa-492e-8efe-25082fcc421c None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:39.644854 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:39.680878 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31003064-a785-4011-a8d3-cfde53a0e555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:39.681549 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31003064-a785-4011-a8d3-cfde53a0e555 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:39.681834 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31003064-a785-4011-a8d3-cfde53a0e555 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:39.682111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31003064-a785-4011-a8d3-cfde53a0e555 None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:39.682838 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31003064-a785-4011-a8d3-cfde53a0e555 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:39.683146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31003064-a785-4011-a8d3-cfde53a0e555 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:39.684545 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31003064-a785-4011-a8d3-cfde53a0e555 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:39.696558 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 625/1229] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:39.703189 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d8396-7985-4c24-98ce-5a3e363cec10 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:39.713942 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:39.817238 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287d8396-7985-4c24-98ce-5a3e363cec10 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:39.852346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce9733-1477-436d-a796-772da33416d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:39.853226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce9733-1477-436d-a796-772da33416d5 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:39.853460 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce9733-1477-436d-a796-772da33416d5 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:39.853738 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce9733-1477-436d-a796-772da33416d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:39.860725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce9733-1477-436d-a796-772da33416d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:39.862183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce9733-1477-436d-a796-772da33416d5 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:39.878517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-22ce9733-1477-436d-a796-772da33416d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:16:39.878517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:39.878517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:39.878517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:39.878517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:39.878517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:39.878517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:39.878517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:39.878517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:39.878517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:39.878517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:39.878517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:39.878517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:16:39.878517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:16:39.878517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:16:39.879679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:16:39.879679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:39.879679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:39.879679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:39.879679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:39.879679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:39.879679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:39.879679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:39.879679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:39.879679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:39.879679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:39.879679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:39.879679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:39.879679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:39.879679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:39.879679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:39.879679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:39.884314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:16:39.884314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:16:39.884314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:16:39.884314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:16:39.884314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:16:39.884314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:16:39.884314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:16:39.884314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:16:39.884314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 605/1230] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:16:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:39.886186 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31003064-a785-4011-a8d3-cfde53a0e555 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:40.000064 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31003064-a785-4011-a8d3-cfde53a0e555 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:40.037437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c784cd2d-8edf-4211-8f9c-d37ea764a429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:40.039026 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784cd2d-8edf-4211-8f9c-d37ea764a429 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:40.039539 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784cd2d-8edf-4211-8f9c-d37ea764a429 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:40.040298 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c784cd2d-8edf-4211-8f9c-d37ea764a429 None admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:40.041819 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784cd2d-8edf-4211-8f9c-d37ea764a429 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:40.042363 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784cd2d-8edf-4211-8f9c-d37ea764a429 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:40.044926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c784cd2d-8edf-4211-8f9c-d37ea764a429 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:40.062723 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 626/1231] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:16:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:40.068905 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce9733-1477-436d-a796-772da33416d5 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:40.151802 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:40.191859 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce9733-1477-436d-a796-772da33416d5 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:40.228968 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273c9efa-e208-4e1a-b805-3c311ca57015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:40.229852 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c9efa-e208-4e1a-b805-3c311ca57015 None admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:40.230165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c9efa-e208-4e1a-b805-3c311ca57015 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:40.230433 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273c9efa-e208-4e1a-b805-3c311ca57015 None admin] PATH_INFO: `/v3/projects/320d79ecbc2342af8031103e7308c10d/users/9164f14fe6894daba1a9f2d8f1f4929c/roles/338a913607974d379aad3249b3d0402d` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:40.245686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c9efa-e208-4e1a-b805-3c311ca57015 None admin] RBAC: Authorizing `identity:create_grant(project_id=320d79ecbc2342af8031103e7308c10d, user_id=9164f14fe6894daba1a9f2d8f1f4929c, role_id=338a913607974d379aad3249b3d0402d)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:40.247138 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273c9efa-e208-4e1a-b805-3c311ca57015 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:40.260004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 606/1232] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 00:16:40 2022] PUT /identity/v3/projects/320d79ecbc2342af8031103e7308c10d/users/9164f14fe6894daba1a9f2d8f1f4929c/roles/338a913607974d379aad3249b3d0402d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:16:42.527312 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4dff7-28eb-4e7a-8444-c2a3d19ae90b None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:42.527877 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4dff7-28eb-4e7a-8444-c2a3d19ae90b None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:42.528010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4dff7-28eb-4e7a-8444-c2a3d19ae90b None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:42.529691 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 627/1233] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:16:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:42.535167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642af66e-ceaa-4ddf-9525-4580e8201d77 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:42.535637 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642af66e-ceaa-4ddf-9525-4580e8201d77 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:42.535736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642af66e-ceaa-4ddf-9525-4580e8201d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:42.554023 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-642af66e-ceaa-4ddf-9525-4580e8201d77 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:42.555302 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-642af66e-ceaa-4ddf-9525-4580e8201d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:42.631472 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 607/1234] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:16:42.654647 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4dff7-28eb-4e7a-8444-c2a3d19ae90b None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:42.680974 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:42.758584 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4dff7-28eb-4e7a-8444-c2a3d19ae90b None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:42.799533 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05b8e6-5416-411e-9bce-486ec17ea4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:42.799533 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05b8e6-5416-411e-9bce-486ec17ea4c1 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:42.799533 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05b8e6-5416-411e-9bce-486ec17ea4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:42.800427 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05b8e6-5416-411e-9bce-486ec17ea4c1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:42.810321 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05b8e6-5416-411e-9bce-486ec17ea4c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:16:42.818044 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-7e05b8e6-5416-411e-9bce-486ec17ea4c1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:16:42.818044 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:42.818044 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:42.818044 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:42.818044 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:42.818044 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:42.818044 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:42.818044 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:42.818044 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:42.818044 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:42.818044 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:42.818044 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:42.818044 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:16:42.818044 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:16:42.818044 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:16:42.818044 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:16:42.819265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:16:42.819265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:16:42.819265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:16:42.819265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:16:42.819265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:42.819265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:42.819265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:42.819265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:42.819265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:42.819265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:42.819265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:42.819265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:42.819265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:42.819265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:42.819265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:42.819265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:42.820302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:42.820302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:42.820302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:42.820302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:42.820302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:16:42.820302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:16:42.820302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:16:42.820302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:16:42.820302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:16:42.820302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:16:42.820302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 16 00:16:42.820302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:16:42.820302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 628/1235] 10.222.0.44 () {56 vars in 1102 bytes} [Thu Jun 16 00:16:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:42.825247 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642af66e-ceaa-4ddf-9525-4580e8201d77 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:42.875741 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:42.940321 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642af66e-ceaa-4ddf-9525-4580e8201d77 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:42.980456 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398dfc29-34ab-4b79-8bd9-9a283f652db5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:42.981225 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dfc29-34ab-4b79-8bd9-9a283f652db5 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:42.981503 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dfc29-34ab-4b79-8bd9-9a283f652db5 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:42.981754 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dfc29-34ab-4b79-8bd9-9a283f652db5 None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:42.982608 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398dfc29-34ab-4b79-8bd9-9a283f652db5 None admin] RBAC: Adding query filter params (name=service) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:42.982954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398dfc29-34ab-4b79-8bd9-9a283f652db5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:42.984438 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398dfc29-34ab-4b79-8bd9-9a283f652db5 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:42.994007 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 608/1236] 10.222.0.44 () {56 vars in 1103 bytes} [Thu Jun 16 00:16:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:43.000366 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05b8e6-5416-411e-9bce-486ec17ea4c1 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:43.093724 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:43.112258 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05b8e6-5416-411e-9bce-486ec17ea4c1 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:43.151989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112eaa4-1abf-4da5-bce1-d3d1d354d7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:43.152802 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112eaa4-1abf-4da5-bce1-d3d1d354d7ad None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:43.153087 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112eaa4-1abf-4da5-bce1-d3d1d354d7ad None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:43.153365 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b112eaa4-1abf-4da5-bce1-d3d1d354d7ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:43.164850 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112eaa4-1abf-4da5-bce1-d3d1d354d7ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:43.166305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b112eaa4-1abf-4da5-bce1-d3d1d354d7ad None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:43.183284 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-b112eaa4-1abf-4da5-bce1-d3d1d354d7ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:43.183284 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:43.183284 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:43.183284 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:43.183284 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:43.183284 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:43.183284 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:43.183284 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:43.183284 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:43.183284 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:43.183284 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:43.183284 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:43.183284 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:16:43.183284 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:16:43.183284 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:16:43.184293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:16:43.184293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:43.184293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:43.184293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:43.184293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:43.184293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:43.184293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:43.184293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:43.184293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:43.184293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:43.184293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:43.184293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:43.184293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:43.184293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:43.184293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:43.184293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:43.184293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:43.185185 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:16:43.185185 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:16:43.185185 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:43.185185 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:16:43.189348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 629/1237] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:16:43.190300 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398dfc29-34ab-4b79-8bd9-9a283f652db5 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:43.298823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398dfc29-34ab-4b79-8bd9-9a283f652db5 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:43.308704 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:43.334171 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4e2cc-a2bc-4299-8868-0eccba5604e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:43.334860 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4e2cc-a2bc-4299-8868-0eccba5604e4 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:43.335145 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4e2cc-a2bc-4299-8868-0eccba5604e4 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:43.335419 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c4e2cc-a2bc-4299-8868-0eccba5604e4 None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:43.336179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4e2cc-a2bc-4299-8868-0eccba5604e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:43.336485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4e2cc-a2bc-4299-8868-0eccba5604e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:43.337863 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c4e2cc-a2bc-4299-8868-0eccba5604e4 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:43.351286 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 609/1238] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:43.357044 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112eaa4-1abf-4da5-bce1-d3d1d354d7ad None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:43.465057 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b112eaa4-1abf-4da5-bce1-d3d1d354d7ad None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:43.502347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71a58c-ea92-4a3e-9e3f-27f13f6d62b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:43.503166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71a58c-ea92-4a3e-9e3f-27f13f6d62b9 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:43.503451 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71a58c-ea92-4a3e-9e3f-27f13f6d62b9 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:43.503763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b71a58c-ea92-4a3e-9e3f-27f13f6d62b9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:43.506960 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:43.513222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71a58c-ea92-4a3e-9e3f-27f13f6d62b9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:43.514828 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b71a58c-ea92-4a3e-9e3f-27f13f6d62b9 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:43.532334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-3b71a58c-ea92-4a3e-9e3f-27f13f6d62b9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:16:43.532334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:43.532334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:43.532334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:43.532334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:43.532334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:43.532334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:43.532334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:43.532334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:43.532334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:43.532334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:43.532334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:43.532334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:16:43.532334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:16:43.532334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:16:43.532334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:16:43.534038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:43.534038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:43.534038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:16:43.534038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:16:43.534038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:16:43.534038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:16:43.534038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:43.534038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:43.534038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:43.534038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:43.534038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:43.534038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:43.534038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:43.534038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:43.534038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:43.534038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:43.534038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:43.534038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:43.535215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:43.535215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:43.535215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:16:43.535215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:16:43.535215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:16:43.535215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:16:43.535215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:16:43.535215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:16:43.535215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:16:43.535215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:16:43.535215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 630/1239] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:16:43 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:43.540428 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4e2cc-a2bc-4299-8868-0eccba5604e4 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:43.653478 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c4e2cc-a2bc-4299-8868-0eccba5604e4 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:43.690131 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56341580-d22a-4a1a-b9f1-b1f6802044b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:43.691731 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56341580-d22a-4a1a-b9f1-b1f6802044b4 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:43.691731 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56341580-d22a-4a1a-b9f1-b1f6802044b4 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:43.691731 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56341580-d22a-4a1a-b9f1-b1f6802044b4 None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:43.692349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56341580-d22a-4a1a-b9f1-b1f6802044b4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:43.692662 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56341580-d22a-4a1a-b9f1-b1f6802044b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:43.695149 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56341580-d22a-4a1a-b9f1-b1f6802044b4 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:43.717047 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 610/1240] 10.222.0.44 () {56 vars in 1143 bytes} [Thu Jun 16 00:16:43 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:43.723027 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71a58c-ea92-4a3e-9e3f-27f13f6d62b9 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:43.846219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b71a58c-ea92-4a3e-9e3f-27f13f6d62b9 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:43.884866 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508295e-9dc9-474e-b333-fdbdf3900bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:43.885517 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508295e-9dc9-474e-b333-fdbdf3900bb1 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:43.885802 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508295e-9dc9-474e-b333-fdbdf3900bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:43.886084 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7508295e-9dc9-474e-b333-fdbdf3900bb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:43.959570 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:43.968380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7508295e-9dc9-474e-b333-fdbdf3900bb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:43.970420 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7508295e-9dc9-474e-b333-fdbdf3900bb1 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:44.084795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 631/1241] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:16:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:16:44.090788 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56341580-d22a-4a1a-b9f1-b1f6802044b4 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:44.117868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:44.191592 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56341580-d22a-4a1a-b9f1-b1f6802044b4 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:44.230856 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ba43f-913f-45b4-beca-b0486fa8e8d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:44.231689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ba43f-913f-45b4-beca-b0486fa8e8d9 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:44.231979 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ba43f-913f-45b4-beca-b0486fa8e8d9 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:44.232255 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ba43f-913f-45b4-beca-b0486fa8e8d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:44.243192 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ba43f-913f-45b4-beca-b0486fa8e8d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:44.244692 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ba43f-913f-45b4-beca-b0486fa8e8d9 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:44.264883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-066ba43f-913f-45b4-beca-b0486fa8e8d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:44.264883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:44.264883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:44.264883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:44.264883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:44.264883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:44.264883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:44.264883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:44.264883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:44.264883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:44.264883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:44.264883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:44.264883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:16:44.264883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:16:44.264883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:16:44.266216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:16:44.266216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:44.266216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:44.266216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:44.266216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:44.266216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:44.266216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:44.266216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:44.266216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:44.266216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:44.266216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:44.266216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:44.266216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:44.266216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:44.266216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:44.266216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:44.266216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:44.267117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:16:44.267117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:16:44.267117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:44.267117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:16:44.267117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 611/1242] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:44.272501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508295e-9dc9-474e-b333-fdbdf3900bb1 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:44.374733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:44.381557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7508295e-9dc9-474e-b333-fdbdf3900bb1 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:44.418529 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eec23f-7cf5-4c10-aa57-ca0fa7320e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:44.419201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eec23f-7cf5-4c10-aa57-ca0fa7320e18 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:44.419494 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eec23f-7cf5-4c10-aa57-ca0fa7320e18 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:44.419804 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eec23f-7cf5-4c10-aa57-ca0fa7320e18 None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:44.420520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eec23f-7cf5-4c10-aa57-ca0fa7320e18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:44.420885 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eec23f-7cf5-4c10-aa57-ca0fa7320e18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:44.422355 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eec23f-7cf5-4c10-aa57-ca0fa7320e18 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:44.444056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 632/1243] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:44.445866 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ba43f-913f-45b4-beca-b0486fa8e8d9 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:44.544384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:44.578575 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ba43f-913f-45b4-beca-b0486fa8e8d9 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:44.622633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a068ef-45f7-40d6-a97e-9cbc932e1865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:44.623382 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a068ef-45f7-40d6-a97e-9cbc932e1865 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:44.623698 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a068ef-45f7-40d6-a97e-9cbc932e1865 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:44.624260 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a068ef-45f7-40d6-a97e-9cbc932e1865 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:44.632839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a068ef-45f7-40d6-a97e-9cbc932e1865 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:44.634290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a068ef-45f7-40d6-a97e-9cbc932e1865 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:44.649272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-c8a068ef-45f7-40d6-a97e-9cbc932e1865 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:16:44.649272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:44.649272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:44.649272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:44.649272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:44.649272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:44.649272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:44.649272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:44.649272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:44.649272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:44.649272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:44.649272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:44.649272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:16:44.649272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:16:44.649272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:16:44.650446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:16:44.650446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:44.650446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:44.650446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:44.650446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:44.650446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:44.650446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:44.650446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:44.650446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:44.650446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:44.650446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:44.650446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:44.650446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:44.650446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:44.650446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:44.650446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:44.650446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:44.651679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:16:44.651679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:16:44.651679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:16:44.651679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:16:44.651679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:16:44.651679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:16:44.651679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:16:44.651679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:16:44.651679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 612/1244] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:16:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:44.656613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eec23f-7cf5-4c10-aa57-ca0fa7320e18 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:44.764446 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eec23f-7cf5-4c10-aa57-ca0fa7320e18 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:44.803688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfb6c8-2723-405f-a33e-3a7e57fadbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:44.804896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfb6c8-2723-405f-a33e-3a7e57fadbf7 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:44.805165 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfb6c8-2723-405f-a33e-3a7e57fadbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:44.805441 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfb6c8-2723-405f-a33e-3a7e57fadbf7 None admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:44.806254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfb6c8-2723-405f-a33e-3a7e57fadbf7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:44.806564 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfb6c8-2723-405f-a33e-3a7e57fadbf7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:44.808019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cfb6c8-2723-405f-a33e-3a7e57fadbf7 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:44.820885 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 633/1245] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:16:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:44.828351 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a068ef-45f7-40d6-a97e-9cbc932e1865 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:44.943435 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a068ef-45f7-40d6-a97e-9cbc932e1865 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:44.981330 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ec1dd4-2acc-4784-92c8-7e5a2e70cf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:44.981989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec1dd4-2acc-4784-92c8-7e5a2e70cf2f None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:44.982282 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec1dd4-2acc-4784-92c8-7e5a2e70cf2f None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:44.982557 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ec1dd4-2acc-4784-92c8-7e5a2e70cf2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:44.983380 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec1dd4-2acc-4784-92c8-7e5a2e70cf2f None admin] RBAC: Adding query filter params (role.id=338a913607974d379aad3249b3d0402d, scope.project.id=320d79ecbc2342af8031103e7308c10d, user.id=9164f14fe6894daba1a9f2d8f1f4929c) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:44.983718 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec1dd4-2acc-4784-92c8-7e5a2e70cf2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:44.985190 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ec1dd4-2acc-4784-92c8-7e5a2e70cf2f None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:44.991365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 613/1246] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:16:44 2022] GET /identity/v3/role_assignments?user.id=9164f14fe6894daba1a9f2d8f1f4929c&scope.project.id=320d79ecbc2342af8031103e7308c10d&role.id=338a913607974d379aad3249b3d0402d => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:47.244812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cb3e2-1de1-4b4e-bc47-157487c72aa2 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:47.245375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cb3e2-1de1-4b4e-bc47-157487c72aa2 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:47.245375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7cb3e2-1de1-4b4e-bc47-157487c72aa2 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:47.246946 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 634/1247] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:16:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:47.253014 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6ed92-2c5d-46ef-af1c-8557abb3fab9 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:47.253467 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6ed92-2c5d-46ef-af1c-8557abb3fab9 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:47.254130 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6ed92-2c5d-46ef-af1c-8557abb3fab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:47.261960 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:47.275785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-37a6ed92-2c5d-46ef-af1c-8557abb3fab9 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:47.277156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-37a6ed92-2c5d-46ef-af1c-8557abb3fab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:47.355083 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 614/1248] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:16:47.378603 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7cb3e2-1de1-4b4e-bc47-157487c72aa2 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:47.400876 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:47.498245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7cb3e2-1de1-4b4e-bc47-157487c72aa2 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:47.534839 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7563d-8b78-4ffb-b5bf-f353971aea87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:47.535590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7563d-8b78-4ffb-b5bf-f353971aea87 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:47.535903 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7563d-8b78-4ffb-b5bf-f353971aea87 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:47.536181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7563d-8b78-4ffb-b5bf-f353971aea87 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:47.546600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7563d-8b78-4ffb-b5bf-f353971aea87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:16:47.554219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-67f7563d-8b78-4ffb-b5bf-f353971aea87 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:16:47.554219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:47.554219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:47.554219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:47.554219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:47.554219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:47.554219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:47.554219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:47.554219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:47.554219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:47.554219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:47.554219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:47.554219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:16:47.554219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:16:47.554219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:16:47.554219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:16:47.555314 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:16:47.555314 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:16:47.555314 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:16:47.555314 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:16:47.555314 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:47.555314 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:47.555314 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:47.555314 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:47.555314 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:47.555314 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:47.555314 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:47.555314 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:47.555314 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:47.555314 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:47.555314 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:47.555314 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:47.556344 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:47.556344 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:47.556344 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:47.556344 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:47.556344 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:16:47.556344 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:16:47.556344 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:16:47.556344 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:16:47.556344 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:16:47.556344 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:16:47.556344 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:16:47.556344 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:16:47.556344 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 635/1249] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:16:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:47.562899 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6ed92-2c5d-46ef-af1c-8557abb3fab9 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:47.679084 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6ed92-2c5d-46ef-af1c-8557abb3fab9 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:47.709906 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:47.715355 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee8972-124e-464f-a71a-a2fa08c6dc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:47.716057 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee8972-124e-464f-a71a-a2fa08c6dc38 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:47.716341 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee8972-124e-464f-a71a-a2fa08c6dc38 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:47.716618 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee8972-124e-464f-a71a-a2fa08c6dc38 None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:47.717361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee8972-124e-464f-a71a-a2fa08c6dc38 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:47.717669 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee8972-124e-464f-a71a-a2fa08c6dc38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:47.719050 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee8972-124e-464f-a71a-a2fa08c6dc38 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:47.727949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 615/1250] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:16:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:47.734136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7563d-8b78-4ffb-b5bf-f353971aea87 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:47.823723 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:47.851078 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7563d-8b78-4ffb-b5bf-f353971aea87 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:47.887150 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d94d9c-8340-4f0c-856a-97b0cd6392e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:47.887998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d94d9c-8340-4f0c-856a-97b0cd6392e1 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:47.888285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d94d9c-8340-4f0c-856a-97b0cd6392e1 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:47.888576 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d94d9c-8340-4f0c-856a-97b0cd6392e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:47.899630 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d94d9c-8340-4f0c-856a-97b0cd6392e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:47.901112 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d94d9c-8340-4f0c-856a-97b0cd6392e1 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:47.921338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-a0d94d9c-8340-4f0c-856a-97b0cd6392e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:47.921338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:47.921338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:47.921338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:47.921338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:47.921338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:47.921338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:47.921338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:47.921338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:47.921338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:47.921338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:47.921338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:47.921338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:16:47.921338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:16:47.921338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:16:47.922275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:16:47.922275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:47.922275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:47.922275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:47.922275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:47.922275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:47.922275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:47.922275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:47.922275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:47.922275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:47.922275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:47.922275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:47.922275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:47.922275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:47.922275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:47.922275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:47.922275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:47.923200 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:16:47.923200 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:16:47.923200 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:47.923200 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:16:47.923200 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 636/1251] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:16:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:47.928808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee8972-124e-464f-a71a-a2fa08c6dc38 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:48.032508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee8972-124e-464f-a71a-a2fa08c6dc38 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:48.075247 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c6a19-50b0-4e10-a619-5a8b379662a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:48.075854 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c6a19-50b0-4e10-a619-5a8b379662a7 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:48.076145 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c6a19-50b0-4e10-a619-5a8b379662a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:48.076453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7c6a19-50b0-4e10-a619-5a8b379662a7 None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:48.077146 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c6a19-50b0-4e10-a619-5a8b379662a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:48.077461 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c6a19-50b0-4e10-a619-5a8b379662a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:48.078850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7c6a19-50b0-4e10-a619-5a8b379662a7 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:48.091645 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 616/1252] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:48.097577 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d94d9c-8340-4f0c-856a-97b0cd6392e1 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:48.210827 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d94d9c-8340-4f0c-856a-97b0cd6392e1 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:48.239047 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:48.249324 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a72451-66c7-41ef-bb61-541e3ecbb9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:48.250347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a72451-66c7-41ef-bb61-541e3ecbb9f1 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:48.250641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a72451-66c7-41ef-bb61-541e3ecbb9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:48.250921 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a72451-66c7-41ef-bb61-541e3ecbb9f1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:48.260357 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a72451-66c7-41ef-bb61-541e3ecbb9f1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:48.262003 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a72451-66c7-41ef-bb61-541e3ecbb9f1 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:48.279191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-b8a72451-66c7-41ef-bb61-541e3ecbb9f1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:16:48.279191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:48.279191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:48.279191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:48.279191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:48.279191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:48.279191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:48.279191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:48.279191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:48.279191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:48.279191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:48.279191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:48.279191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:16:48.279191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:16:48.279191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:16:48.279191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:16:48.280415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:48.280415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:48.280415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:16:48.280415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:16:48.280415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:16:48.280415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:16:48.280415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:48.280415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:48.280415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:48.280415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:48.280415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:48.280415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:48.280415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:48.280415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:48.280415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:48.280415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:48.280415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:48.280415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:48.281799 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:48.281799 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:48.281799 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:16:48.281799 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:16:48.281799 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:16:48.281799 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:16:48.281799 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:16:48.281799 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:16:48.281799 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:16:48.281799 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:16:48.281799 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 637/1253] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:16:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:48.286655 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c6a19-50b0-4e10-a619-5a8b379662a7 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:48.348524 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:48.401704 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7c6a19-50b0-4e10-a619-5a8b379662a7 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:48.436624 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a2afe-6ee6-46cf-8927-7428fad8c6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:48.437302 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a2afe-6ee6-46cf-8927-7428fad8c6aa None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:48.437589 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a2afe-6ee6-46cf-8927-7428fad8c6aa None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:48.437928 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2a2afe-6ee6-46cf-8927-7428fad8c6aa None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:48.438723 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a2afe-6ee6-46cf-8927-7428fad8c6aa None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:48.439014 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a2afe-6ee6-46cf-8927-7428fad8c6aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:48.440481 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2a2afe-6ee6-46cf-8927-7428fad8c6aa None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:48.457784 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 617/1254] 10.222.0.44 () {56 vars in 1143 bytes} [Thu Jun 16 00:16:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:48.463549 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a72451-66c7-41ef-bb61-541e3ecbb9f1 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:48.569143 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a72451-66c7-41ef-bb61-541e3ecbb9f1 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:48.608449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda44e98-c9a9-4cd8-9943-70a76d90398b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:48.609224 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda44e98-c9a9-4cd8-9943-70a76d90398b None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:48.609509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda44e98-c9a9-4cd8-9943-70a76d90398b None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:48.609866 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda44e98-c9a9-4cd8-9943-70a76d90398b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:48.672680 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:48.686386 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda44e98-c9a9-4cd8-9943-70a76d90398b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:48.687902 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda44e98-c9a9-4cd8-9943-70a76d90398b None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:48.793453 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 638/1255] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:16:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 16 00:16:48.799456 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a2afe-6ee6-46cf-8927-7428fad8c6aa None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:48.900744 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2a2afe-6ee6-46cf-8927-7428fad8c6aa None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:48.914851 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:48.939841 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b097d-e84b-40b2-ac02-4775366ef188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:48.940733 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b097d-e84b-40b2-ac02-4775366ef188 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:48.941017 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b097d-e84b-40b2-ac02-4775366ef188 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:48.941330 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2b097d-e84b-40b2-ac02-4775366ef188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:48.952668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b097d-e84b-40b2-ac02-4775366ef188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:48.954126 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2b097d-e84b-40b2-ac02-4775366ef188 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:48.971874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-ea2b097d-e84b-40b2-ac02-4775366ef188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:48.971874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:48.971874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:48.971874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:48.971874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:48.971874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:48.971874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:48.971874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:48.971874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:48.971874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:48.971874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:48.971874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:48.971874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:16:48.971874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:16:48.971874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:16:48.972808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:16:48.972808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:48.972808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:48.972808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:48.972808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:48.972808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:48.972808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:48.972808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:48.972808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:48.972808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:48.972808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:48.972808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:48.972808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:48.972808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:48.972808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:48.972808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:48.972808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:48.973747 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:16:48.973747 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:16:48.973747 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:48.973747 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:16:48.973747 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 618/1256] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:48.979029 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda44e98-c9a9-4cd8-9943-70a76d90398b None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:49.072323 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:49.085962 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda44e98-c9a9-4cd8-9943-70a76d90398b None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:49.122509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd801c1-56e3-4e1d-b9c9-86b15e5922fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:49.123177 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd801c1-56e3-4e1d-b9c9-86b15e5922fb None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:49.123776 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd801c1-56e3-4e1d-b9c9-86b15e5922fb None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:49.124077 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd801c1-56e3-4e1d-b9c9-86b15e5922fb None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:49.124875 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd801c1-56e3-4e1d-b9c9-86b15e5922fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:49.125253 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd801c1-56e3-4e1d-b9c9-86b15e5922fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:49.126780 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd801c1-56e3-4e1d-b9c9-86b15e5922fb None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:49.139356 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 639/1257] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:49.145161 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b097d-e84b-40b2-ac02-4775366ef188 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:49.253549 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2b097d-e84b-40b2-ac02-4775366ef188 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:49.293335 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123717c-205d-473b-a854-5f3047c11b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:49.294141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123717c-205d-473b-a854-5f3047c11b95 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:49.294424 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123717c-205d-473b-a854-5f3047c11b95 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:49.294700 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123717c-205d-473b-a854-5f3047c11b95 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:49.303027 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123717c-205d-473b-a854-5f3047c11b95 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:49.304558 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123717c-205d-473b-a854-5f3047c11b95 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:49.319291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-f123717c-205d-473b-a854-5f3047c11b95 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:16:49.319291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:49.319291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:49.319291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:49.319291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:49.319291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:49.319291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:49.319291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:49.319291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:49.319291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:49.319291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:49.319291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:49.319291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:16:49.319291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:16:49.319291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:16:49.320489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:16:49.320489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:49.320489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:49.320489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:49.320489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:49.320489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:49.320489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:49.320489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:49.320489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:49.320489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:49.320489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:49.320489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:49.320489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:49.320489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:49.320489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:49.320489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:49.320489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:49.326327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:16:49.326327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:16:49.326327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:16:49.326327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:16:49.326327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:16:49.326327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:16:49.326327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:16:49.326327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:16:49.326327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 619/1258] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:16:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:49.326837 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd801c1-56e3-4e1d-b9c9-86b15e5922fb None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:49.432683 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd801c1-56e3-4e1d-b9c9-86b15e5922fb None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:49.467676 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff5be01-360c-4e64-8130-f5593d991407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:49.468360 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5be01-360c-4e64-8130-f5593d991407 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:49.468649 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5be01-360c-4e64-8130-f5593d991407 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:49.468938 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff5be01-360c-4e64-8130-f5593d991407 None admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:49.469743 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5be01-360c-4e64-8130-f5593d991407 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:49.470060 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5be01-360c-4e64-8130-f5593d991407 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:49.471518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff5be01-360c-4e64-8130-f5593d991407 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:49.485220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 640/1259] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:16:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:49.491518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123717c-205d-473b-a854-5f3047c11b95 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:49.520691 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:49.612214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123717c-205d-473b-a854-5f3047c11b95 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:49.648887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37c2dda-ff1c-4302-9882-d9db805e252c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:49.649553 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c2dda-ff1c-4302-9882-d9db805e252c None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:49.649860 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c2dda-ff1c-4302-9882-d9db805e252c None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:49.650138 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37c2dda-ff1c-4302-9882-d9db805e252c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:49.650971 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c2dda-ff1c-4302-9882-d9db805e252c None admin] RBAC: Adding query filter params (role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab, scope.project.id=320d79ecbc2342af8031103e7308c10d, user.id=9164f14fe6894daba1a9f2d8f1f4929c) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:49.651285 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c2dda-ff1c-4302-9882-d9db805e252c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:49.652782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37c2dda-ff1c-4302-9882-d9db805e252c None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:49.659015 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 620/1260] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:16:49 2022] GET /identity/v3/role_assignments?user.id=9164f14fe6894daba1a9f2d8f1f4929c&scope.project.id=320d79ecbc2342af8031103e7308c10d&role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:16:51.732700 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e14eef-92ec-484c-88ff-e41591cc1d9a None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:51.733231 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e14eef-92ec-484c-88ff-e41591cc1d9a None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:51.733350 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e14eef-92ec-484c-88ff-e41591cc1d9a None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:51.734626 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 641/1261] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:51.740186 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3fe2f-4110-4cf4-84cd-77309d866d48 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:51.740599 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3fe2f-4110-4cf4-84cd-77309d866d48 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:51.740743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb3fe2f-4110-4cf4-84cd-77309d866d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:51.758041 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-5cb3fe2f-4110-4cf4-84cd-77309d866d48 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:51.759350 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-5cb3fe2f-4110-4cf4-84cd-77309d866d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:51.823997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 621/1262] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:16:51.846089 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e14eef-92ec-484c-88ff-e41591cc1d9a None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:51.856664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:51.946028 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e14eef-92ec-484c-88ff-e41591cc1d9a None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:51.978525 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8809cb5-94c3-4a38-980a-126cd2ba4f85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:51.979296 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8809cb5-94c3-4a38-980a-126cd2ba4f85 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:51.979580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8809cb5-94c3-4a38-980a-126cd2ba4f85 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:51.979886 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8809cb5-94c3-4a38-980a-126cd2ba4f85 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:51.990265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8809cb5-94c3-4a38-980a-126cd2ba4f85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:16:51.997652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-c8809cb5-94c3-4a38-980a-126cd2ba4f85 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:16:51.997652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:51.997652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:51.997652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:51.997652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:51.997652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:51.997652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:51.997652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:51.997652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:51.997652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:51.997652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:51.997652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:51.997652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:16:51.997652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:16:51.997652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:16:51.997652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:16:51.998989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:16:51.998989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:16:51.998989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:16:51.998989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:16:51.998989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:51.998989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:51.998989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:51.998989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:51.998989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:51.998989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:51.998989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:51.998989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:51.998989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:51.998989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:51.998989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:51.998989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:52.000227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:52.000227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:52.000227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:52.000227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:52.000227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:16:52.000227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:16:52.000227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:16:52.000227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:16:52.000227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:16:52.000227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:16:52.000227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:16:52.000227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:16:52.000227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 642/1263] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:16:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:52.004975 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3fe2f-4110-4cf4-84cd-77309d866d48 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:52.023075 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:52.101310 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb3fe2f-4110-4cf4-84cd-77309d866d48 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:52.133754 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132490c7-db6e-4c98-ba59-abb7eee57364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:52.134399 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132490c7-db6e-4c98-ba59-abb7eee57364 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:52.134677 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132490c7-db6e-4c98-ba59-abb7eee57364 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:52.134947 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132490c7-db6e-4c98-ba59-abb7eee57364 None admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:52.135702 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132490c7-db6e-4c98-ba59-abb7eee57364 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:52.136009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132490c7-db6e-4c98-ba59-abb7eee57364 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:52.137368 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132490c7-db6e-4c98-ba59-abb7eee57364 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:52.145099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 622/1264] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:16:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:16:52.150560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8809cb5-94c3-4a38-980a-126cd2ba4f85 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:52.213943 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:52.246745 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8809cb5-94c3-4a38-980a-126cd2ba4f85 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:52.278246 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedc4f0-7890-4752-b8c4-26fba7e95454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:52.279012 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedc4f0-7890-4752-b8c4-26fba7e95454 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:52.279292 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedc4f0-7890-4752-b8c4-26fba7e95454 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:52.279565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedc4f0-7890-4752-b8c4-26fba7e95454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:52.290337 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fedc4f0-7890-4752-b8c4-26fba7e95454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:52.291848 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fedc4f0-7890-4752-b8c4-26fba7e95454 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:52.308283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-9fedc4f0-7890-4752-b8c4-26fba7e95454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:52.308283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:52.308283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:52.308283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:52.308283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:52.308283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:52.308283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:52.308283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:52.308283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:52.308283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:52.308283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:52.308283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:52.308283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:16:52.308283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:16:52.308283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:16:52.309305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:16:52.309305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:52.309305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:52.309305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:52.309305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:52.309305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:52.309305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:52.309305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:52.309305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:52.309305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:52.309305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:52.309305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:52.309305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:52.309305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:52.309305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:52.309305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:52.309305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:52.310530 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:16:52.310530 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:16:52.310530 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:52.310530 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:16:52.310530 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 643/1265] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:52.314943 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132490c7-db6e-4c98-ba59-abb7eee57364 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:52.393892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:52.412937 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132490c7-db6e-4c98-ba59-abb7eee57364 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:52.445661 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc14ad-e933-4b2f-ab08-63e5f24c77d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:52.446308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc14ad-e933-4b2f-ab08-63e5f24c77d0 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:52.446596 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc14ad-e933-4b2f-ab08-63e5f24c77d0 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:52.446876 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc14ad-e933-4b2f-ab08-63e5f24c77d0 None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:52.447594 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc14ad-e933-4b2f-ab08-63e5f24c77d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:52.447945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc14ad-e933-4b2f-ab08-63e5f24c77d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:52.449349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc14ad-e933-4b2f-ab08-63e5f24c77d0 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:52.460681 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 623/1266] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:52.466111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedc4f0-7890-4752-b8c4-26fba7e95454 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:52.564973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedc4f0-7890-4752-b8c4-26fba7e95454 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:52.588790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:52.606751 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba588b-e36d-4fa2-a742-d041502fd601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:52.607794 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba588b-e36d-4fa2-a742-d041502fd601 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:52.608110 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba588b-e36d-4fa2-a742-d041502fd601 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:52.608353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba588b-e36d-4fa2-a742-d041502fd601 None admin] PATH_INFO: `/v3/users/placement` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:52.616958 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba588b-e36d-4fa2-a742-d041502fd601 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:52.618367 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba588b-e36d-4fa2-a742-d041502fd601 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:52.633663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-50ba588b-e36d-4fa2-a742-d041502fd601 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:16:52.633663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:52.633663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:52.633663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:52.633663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:52.633663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:52.633663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:52.633663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:52.633663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:52.633663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:52.633663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:52.633663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:52.633663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:16:52.633663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:16:52.633663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:16:52.633663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:16:52.634791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:52.634791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:52.634791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:16:52.634791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:16:52.634791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:16:52.634791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:16:52.634791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:52.634791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:52.634791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:52.634791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:52.634791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:52.634791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:52.634791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:52.634791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:52.634791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:52.634791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:52.634791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:52.634791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:52.636083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:52.636083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:52.636083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:16:52.636083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:16:52.636083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:16:52.636083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:16:52.636083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:16:52.636083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:16:52.636083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:16:52.636083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:16:52.636083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 644/1267] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:16:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:52.640685 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc14ad-e933-4b2f-ab08-63e5f24c77d0 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:52.738697 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc14ad-e933-4b2f-ab08-63e5f24c77d0 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:52.772077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42c597-f039-47be-be33-d1b231362f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:52.772739 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42c597-f039-47be-be33-d1b231362f43 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:52.773023 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42c597-f039-47be-be33-d1b231362f43 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:52.773297 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42c597-f039-47be-be33-d1b231362f43 None admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:52.774119 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42c597-f039-47be-be33-d1b231362f43 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:52.774427 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42c597-f039-47be-be33-d1b231362f43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:52.775871 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c42c597-f039-47be-be33-d1b231362f43 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:52.784217 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:52.793704 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 624/1268] 10.222.0.44 () {56 vars in 1143 bytes} [Thu Jun 16 00:16:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:52.799801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba588b-e36d-4fa2-a742-d041502fd601 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:52.896600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba588b-e36d-4fa2-a742-d041502fd601 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:52.929258 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c557301-0ea1-4c60-a4fe-b115836420a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:52.930031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c557301-0ea1-4c60-a4fe-b115836420a0 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:52.930314 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c557301-0ea1-4c60-a4fe-b115836420a0 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:52.930596 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c557301-0ea1-4c60-a4fe-b115836420a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:52.940916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c557301-0ea1-4c60-a4fe-b115836420a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:52.942346 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c557301-0ea1-4c60-a4fe-b115836420a0 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:52.959914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-8c557301-0ea1-4c60-a4fe-b115836420a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:52.959914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:52.959914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:52.959914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:52.959914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:52.959914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:52.959914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:52.959914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:52.959914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:52.959914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:52.959914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:52.959914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:52.959914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:16:52.959914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:16:52.959914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:16:52.960976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:16:52.960976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:52.960976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:52.960976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:52.960976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:52.960976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:52.960976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:52.960976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:52.960976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:52.960976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:52.960976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:52.960976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:52.960976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:52.960976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:52.960976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:52.960976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:52.960976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:52.962103 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:16:52.962103 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:16:52.962103 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:52.962103 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:16:52.962103 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 645/1269] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:52.966670 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42c597-f039-47be-be33-d1b231362f43 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:53.062085 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42c597-f039-47be-be33-d1b231362f43 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:53.094669 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56250e1-f38d-4b8a-a306-c341d4310134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:53.095305 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56250e1-f38d-4b8a-a306-c341d4310134 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:53.095582 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56250e1-f38d-4b8a-a306-c341d4310134 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:53.095877 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56250e1-f38d-4b8a-a306-c341d4310134 None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:53.096580 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56250e1-f38d-4b8a-a306-c341d4310134 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:53.096882 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56250e1-f38d-4b8a-a306-c341d4310134 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:53.098233 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56250e1-f38d-4b8a-a306-c341d4310134 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:53.108932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 625/1270] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:16:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:53.114416 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c557301-0ea1-4c60-a4fe-b115836420a0 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:53.145488 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:53.212217 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c557301-0ea1-4c60-a4fe-b115836420a0 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:53.244868 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826572a2-a9fc-4192-995b-744daf299579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:53.245656 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826572a2-a9fc-4192-995b-744daf299579 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:53.245944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826572a2-a9fc-4192-995b-744daf299579 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:53.246224 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826572a2-a9fc-4192-995b-744daf299579 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:53.252940 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826572a2-a9fc-4192-995b-744daf299579 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:53.254375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826572a2-a9fc-4192-995b-744daf299579 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:53.268690 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-826572a2-a9fc-4192-995b-744daf299579 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:16:53.268690 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:53.268690 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:53.268690 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:53.268690 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:53.268690 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:53.268690 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:53.268690 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:53.268690 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:53.268690 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:53.268690 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:53.268690 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:53.268690 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:16:53.268690 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:16:53.268690 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:16:53.269727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:16:53.269727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:53.269727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:53.269727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:53.269727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:53.269727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:53.269727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:53.269727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:53.269727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:53.269727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:53.269727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:53.269727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:53.269727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:53.269727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:53.269727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:53.269727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:53.269727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:53.270835 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:16:53.270835 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:16:53.270835 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:16:53.270835 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:16:53.270835 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:16:53.270835 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:16:53.270835 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:16:53.270835 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:16:53.270835 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 646/1271] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:16:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:53.275754 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56250e1-f38d-4b8a-a306-c341d4310134 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:53.332696 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:53.373856 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56250e1-f38d-4b8a-a306-c341d4310134 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:53.405917 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897119b-42da-4b6b-b109-d434b82843aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:53.406564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897119b-42da-4b6b-b109-d434b82843aa None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:53.406846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897119b-42da-4b6b-b109-d434b82843aa None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:53.407125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897119b-42da-4b6b-b109-d434b82843aa None admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:53.407931 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897119b-42da-4b6b-b109-d434b82843aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:53.408242 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897119b-42da-4b6b-b109-d434b82843aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:53.409665 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897119b-42da-4b6b-b109-d434b82843aa None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:53.421089 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 626/1272] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:16:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:53.427426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826572a2-a9fc-4192-995b-744daf299579 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:53.516813 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:53.525585 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826572a2-a9fc-4192-995b-744daf299579 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:53.559222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6deb62-e50b-43f8-b1c8-2d61a51563fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:53.560184 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6deb62-e50b-43f8-b1c8-2d61a51563fa None admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:53.560423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6deb62-e50b-43f8-b1c8-2d61a51563fa None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:53.560705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6deb62-e50b-43f8-b1c8-2d61a51563fa None admin] PATH_INFO: `/v3/projects/320d79ecbc2342af8031103e7308c10d/users/9164f14fe6894daba1a9f2d8f1f4929c/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:53.562931 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6deb62-e50b-43f8-b1c8-2d61a51563fa None admin] RBAC: Authorizing `identity:create_grant(project_id=320d79ecbc2342af8031103e7308c10d, user_id=9164f14fe6894daba1a9f2d8f1f4929c, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:53.564472 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6deb62-e50b-43f8-b1c8-2d61a51563fa None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:53.577980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 647/1273] 10.222.0.44 () {58 vars in 1439 bytes} [Thu Jun 16 00:16:53 2022] PUT /identity/v3/projects/320d79ecbc2342af8031103e7308c10d/users/9164f14fe6894daba1a9f2d8f1f4929c/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:16:55.652488 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6908460-d1c8-4e42-a410-f5d64d7fb51b None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:55.653035 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6908460-d1c8-4e42-a410-f5d64d7fb51b None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:55.653035 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6908460-d1c8-4e42-a410-f5d64d7fb51b None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:55.654404 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 627/1274] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:55.659560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db52a60-1517-45f7-aea1-8249c196495d None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:55.659955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db52a60-1517-45f7-aea1-8249c196495d None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:55.660160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db52a60-1517-45f7-aea1-8249c196495d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:55.676435 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-8db52a60-1517-45f7-aea1-8249c196495d None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:55.678145 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-8db52a60-1517-45f7-aea1-8249c196495d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:55.743104 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 648/1275] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:16:55.769212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6908460-d1c8-4e42-a410-f5d64d7fb51b None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:55.869261 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6908460-d1c8-4e42-a410-f5d64d7fb51b None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:55.886514 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:55.903411 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d959923-87f2-4377-9ef3-fda51ddf5080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:55.904161 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d959923-87f2-4377-9ef3-fda51ddf5080 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:55.904442 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d959923-87f2-4377-9ef3-fda51ddf5080 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:55.904716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d959923-87f2-4377-9ef3-fda51ddf5080 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:55.914506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d959923-87f2-4377-9ef3-fda51ddf5080 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 16 00:16:55.922086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-1d959923-87f2-4377-9ef3-fda51ddf5080 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:16:55.922086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:55.922086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:55.922086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:55.922086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:55.922086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:55.922086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:55.922086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:55.922086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:55.922086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:55.922086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:55.922086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:55.922086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 16 00:16:55.922086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 16 00:16:55.922086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 16 00:16:55.922086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 16 00:16:55.923165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 16 00:16:55.923165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 16 00:16:55.923165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 16 00:16:55.923165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 16 00:16:55.923165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:55.923165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:55.923165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:55.923165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:55.923165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:55.923165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:55.923165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:55.923165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:55.923165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:55.923165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:55.923165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:55.923165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:55.924243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:55.924243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:55.924243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:55.924243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:55.924243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 16 00:16:55.924243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 16 00:16:55.924243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 16 00:16:55.924243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 16 00:16:55.924243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 16 00:16:55.924243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 16 00:16:55.924243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 16 00:16:55.924243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:16:55.924243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 628/1276] 10.222.0.44 () {56 vars in 1096 bytes} [Thu Jun 16 00:16:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:55.929276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db52a60-1517-45f7-aea1-8249c196495d None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:56.011835 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:56.030657 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db52a60-1517-45f7-aea1-8249c196495d None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:56.062845 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85e5f1-83b4-4f35-bfe6-a2dbfebb9b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:56.063497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85e5f1-83b4-4f35-bfe6-a2dbfebb9b01 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:56.063807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85e5f1-83b4-4f35-bfe6-a2dbfebb9b01 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:56.064085 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b85e5f1-83b4-4f35-bfe6-a2dbfebb9b01 None admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:56.064824 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85e5f1-83b4-4f35-bfe6-a2dbfebb9b01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:56.065131 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85e5f1-83b4-4f35-bfe6-a2dbfebb9b01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:56.066484 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b85e5f1-83b4-4f35-bfe6-a2dbfebb9b01 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:56.074842 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 649/1277] 10.222.0.44 () {56 vars in 1099 bytes} [Thu Jun 16 00:16:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:16:56.080529 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d959923-87f2-4377-9ef3-fda51ddf5080 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:56.177963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d959923-87f2-4377-9ef3-fda51ddf5080 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:56.210213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04716210-e90c-4cd6-9794-f77f5e61c235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:56.210987 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04716210-e90c-4cd6-9794-f77f5e61c235 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:56.211273 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04716210-e90c-4cd6-9794-f77f5e61c235 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:56.211550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04716210-e90c-4cd6-9794-f77f5e61c235 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:56.221719 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04716210-e90c-4cd6-9794-f77f5e61c235 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:56.223167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04716210-e90c-4cd6-9794-f77f5e61c235 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:56.240249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-04716210-e90c-4cd6-9794-f77f5e61c235 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:56.240249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:56.240249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:56.240249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:56.240249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:56.240249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:56.240249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:56.240249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:56.240249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:56.240249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:56.240249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:56.240249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:56.240249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:16:56.240249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:16:56.240249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:16:56.241361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:16:56.241361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:56.241361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:56.241361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:56.241361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:56.241361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:56.241361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:56.241361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:56.241361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:56.241361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:56.241361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:56.241361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:56.241361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:56.241361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:56.241361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:56.241361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:56.241361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:56.242329 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:16:56.242329 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:16:56.242329 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:56.242329 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:16:56.242329 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 629/1278] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:56.247121 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85e5f1-83b4-4f35-bfe6-a2dbfebb9b01 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:56.344516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b85e5f1-83b4-4f35-bfe6-a2dbfebb9b01 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:56.377103 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73e298-2e3b-47b1-9be0-bc3be0dbba14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:56.377748 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73e298-2e3b-47b1-9be0-bc3be0dbba14 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:56.378035 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73e298-2e3b-47b1-9be0-bc3be0dbba14 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:56.378316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e73e298-2e3b-47b1-9be0-bc3be0dbba14 None admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:56.379032 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73e298-2e3b-47b1-9be0-bc3be0dbba14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:56.379345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73e298-2e3b-47b1-9be0-bc3be0dbba14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:56.381269 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e73e298-2e3b-47b1-9be0-bc3be0dbba14 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:56.392661 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 650/1279] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:56.398098 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04716210-e90c-4cd6-9794-f77f5e61c235 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:56.428551 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:56.495826 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04716210-e90c-4cd6-9794-f77f5e61c235 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:56.528327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db23fc-d084-479a-a245-491a6711294d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:56.529108 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db23fc-d084-479a-a245-491a6711294d None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:56.529393 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db23fc-d084-479a-a245-491a6711294d None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:56.529669 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db23fc-d084-479a-a245-491a6711294d None admin] PATH_INFO: `/v3/users/placement` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:56.538145 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db23fc-d084-479a-a245-491a6711294d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:56.539589 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db23fc-d084-479a-a245-491a6711294d None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:56.554087 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-a2db23fc-d084-479a-a245-491a6711294d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:16:56.554087 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:56.554087 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:56.554087 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:56.554087 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:56.554087 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:56.554087 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:56.554087 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:56.554087 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:56.554087 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:56.554087 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:56.554087 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:56.554087 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 16 00:16:56.554087 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 16 00:16:56.554087 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 16 00:16:56.554087 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 16 00:16:56.555354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:56.555354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:56.555354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 16 00:16:56.555354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:16:56.555354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 16 00:16:56.555354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 16 00:16:56.555354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:56.555354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:56.555354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:56.555354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:56.555354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:56.555354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:56.555354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:56.555354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:56.555354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:56.555354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:56.555354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:56.555354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:56.556369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:56.556369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:56.556369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 16 00:16:56.556369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 16 00:16:56.556369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 16 00:16:56.556369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 16 00:16:56.556369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 16 00:16:56.556369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 16 00:16:56.556369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 16 00:16:56.556369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:16:56.556369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 630/1280] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:16:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:56.561901 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73e298-2e3b-47b1-9be0-bc3be0dbba14 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:56.566628 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:56.675410 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e73e298-2e3b-47b1-9be0-bc3be0dbba14 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:56.708609 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b83383-4645-4662-8e2e-73b06a6022e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:56.709271 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b83383-4645-4662-8e2e-73b06a6022e6 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:56.709552 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b83383-4645-4662-8e2e-73b06a6022e6 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:56.709833 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b83383-4645-4662-8e2e-73b06a6022e6 None admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:56.710655 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b83383-4645-4662-8e2e-73b06a6022e6 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:56.710964 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b83383-4645-4662-8e2e-73b06a6022e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:56.712408 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b83383-4645-4662-8e2e-73b06a6022e6 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:56.729191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 651/1281] 10.222.0.44 () {56 vars in 1143 bytes} [Thu Jun 16 00:16:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:56.734931 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db23fc-d084-479a-a245-491a6711294d None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:56.824217 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:56.833833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db23fc-d084-479a-a245-491a6711294d None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:56.866629 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbc0c4-afd4-49a8-8013-90d7acfc4437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:56.867265 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbc0c4-afd4-49a8-8013-90d7acfc4437 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:56.867546 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbc0c4-afd4-49a8-8013-90d7acfc4437 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:56.867848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbc0c4-afd4-49a8-8013-90d7acfc4437 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:56.932104 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbc0c4-afd4-49a8-8013-90d7acfc4437 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:56.933552 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbc0c4-afd4-49a8-8013-90d7acfc4437 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:57.017462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:57.028047 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 631/1282] 10.222.0.44 () {58 vars in 1282 bytes} [Thu Jun 16 00:16:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 16 00:16:57.033803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b83383-4645-4662-8e2e-73b06a6022e6 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:57.094032 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:57.132754 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b83383-4645-4662-8e2e-73b06a6022e6 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:57.166113 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb8432-ee70-4e2d-bd53-164bc5394ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:57.166899 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb8432-ee70-4e2d-bd53-164bc5394ce0 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:57.167188 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb8432-ee70-4e2d-bd53-164bc5394ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:57.167464 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb8432-ee70-4e2d-bd53-164bc5394ce0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:57.177221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb8432-ee70-4e2d-bd53-164bc5394ce0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:57.178664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb8432-ee70-4e2d-bd53-164bc5394ce0 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:57.195775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-57eb8432-ee70-4e2d-bd53-164bc5394ce0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:57.195775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:57.195775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:57.195775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:57.195775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:57.195775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:57.195775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:57.195775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:57.195775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:57.195775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:57.195775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:57.195775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:57.195775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 16 00:16:57.195775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 16 00:16:57.195775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 16 00:16:57.196841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 16 00:16:57.196841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:57.196841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:57.196841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:57.196841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:57.196841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:57.196841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:57.196841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:57.196841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:57.196841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:57.196841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:57.196841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:57.196841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:57.196841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:57.196841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:57.196841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:57.196841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:57.197962 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 16 00:16:57.197962 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 16 00:16:57.197962 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 16 00:16:57.197962 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:16:57.197962 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 652/1283] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 16 00:16:57.202561 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbc0c4-afd4-49a8-8013-90d7acfc4437 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:57.298805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbc0c4-afd4-49a8-8013-90d7acfc4437 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:57.331148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd78f2c-9ae3-4f9d-92a7-e1e6f3595526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:57.331817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd78f2c-9ae3-4f9d-92a7-e1e6f3595526 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:57.332102 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd78f2c-9ae3-4f9d-92a7-e1e6f3595526 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:57.332378 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd78f2c-9ae3-4f9d-92a7-e1e6f3595526 None admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:57.333644 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd78f2c-9ae3-4f9d-92a7-e1e6f3595526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:57.333956 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd78f2c-9ae3-4f9d-92a7-e1e6f3595526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:57.335318 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd78f2c-9ae3-4f9d-92a7-e1e6f3595526 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:57.346074 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 632/1284] 10.222.0.44 () {56 vars in 1109 bytes} [Thu Jun 16 00:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:57.351688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb8432-ee70-4e2d-bd53-164bc5394ce0 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:57.448742 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb8432-ee70-4e2d-bd53-164bc5394ce0 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:57.462744 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:57.482643 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc2957-c0b2-4069-9bb8-49a55fa815e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:57.483427 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc2957-c0b2-4069-9bb8-49a55fa815e5 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:57.483739 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc2957-c0b2-4069-9bb8-49a55fa815e5 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:57.484019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bc2957-c0b2-4069-9bb8-49a55fa815e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:57.490449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc2957-c0b2-4069-9bb8-49a55fa815e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:57.491935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bc2957-c0b2-4069-9bb8-49a55fa815e5 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:57.506016 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application [None req-09bc2957-c0b2-4069-9bb8-49a55fa815e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:16:57.506016 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:16:57.506016 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:16:57.506016 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:16:57.506016 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:16:57.506016 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:16:57.506016 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:16:57.506016 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:16:57.506016 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:16:57.506016 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:16:57.506016 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:16:57.506016 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:16:57.506016 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 16 00:16:57.506016 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 16 00:16:57.506016 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 16 00:16:57.507075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 16 00:16:57.507075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:16:57.507075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:16:57.507075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:16:57.507075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:16:57.507075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:16:57.507075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:16:57.507075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:16:57.507075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application with Lock( Jun 16 00:16:57.507075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:16:57.507075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:16:57.507075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:16:57.507075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:16:57.507075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:16:57.507075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:16:57.507075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:16:57.507075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:16:57.508443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 16 00:16:57.508443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 16 00:16:57.508443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 16 00:16:57.508443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 16 00:16:57.508443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 16 00:16:57.508443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 16 00:16:57.508443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 16 00:16:57.508443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: ERROR keystone.server.flask.application Jun 16 00:16:57.508443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 653/1285] 10.222.0.44 () {56 vars in 1111 bytes} [Thu Jun 16 00:16:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:16:57.512812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd78f2c-9ae3-4f9d-92a7-e1e6f3595526 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:57.561018 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:16:57.610291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd78f2c-9ae3-4f9d-92a7-e1e6f3595526 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:57.642806 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0b224-ed94-4f66-9be2-2bc400aa6293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:57.643479 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0b224-ed94-4f66-9be2-2bc400aa6293 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:57.643792 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0b224-ed94-4f66-9be2-2bc400aa6293 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:57.644069 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0b224-ed94-4f66-9be2-2bc400aa6293 None admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:57.644846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0b224-ed94-4f66-9be2-2bc400aa6293 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:57.645155 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0b224-ed94-4f66-9be2-2bc400aa6293 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:57.647128 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0b224-ed94-4f66-9be2-2bc400aa6293 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:57.658557 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 633/1286] 10.222.0.44 () {56 vars in 1148 bytes} [Thu Jun 16 00:16:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:57.664426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc2957-c0b2-4069-9bb8-49a55fa815e5 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:16:57.760871 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bc2957-c0b2-4069-9bb8-49a55fa815e5 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:16:57.792661 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809ff7d-0363-45c5-94a2-7e59ae873423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:16:57.793310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809ff7d-0363-45c5-94a2-7e59ae873423 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:57.793593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809ff7d-0363-45c5-94a2-7e59ae873423 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:57.793870 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809ff7d-0363-45c5-94a2-7e59ae873423 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:57.794696 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809ff7d-0363-45c5-94a2-7e59ae873423 None admin] RBAC: Adding query filter params (role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab, scope.project.id=320d79ecbc2342af8031103e7308c10d, user.id=9164f14fe6894daba1a9f2d8f1f4929c) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:16:57.795012 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809ff7d-0363-45c5-94a2-7e59ae873423 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:16:57.796475 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809ff7d-0363-45c5-94a2-7e59ae873423 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:16:57.802982 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 654/1287] 10.222.0.44 () {56 vars in 1374 bytes} [Thu Jun 16 00:16:57 2022] GET /identity/v3/role_assignments?user.id=9164f14fe6894daba1a9f2d8f1f4929c&scope.project.id=320d79ecbc2342af8031103e7308c10d&role.id=6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:16:59.915329 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978b884-9b00-4bce-9d6f-795f1151c28b None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:59.915911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978b884-9b00-4bce-9d6f-795f1151c28b None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:59.915911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7978b884-9b00-4bce-9d6f-795f1151c28b None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:59.917274 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 634/1288] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:16:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:16:59.922423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022042c-1a2f-4dc6-99bf-d9f1184ded3d None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:16:59.922866 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022042c-1a2f-4dc6-99bf-d9f1184ded3d None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:16:59.922970 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022042c-1a2f-4dc6-99bf-d9f1184ded3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:16:59.940094 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-f022042c-1a2f-4dc6-99bf-d9f1184ded3d None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:16:59.941279 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-f022042c-1a2f-4dc6-99bf-d9f1184ded3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:16:59.970378 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:00.007949 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 655/1289] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:16:59 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:17:00.029605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978b884-9b00-4bce-9d6f-795f1151c28b None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:00.128164 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7978b884-9b00-4bce-9d6f-795f1151c28b None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:00.139676 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:00.162128 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646e99c-a046-44c0-8037-53c9f168d5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:00.162908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646e99c-a046-44c0-8037-53c9f168d5a7 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:00.163188 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646e99c-a046-44c0-8037-53c9f168d5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:00.163460 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646e99c-a046-44c0-8037-53c9f168d5a7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:00.164134 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646e99c-a046-44c0-8037-53c9f168d5a7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:00.165495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646e99c-a046-44c0-8037-53c9f168d5a7 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:00.177345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-5646e99c-a046-44c0-8037-53c9f168d5a7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:17:00.177345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:17:00.177345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:17:00.177345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:17:00.177345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:17:00.177345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:17:00.177345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:17:00.177345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:17:00.177345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:17:00.177345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:17:00.177345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:17:00.177345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:17:00.177345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:17:00.177345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:17:00.177345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:17:00.177345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:17:00.177345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:17:00.178578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:17:00.178578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:17:00.178578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:17:00.178578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:17:00.178578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:17:00.178578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:17:00.178578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:17:00.178578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:17:00.178578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:17:00.178578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:17:00.178578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:17:00.178578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:17:00.178578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:17:00.178578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:17:00.178578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:17:00.178578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:17:00.179507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:17:00.179507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:17:00.179507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:17:00.179507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:17:00.179507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:17:00.179507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:17:00.179507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:17:00.179507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:17:00.179507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:17:00.179507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:17:00.179507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:17:00.179507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:17:00.179507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:17:00.179507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:17:00.179507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 635/1290] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 16 00:17:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:17:00.184363 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022042c-1a2f-4dc6-99bf-d9f1184ded3d None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:00.278612 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022042c-1a2f-4dc6-99bf-d9f1184ded3d None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:00.311513 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa664de-4350-400d-b496-db16ad871875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:00.312190 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa664de-4350-400d-b496-db16ad871875 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:00.312476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa664de-4350-400d-b496-db16ad871875 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:00.312751 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa664de-4350-400d-b496-db16ad871875 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:00.313450 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa664de-4350-400d-b496-db16ad871875 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:17:00.313759 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa664de-4350-400d-b496-db16ad871875 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:00.315112 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa664de-4350-400d-b496-db16ad871875 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:00.319877 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 656/1291] 10.222.0.44 () {56 vars in 1116 bytes} [Thu Jun 16 00:17:00 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:17:00.325282 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646e99c-a046-44c0-8037-53c9f168d5a7 None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:00.420266 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646e99c-a046-44c0-8037-53c9f168d5a7 None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:00.452207 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7ce93-b9b5-4ceb-9ee7-25d8cd370bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:00.452852 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7ce93-b9b5-4ceb-9ee7-25d8cd370bd7 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:00.453137 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7ce93-b9b5-4ceb-9ee7-25d8cd370bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:00.453414 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7ce93-b9b5-4ceb-9ee7-25d8cd370bd7 None admin] PATH_INFO: `/v3/services` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:00.454110 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7ce93-b9b5-4ceb-9ee7-25d8cd370bd7 None admin] RBAC: Adding query filter params (type=placement) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:17:00.454420 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7ce93-b9b5-4ceb-9ee7-25d8cd370bd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:00.455812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7ce93-b9b5-4ceb-9ee7-25d8cd370bd7 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:00.460173 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 636/1292] 10.222.0.44 () {56 vars in 1116 bytes} [Thu Jun 16 00:17:00 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:17:02.536119 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93c5ba-7cea-4a09-b61c-7492aae5da49 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:02.536670 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93c5ba-7cea-4a09-b61c-7492aae5da49 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:02.536670 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a93c5ba-7cea-4a09-b61c-7492aae5da49 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:02.538054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 657/1293] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:17:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:02.543120 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c0195-ac90-48bb-ae07-0b441fcc1f59 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:02.543501 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c0195-ac90-48bb-ae07-0b441fcc1f59 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:02.543708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89c0195-ac90-48bb-ae07-0b441fcc1f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:02.560218 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-e89c0195-ac90-48bb-ae07-0b441fcc1f59 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:02.561397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e89c0195-ac90-48bb-ae07-0b441fcc1f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:02.594288 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:02.634301 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 637/1294] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:17:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:17:02.657060 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93c5ba-7cea-4a09-b61c-7492aae5da49 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:02.688485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:02.757248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a93c5ba-7cea-4a09-b61c-7492aae5da49 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:02.790438 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144787b-fb28-44fc-bda1-ce1d06b73514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:02.791025 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144787b-fb28-44fc-bda1-ce1d06b73514 None admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:02.791306 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144787b-fb28-44fc-bda1-ce1d06b73514 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:02.791582 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144787b-fb28-44fc-bda1-ce1d06b73514 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:02.792334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144787b-fb28-44fc-bda1-ce1d06b73514 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:02.793683 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144787b-fb28-44fc-bda1-ce1d06b73514 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:02.808745 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 658/1295] 10.222.0.44 () {60 vars in 1141 bytes} [Thu Jun 16 00:17:02 2022] POST /identity/v3/services => generated 246 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:17:04.872222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af741883-512f-462d-a192-683ddd8d3d8f None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:04.873021 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af741883-512f-462d-a192-683ddd8d3d8f None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:04.873021 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af741883-512f-462d-a192-683ddd8d3d8f None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:04.874412 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 638/1296] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:04.879564 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee63f8-8d43-457a-b59b-f56cfab476f5 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:04.879966 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee63f8-8d43-457a-b59b-f56cfab476f5 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:04.880151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccee63f8-8d43-457a-b59b-f56cfab476f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:04.896442 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-ccee63f8-8d43-457a-b59b-f56cfab476f5 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:04.897660 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-ccee63f8-8d43-457a-b59b-f56cfab476f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:04.968062 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 659/1297] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:17:04 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 16 00:17:04.991341 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af741883-512f-462d-a192-683ddd8d3d8f None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:05.088760 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af741883-512f-462d-a192-683ddd8d3d8f None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:05.121918 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7edf93-df4c-4df7-b026-4f615be80a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:05.122957 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7edf93-df4c-4df7-b026-4f615be80a8b None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:05.123244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7edf93-df4c-4df7-b026-4f615be80a8b None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:05.123522 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7edf93-df4c-4df7-b026-4f615be80a8b None admin] PATH_INFO: `/v3/services/placement` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:05.124199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7edf93-df4c-4df7-b026-4f615be80a8b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:05.125576 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7edf93-df4c-4df7-b026-4f615be80a8b None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:05.137156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-9e7edf93-df4c-4df7-b026-4f615be80a8b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:17:05.137156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:17:05.137156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:17:05.137156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:17:05.137156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:17:05.137156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:17:05.137156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:17:05.137156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:17:05.137156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:17:05.137156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:17:05.137156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:17:05.137156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:17:05.137156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:17:05.137156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:17:05.137156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:17:05.137156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:17:05.137156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:17:05.138392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:17:05.138392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:17:05.138392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:17:05.138392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:17:05.138392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:17:05.138392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:17:05.138392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:17:05.138392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:17:05.138392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:17:05.138392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:17:05.138392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:17:05.138392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:17:05.138392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:17:05.138392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:17:05.138392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:17:05.138392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:17:05.139650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:17:05.139650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:17:05.139650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:17:05.139650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:17:05.139650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:17:05.139650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:17:05.139650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:17:05.139650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:17:05.139650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:17:05.139650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:17:05.139650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:17:05.139650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:17:05.139650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:17:05.139650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:17:05.139650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 639/1298] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 16 00:17:04 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:17:05.144135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee63f8-8d43-457a-b59b-f56cfab476f5 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:05.162428 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:05.242565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccee63f8-8d43-457a-b59b-f56cfab476f5 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:05.281713 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448132c-456a-4a45-a5e2-4c6a4ec7a971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:05.282371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448132c-456a-4a45-a5e2-4c6a4ec7a971 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:05.282657 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448132c-456a-4a45-a5e2-4c6a4ec7a971 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:05.282935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448132c-456a-4a45-a5e2-4c6a4ec7a971 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:05.283668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448132c-456a-4a45-a5e2-4c6a4ec7a971 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:17:05.283979 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448132c-456a-4a45-a5e2-4c6a4ec7a971 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:05.285933 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448132c-456a-4a45-a5e2-4c6a4ec7a971 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:05.290978 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 660/1299] 10.222.0.44 () {56 vars in 1116 bytes} [Thu Jun 16 00:17:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:17:05.296790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7edf93-df4c-4df7-b026-4f615be80a8b None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:05.327244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:05.393812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7edf93-df4c-4df7-b026-4f615be80a8b None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:05.426526 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2779cd38-3283-4d7a-966e-88e5dfd16697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:05.427164 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779cd38-3283-4d7a-966e-88e5dfd16697 None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:05.427451 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779cd38-3283-4d7a-966e-88e5dfd16697 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:05.427761 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2779cd38-3283-4d7a-966e-88e5dfd16697 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:05.428544 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2779cd38-3283-4d7a-966e-88e5dfd16697 None admin] RBAC: Adding query filter params (interface=public, service_id=41ad672829eb499b8e10aa8283422ef8, region_id=RegionOne) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:17:05.428861 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2779cd38-3283-4d7a-966e-88e5dfd16697 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:05.430223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2779cd38-3283-4d7a-966e-88e5dfd16697 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:05.435104 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 640/1300] 10.222.0.44 () {56 vars in 1251 bytes} [Thu Jun 16 00:17:05 2022] GET /identity/v3/endpoints?service_id=41ad672829eb499b8e10aa8283422ef8&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:17:05.440668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448132c-456a-4a45-a5e2-4c6a4ec7a971 None admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:05.520642 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:05.539422 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448132c-456a-4a45-a5e2-4c6a4ec7a971 None admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:05.577285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b4e2df-57af-4299-b679-ac3951829aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:05.577950 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4e2df-57af-4299-b679-ac3951829aad None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:05.578243 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4e2df-57af-4299-b679-ac3951829aad None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:05.578518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b4e2df-57af-4299-b679-ac3951829aad None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:05.579312 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4e2df-57af-4299-b679-ac3951829aad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:05.580846 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b4e2df-57af-4299-b679-ac3951829aad None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:05.589334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 661/1301] 10.222.0.44 () {56 vars in 1087 bytes} [Thu Jun 16 00:17:05 2022] GET /identity/v3/services => generated 2191 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:17:07.698944 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4fdd5-9ff5-4c3e-9f33-2d1ca3fa4f4d None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:07.699506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4fdd5-9ff5-4c3e-9f33-2d1ca3fa4f4d None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:07.699506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4fdd5-9ff5-4c3e-9f33-2d1ca3fa4f4d None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:07.700906 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 641/1302] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:17:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:17:07.706000 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d157141-21cd-4f5a-bfdf-a2d0ebb4a081 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:07.706397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d157141-21cd-4f5a-bfdf-a2d0ebb4a081 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:07.706554 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d157141-21cd-4f5a-bfdf-a2d0ebb4a081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:07.722770 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-5d157141-21cd-4f5a-bfdf-a2d0ebb4a081 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:17:07.723983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-5d157141-21cd-4f5a-bfdf-a2d0ebb4a081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:17:07.789738 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 662/1303] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:17:07 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 16 00:17:07.812561 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4fdd5-9ff5-4c3e-9f33-2d1ca3fa4f4d None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:07.906205 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:07.913480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4fdd5-9ff5-4c3e-9f33-2d1ca3fa4f4d None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:07.946167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e55a96-1cbb-492a-878a-96c4aaeac81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:07.946959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e55a96-1cbb-492a-878a-96c4aaeac81f None admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:07.947248 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e55a96-1cbb-492a-878a-96c4aaeac81f None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:07.947526 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e55a96-1cbb-492a-878a-96c4aaeac81f None admin] PATH_INFO: `/v3/services/placement` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:07.948211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e55a96-1cbb-492a-878a-96c4aaeac81f None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:07.949625 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e55a96-1cbb-492a-878a-96c4aaeac81f None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:07.961757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application [None req-20e55a96-1cbb-492a-878a-96c4aaeac81f None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:17:07.961757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:17:07.961757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 16 00:17:07.961757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 16 00:17:07.961757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 16 00:17:07.961757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 16 00:17:07.961757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 16 00:17:07.961757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:17:07.961757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:17:07.961757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:17:07.961757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 16 00:17:07.961757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:17:07.961757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 16 00:17:07.961757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 16 00:17:07.961757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 16 00:17:07.961757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 16 00:17:07.961757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 16 00:17:07.962920 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 16 00:17:07.962920 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 16 00:17:07.962920 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 16 00:17:07.962920 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 16 00:17:07.962920 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 16 00:17:07.962920 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 16 00:17:07.962920 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 16 00:17:07.962920 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 16 00:17:07.962920 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 16 00:17:07.962920 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 16 00:17:07.962920 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 16 00:17:07.962920 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 16 00:17:07.962920 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 16 00:17:07.962920 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 16 00:17:07.962920 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 16 00:17:07.962920 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.get_or_create( Jun 16 00:17:07.964004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 16 00:17:07.964004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application with Lock( Jun 16 00:17:07.964004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 16 00:17:07.964004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self._enter() Jun 16 00:17:07.964004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 16 00:17:07.964004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 16 00:17:07.964004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 16 00:17:07.964004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application return self.creator() Jun 16 00:17:07.964004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 16 00:17:07.964004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application created_value = creator( Jun 16 00:17:07.964004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 16 00:17:07.964004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 16 00:17:07.964004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 16 00:17:07.964004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: ERROR keystone.server.flask.application Jun 16 00:17:07.964004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 642/1304] 10.222.0.44 () {56 vars in 1117 bytes} [Thu Jun 16 00:17:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 16 00:17:07.968963 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d157141-21cd-4f5a-bfdf-a2d0ebb4a081 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:08.042590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:08.065182 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d157141-21cd-4f5a-bfdf-a2d0ebb4a081 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:08.099785 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088e9886-995e-432b-b47e-f0a880cd1111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:08.100438 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e9886-995e-432b-b47e-f0a880cd1111 None admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:08.100726 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e9886-995e-432b-b47e-f0a880cd1111 None admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:08.101014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088e9886-995e-432b-b47e-f0a880cd1111 None admin] PATH_INFO: `/v3/services` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:08.101719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e9886-995e-432b-b47e-f0a880cd1111 None admin] RBAC: Adding query filter params (name=placement) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:17:08.102030 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e9886-995e-432b-b47e-f0a880cd1111 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:08.103391 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088e9886-995e-432b-b47e-f0a880cd1111 None admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:08.108457 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 663/1305] 10.222.0.44 () {56 vars in 1116 bytes} [Thu Jun 16 00:17:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:17:08.114056 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e55a96-1cbb-492a-878a-96c4aaeac81f None admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:17:08.211242 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e55a96-1cbb-492a-878a-96c4aaeac81f None admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:17:08.243352 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6d946-6d83-4b4b-a58b-082e44ce4987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:17:08.244010 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6d946-6d83-4b4b-a58b-082e44ce4987 None admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:17:08.244290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6d946-6d83-4b4b-a58b-082e44ce4987 None admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:17:08.244557 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6d946-6d83-4b4b-a58b-082e44ce4987 None admin] PATH_INFO: `/v3/endpoints` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:17:08.245279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6d946-6d83-4b4b-a58b-082e44ce4987 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:17:08.246636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6d946-6d83-4b4b-a58b-082e44ce4987 None admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:17:08.265449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 643/1306] 10.222.0.44 () {60 vars in 1144 bytes} [Thu Jun 16 00:17:08 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:17:18.105535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=30 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:17:18.261127 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:10.882800 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d876afd-19fb-4d93-abde-67f9c7e6f3b5 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:10.884128 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d876afd-19fb-4d93-abde-67f9c7e6f3b5 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:10.885064 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d876afd-19fb-4d93-abde-67f9c7e6f3b5 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:10.894064 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2903e8e-5cd2-4614-bc98-f188077bfa7c None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:10.894467 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2903e8e-5cd2-4614-bc98-f188077bfa7c None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:10.894738 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2903e8e-5cd2-4614-bc98-f188077bfa7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:10.896500 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 664/1307] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:18:10 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:11.001135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-c2903e8e-5cd2-4614-bc98-f188077bfa7c None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:11.003527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-c2903e8e-5cd2-4614-bc98-f188077bfa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:11.167099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 644/1308] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:18:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:11.217077 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421d130-90e4-4ba8-9bba-b300d37ef292 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:11.217242 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421d130-90e4-4ba8-9bba-b300d37ef292 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:11.217506 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0421d130-90e4-4ba8-9bba-b300d37ef292 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:11.219357 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 665/1309] 10.222.0.44 () {54 vars in 964 bytes} [Thu Jun 16 00:18:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:11.229798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216d982-82bb-44fb-991f-4fb074e37599 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:11.231120 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216d982-82bb-44fb-991f-4fb074e37599 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:11.231504 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216d982-82bb-44fb-991f-4fb074e37599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:11.317918 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-6216d982-82bb-44fb-991f-4fb074e37599 None None] MFA Rules not processed for user `222e3db424f0476386bc3432cc0f868e`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:11.319266 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-6216d982-82bb-44fb-991f-4fb074e37599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:11.342505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:11.403702 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 645/1310] 10.222.0.44 () {58 vars in 1061 bytes} [Thu Jun 16 00:18:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:11.412553 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421d130-90e4-4ba8-9bba-b300d37ef292 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:11.414351 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-0421d130-90e4-4ba8-9bba-b300d37ef292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:11.545701 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0421d130-90e4-4ba8-9bba-b300d37ef292 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:11.631095 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee87cad-600f-426d-83a8-1b4896eca733 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:11.632117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee87cad-600f-426d-83a8-1b4896eca733 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:11.632478 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee87cad-600f-426d-83a8-1b4896eca733 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:11.632845 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee87cad-600f-426d-83a8-1b4896eca733 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:11.634569 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-0ee87cad-600f-426d-83a8-1b4896eca733 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:11.694082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:11.757025 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee87cad-600f-426d-83a8-1b4896eca733 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:11.758642 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee87cad-600f-426d-83a8-1b4896eca733 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:11.781103 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 666/1311] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:14.259340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df91618-6b21-4d19-8338-7a82308b4caa None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:14.259900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df91618-6b21-4d19-8338-7a82308b4caa None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:14.259991 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df91618-6b21-4d19-8338-7a82308b4caa None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:14.261994 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 646/1312] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:18:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:14.267094 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1fe54-d01e-473f-adb5-f39819fad533 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:14.267532 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1fe54-d01e-473f-adb5-f39819fad533 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:14.267673 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1fe54-d01e-473f-adb5-f39819fad533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:14.348680 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-9ef1fe54-d01e-473f-adb5-f39819fad533 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:14.350130 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-9ef1fe54-d01e-473f-adb5-f39819fad533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:14.446373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 667/1313] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:18:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:14.484577 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df91618-6b21-4d19-8338-7a82308b4caa None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:14.486198 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-7df91618-6b21-4d19-8338-7a82308b4caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:14.599167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df91618-6b21-4d19-8338-7a82308b4caa None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:14.673526 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:14.675946 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c8bd4-28e9-43eb-bf09-9ddaed4a2f80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:14.676650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c8bd4-28e9-43eb-bf09-9ddaed4a2f80 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:14.677328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c8bd4-28e9-43eb-bf09-9ddaed4a2f80 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:14.678027 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c8bd4-28e9-43eb-bf09-9ddaed4a2f80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:14.679862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-c43c8bd4-28e9-43eb-bf09-9ddaed4a2f80 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:14.789529 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c8bd4-28e9-43eb-bf09-9ddaed4a2f80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:14.790988 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c8bd4-28e9-43eb-bf09-9ddaed4a2f80 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:14.812497 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 647/1314] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:17.195589 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed2789-53b6-482e-b241-43be814f2337 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:17.196113 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed2789-53b6-482e-b241-43be814f2337 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:17.196113 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ed2789-53b6-482e-b241-43be814f2337 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:17.197507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 668/1315] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:17.203066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d586d7-06b0-4e83-a518-7f08864327da None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:17.203486 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d586d7-06b0-4e83-a518-7f08864327da None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:17.203633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d586d7-06b0-4e83-a518-7f08864327da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:17.267534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-95d586d7-06b0-4e83-a518-7f08864327da None None] MFA Rules not processed for user `f6600340cdd1454682f1b24e37dbb6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:17.268761 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-95d586d7-06b0-4e83-a518-7f08864327da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:17.318937 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:17.363519 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 648/1316] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:18:17 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:17.418055 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fd664-1655-4369-ad55-bb29fc5d7df7 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:17.418350 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fd664-1655-4369-ad55-bb29fc5d7df7 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:17.418633 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fd664-1655-4369-ad55-bb29fc5d7df7 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:17.420079 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 669/1317] 10.222.0.44 () {54 vars in 964 bytes} [Thu Jun 16 00:18:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:17.425891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc84436-cc6f-4b05-9d7b-85cb79c808b1 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:17.426187 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc84436-cc6f-4b05-9d7b-85cb79c808b1 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:17.426466 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc84436-cc6f-4b05-9d7b-85cb79c808b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:17.498892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-fbc84436-cc6f-4b05-9d7b-85cb79c808b1 None None] MFA Rules not processed for user `222e3db424f0476386bc3432cc0f868e`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:17.500116 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-fbc84436-cc6f-4b05-9d7b-85cb79c808b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:17.576026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 649/1318] 10.222.0.44 () {58 vars in 1061 bytes} [Thu Jun 16 00:18:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:17.584872 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fd664-1655-4369-ad55-bb29fc5d7df7 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:17.586386 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-fe0fd664-1655-4369-ad55-bb29fc5d7df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:17.596218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:17.695306 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fd664-1655-4369-ad55-bb29fc5d7df7 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:17.769626 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313da93-0644-41c1-9eef-6bf11a111e1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:17.770210 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313da93-0644-41c1-9eef-6bf11a111e1c service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:17.770495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313da93-0644-41c1-9eef-6bf11a111e1c service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:17.770774 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313da93-0644-41c1-9eef-6bf11a111e1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:17.772448 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-9313da93-0644-41c1-9eef-6bf11a111e1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:17.834253 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:17.881170 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313da93-0644-41c1-9eef-6bf11a111e1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:17.882624 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313da93-0644-41c1-9eef-6bf11a111e1c service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:17.901227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 670/1319] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:17 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:20.870698 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4754b6e-9399-4487-9b0b-70ea1c616e2c None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:20.871214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4754b6e-9399-4487-9b0b-70ea1c616e2c None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:20.871367 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4754b6e-9399-4487-9b0b-70ea1c616e2c None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:20.872685 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 650/1320] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:20.877845 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd271987-2a6c-42c7-91fc-da1cc8bfe9d4 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:20.878247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd271987-2a6c-42c7-91fc-da1cc8bfe9d4 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:20.878394 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd271987-2a6c-42c7-91fc-da1cc8bfe9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:20.941628 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-fd271987-2a6c-42c7-91fc-da1cc8bfe9d4 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:20.942807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-fd271987-2a6c-42c7-91fc-da1cc8bfe9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:21.036831 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 671/1321] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:18:20 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:18:21.075269 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4754b6e-9399-4487-9b0b-70ea1c616e2c None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:21.076829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-f4754b6e-9399-4487-9b0b-70ea1c616e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:21.131978 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:21.180005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4754b6e-9399-4487-9b0b-70ea1c616e2c None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:21.251474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1739c5-f1a2-4611-99ab-4b091eb6ced4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:21.252144 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1739c5-f1a2-4611-99ab-4b091eb6ced4 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:21.252428 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1739c5-f1a2-4611-99ab-4b091eb6ced4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:21.252703 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1739c5-f1a2-4611-99ab-4b091eb6ced4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:21.254330 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-1a1739c5-f1a2-4611-99ab-4b091eb6ced4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:21.347235 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:21.361117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1739c5-f1a2-4611-99ab-4b091eb6ced4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:21.362573 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1739c5-f1a2-4611-99ab-4b091eb6ced4 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:21.380444 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 651/1322] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:21 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:24.155702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e44e3-5106-4ba0-9b10-1b1acc44601a None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:24.156203 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e44e3-5106-4ba0-9b10-1b1acc44601a None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:24.156203 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e44e3-5106-4ba0-9b10-1b1acc44601a None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:24.157732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 672/1323] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:24.162689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab3abc-6b8c-4886-811e-87638aa48452 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:24.163111 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab3abc-6b8c-4886-811e-87638aa48452 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:24.163238 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab3abc-6b8c-4886-811e-87638aa48452 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:24.235389 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-21ab3abc-6b8c-4886-811e-87638aa48452 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:24.236682 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-21ab3abc-6b8c-4886-811e-87638aa48452 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:24.338784 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 652/1324] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:18:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:24.375228 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e44e3-5106-4ba0-9b10-1b1acc44601a None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:24.376799 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-680e44e3-5106-4ba0-9b10-1b1acc44601a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:24.396725 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:24.480496 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e44e3-5106-4ba0-9b10-1b1acc44601a None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:24.552828 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08330f7-be94-4be5-aeaf-cd1f85d4d128 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:24.553487 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08330f7-be94-4be5-aeaf-cd1f85d4d128 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:24.553776 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08330f7-be94-4be5-aeaf-cd1f85d4d128 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:24.554089 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08330f7-be94-4be5-aeaf-cd1f85d4d128 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:24.555769 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-a08330f7-be94-4be5-aeaf-cd1f85d4d128 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:24.629980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:24.668856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08330f7-be94-4be5-aeaf-cd1f85d4d128 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:24.670308 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08330f7-be94-4be5-aeaf-cd1f85d4d128 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:24.688663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 673/1325] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:26.854333 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1c17e-19c0-4c68-8150-c748893c2928 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:26.854889 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1c17e-19c0-4c68-8150-c748893c2928 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:26.854889 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1c17e-19c0-4c68-8150-c748893c2928 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:26.856369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 653/1326] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:18:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:26.861597 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585ece1-e5ae-4d86-bf56-ec7167337d6c None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:26.862011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585ece1-e5ae-4d86-bf56-ec7167337d6c None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:26.862190 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585ece1-e5ae-4d86-bf56-ec7167337d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:26.926632 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-f585ece1-e5ae-4d86-bf56-ec7167337d6c None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:26.927891 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-f585ece1-e5ae-4d86-bf56-ec7167337d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:27.027089 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 674/1327] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:18:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:27.061438 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1c17e-19c0-4c68-8150-c748893c2928 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:27.062987 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-bdb1c17e-19c0-4c68-8150-c748893c2928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:27.128038 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:27.174675 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1c17e-19c0-4c68-8150-c748893c2928 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:27.247441 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b832f1d-40ff-4347-942f-4836fa06d7db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:27.248119 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b832f1d-40ff-4347-942f-4836fa06d7db service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:27.248399 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b832f1d-40ff-4347-942f-4836fa06d7db service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:27.248671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b832f1d-40ff-4347-942f-4836fa06d7db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:27.250318 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-2b832f1d-40ff-4347-942f-4836fa06d7db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:27.363377 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:27.366377 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b832f1d-40ff-4347-942f-4836fa06d7db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:27.367933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b832f1d-40ff-4347-942f-4836fa06d7db service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:27.388681 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 654/1328] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:29.566183 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe1809-28a5-4d61-8990-a14761bc00bc None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:29.566777 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe1809-28a5-4d61-8990-a14761bc00bc None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:29.566777 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fe1809-28a5-4d61-8990-a14761bc00bc None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:29.568225 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 675/1329] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:29.574012 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992e900-b073-48a7-9282-c2f6901da842 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:29.574447 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992e900-b073-48a7-9282-c2f6901da842 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:29.574577 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992e900-b073-48a7-9282-c2f6901da842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:29.637853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-2992e900-b073-48a7-9282-c2f6901da842 None None] MFA Rules not processed for user `f6600340cdd1454682f1b24e37dbb6fe`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:29.639051 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-2992e900-b073-48a7-9282-c2f6901da842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:29.737148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 655/1330] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:18:29 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:29.774404 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe1809-28a5-4d61-8990-a14761bc00bc None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:29.776549 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-54fe1809-28a5-4d61-8990-a14761bc00bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:29.811117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:29.895307 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fe1809-28a5-4d61-8990-a14761bc00bc None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:29.979683 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd994708-eeec-43fe-885a-bffad50101b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:29.980355 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd994708-eeec-43fe-885a-bffad50101b1 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:29.980637 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd994708-eeec-43fe-885a-bffad50101b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:29.980913 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd994708-eeec-43fe-885a-bffad50101b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:29.982621 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-bd994708-eeec-43fe-885a-bffad50101b1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:30.060328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:30.092654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd994708-eeec-43fe-885a-bffad50101b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:30.094091 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd994708-eeec-43fe-885a-bffad50101b1 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:30.112291 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 676/1331] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:29 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:32.461048 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8623d-7bde-4068-bf32-cf5ffb0e3bf3 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:32.461615 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8623d-7bde-4068-bf32-cf5ffb0e3bf3 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:32.461615 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd8623d-7bde-4068-bf32-cf5ffb0e3bf3 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:32.463796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 656/1332] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:18:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:32.468911 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb9a5a-b813-4e10-a4da-f4c346bf1501 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:32.469330 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb9a5a-b813-4e10-a4da-f4c346bf1501 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:32.469479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faeb9a5a-b813-4e10-a4da-f4c346bf1501 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:32.533158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-faeb9a5a-b813-4e10-a4da-f4c346bf1501 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:32.534364 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-faeb9a5a-b813-4e10-a4da-f4c346bf1501 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:32.629348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 677/1333] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:18:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:32.664751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8623d-7bde-4068-bf32-cf5ffb0e3bf3 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:32.666411 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-bcd8623d-7bde-4068-bf32-cf5ffb0e3bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:32.734103 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:32.769042 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd8623d-7bde-4068-bf32-cf5ffb0e3bf3 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:32.840848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce56c1b-ff80-4aa8-81ec-531b29852597 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:32.841490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce56c1b-ff80-4aa8-81ec-531b29852597 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:32.841774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce56c1b-ff80-4aa8-81ec-531b29852597 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:32.842050 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce56c1b-ff80-4aa8-81ec-531b29852597 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:32.843704 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-0ce56c1b-ff80-4aa8-81ec-531b29852597 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:32.950193 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce56c1b-ff80-4aa8-81ec-531b29852597 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:32.951653 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce56c1b-ff80-4aa8-81ec-531b29852597 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:32.961588 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:32.970605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 657/1334] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:35.114384 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b8805-1fae-4907-a64e-dc0da39c62c0 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:35.114898 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b8805-1fae-4907-a64e-dc0da39c62c0 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:35.114898 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893b8805-1fae-4907-a64e-dc0da39c62c0 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:35.116542 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 678/1335] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:18:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:35.121560 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b8691-0197-449c-b221-809986cba12c None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:35.121981 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b8691-0197-449c-b221-809986cba12c None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:35.122118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966b8691-0197-449c-b221-809986cba12c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:35.184949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-966b8691-0197-449c-b221-809986cba12c None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:35.186141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-966b8691-0197-449c-b221-809986cba12c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:35.280661 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 658/1336] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:18:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:35.319458 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b8805-1fae-4907-a64e-dc0da39c62c0 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:35.321046 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-893b8805-1fae-4907-a64e-dc0da39c62c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:35.360518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:35.422787 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893b8805-1fae-4907-a64e-dc0da39c62c0 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:35.493901 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5b996b-5f7f-4b01-bc76-df5c1b406b1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:35.494539 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b996b-5f7f-4b01-bc76-df5c1b406b1d service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:35.494823 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b996b-5f7f-4b01-bc76-df5c1b406b1d service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:35.495099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5b996b-5f7f-4b01-bc76-df5c1b406b1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:35.496756 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-5c5b996b-5f7f-4b01-bc76-df5c1b406b1d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:35.580151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:35.605701 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b996b-5f7f-4b01-bc76-df5c1b406b1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:35.607144 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5b996b-5f7f-4b01-bc76-df5c1b406b1d service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:35.626953 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 679/1337] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:38.156035 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c84ebd-aa58-4e2c-9778-6933d55faa06 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:38.156555 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c84ebd-aa58-4e2c-9778-6933d55faa06 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:38.156555 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c84ebd-aa58-4e2c-9778-6933d55faa06 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:38.157891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 659/1338] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:38.163147 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899de011-62ac-4eb8-b02f-4a11c426c816 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:38.163565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899de011-62ac-4eb8-b02f-4a11c426c816 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:38.163736 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899de011-62ac-4eb8-b02f-4a11c426c816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:38.227829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-899de011-62ac-4eb8-b02f-4a11c426c816 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:38.229117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-899de011-62ac-4eb8-b02f-4a11c426c816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:38.331105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 680/1339] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:18:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:38.366658 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c84ebd-aa58-4e2c-9778-6933d55faa06 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:38.368751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-03c84ebd-aa58-4e2c-9778-6933d55faa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:38.442884 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:38.470765 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c84ebd-aa58-4e2c-9778-6933d55faa06 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:38.541900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3a4dc-167c-45a7-9df8-cff97086fd42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:38.542538 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3a4dc-167c-45a7-9df8-cff97086fd42 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:38.542818 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3a4dc-167c-45a7-9df8-cff97086fd42 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:38.543090 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3a4dc-167c-45a7-9df8-cff97086fd42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:38.544746 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a3a3a4dc-167c-45a7-9df8-cff97086fd42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:38.659563 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3a4dc-167c-45a7-9df8-cff97086fd42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:38.661039 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3a4dc-167c-45a7-9df8-cff97086fd42 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:38.678788 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 660/1340] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:42.787936 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25ac6c-f4c8-4e07-ba44-3aef03cff513 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:42.788487 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25ac6c-f4c8-4e07-ba44-3aef03cff513 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:42.788487 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25ac6c-f4c8-4e07-ba44-3aef03cff513 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:42.790427 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 681/1341] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:18:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:42.796177 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71594edf-0b9d-4ab4-888a-9805e980ab91 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:42.796582 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71594edf-0b9d-4ab4-888a-9805e980ab91 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:42.796758 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71594edf-0b9d-4ab4-888a-9805e980ab91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:42.802866 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:42.869184 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-71594edf-0b9d-4ab4-888a-9805e980ab91 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:42.870290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-71594edf-0b9d-4ab4-888a-9805e980ab91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:42.975495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 661/1342] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:18:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:43.014207 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25ac6c-f4c8-4e07-ba44-3aef03cff513 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:43.016433 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-6b25ac6c-f4c8-4e07-ba44-3aef03cff513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:43.066053 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:43.111495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25ac6c-f4c8-4e07-ba44-3aef03cff513 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:43.115464 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a24706f-93b3-4fd7-8c47-d399355f2047 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:43.116140 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24706f-93b3-4fd7-8c47-d399355f2047 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:43.116425 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24706f-93b3-4fd7-8c47-d399355f2047 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:43.116702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a24706f-93b3-4fd7-8c47-d399355f2047 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:43.126420 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24706f-93b3-4fd7-8c47-d399355f2047 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:43.127824 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a24706f-93b3-4fd7-8c47-d399355f2047 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:43.137896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 682/1343] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:45.862329 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772fd34-b693-4e5d-bed6-75c2041da68c None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:45.862886 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772fd34-b693-4e5d-bed6-75c2041da68c None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:45.862886 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d772fd34-b693-4e5d-bed6-75c2041da68c None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:45.864574 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 662/1344] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:45.870767 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979f6bd-e7eb-4643-ab76-35edbd50ee52 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:45.871306 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979f6bd-e7eb-4643-ab76-35edbd50ee52 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:45.871306 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7979f6bd-e7eb-4643-ab76-35edbd50ee52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:45.900275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-7979f6bd-e7eb-4643-ab76-35edbd50ee52 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:45.901520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-7979f6bd-e7eb-4643-ab76-35edbd50ee52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:45.984789 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 683/1345] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:18:45 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:46.022579 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772fd34-b693-4e5d-bed6-75c2041da68c None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:46.033928 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d772fd34-b693-4e5d-bed6-75c2041da68c None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:46.037484 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d58287-496c-4bfa-9291-500cd2ce0a78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:46.038123 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d58287-496c-4bfa-9291-500cd2ce0a78 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:46.038410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d58287-496c-4bfa-9291-500cd2ce0a78 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:46.039327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d58287-496c-4bfa-9291-500cd2ce0a78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:46.048364 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d58287-496c-4bfa-9291-500cd2ce0a78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:46.049805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d58287-496c-4bfa-9291-500cd2ce0a78 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:46.059337 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 663/1346] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:50.057686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e83b5-2953-41d5-9ca3-0c5eea726e81 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:50.058195 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e83b5-2953-41d5-9ca3-0c5eea726e81 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:50.058195 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3e83b5-2953-41d5-9ca3-0c5eea726e81 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:50.059539 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 684/1347] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:18:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:50.064964 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17381ef-edc8-481b-b904-07d36935f088 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:50.065928 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17381ef-edc8-481b-b904-07d36935f088 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:50.066212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17381ef-edc8-481b-b904-07d36935f088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:50.084586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-c17381ef-edc8-481b-b904-07d36935f088 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:50.086632 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-c17381ef-edc8-481b-b904-07d36935f088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:50.095973 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 664/1348] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:50.133602 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e83b5-2953-41d5-9ca3-0c5eea726e81 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:18:50.144370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3e83b5-2953-41d5-9ca3-0c5eea726e81 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:18:50.148506 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30545605-9d55-4c15-953f-1b8b27b49ab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:18:50.149215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30545605-9d55-4c15-953f-1b8b27b49ab9 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:50.149567 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30545605-9d55-4c15-953f-1b8b27b49ab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:50.149910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30545605-9d55-4c15-953f-1b8b27b49ab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:50.159572 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30545605-9d55-4c15-953f-1b8b27b49ab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:18:50.161050 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30545605-9d55-4c15-953f-1b8b27b49ab9 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:18:50.170985 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 685/1349] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:18:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:18:55.165755 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2bea6-c348-49f9-847e-2cc99d91e3f6 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:55.166263 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2bea6-c348-49f9-847e-2cc99d91e3f6 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:55.166376 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2bea6-c348-49f9-847e-2cc99d91e3f6 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:55.167713 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 665/1350] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 16 00:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:55.172803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273b0f9-a16c-4ebf-88b2-3e90518a53af None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:55.173209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273b0f9-a16c-4ebf-88b2-3e90518a53af None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:55.173363 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8273b0f9-a16c-4ebf-88b2-3e90518a53af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:55.246166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-8273b0f9-a16c-4ebf-88b2-3e90518a53af None None] MFA Rules not processed for user `9164f14fe6894daba1a9f2d8f1f4929c`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:55.247630 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-8273b0f9-a16c-4ebf-88b2-3e90518a53af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:55.278974 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:18:55.338338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 686/1351] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 16 00:18:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:18:59.361839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9c834-2ba8-4ee9-ac5f-fc93073d2a6f None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:59.362416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9c834-2ba8-4ee9-ac5f-fc93073d2a6f None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:59.362416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d9c834-2ba8-4ee9-ac5f-fc93073d2a6f None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:59.364326 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 666/1352] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 16 00:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:18:59.369535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed19df-7f92-4086-bc7a-a2ba059d7b86 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:18:59.369965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed19df-7f92-4086-bc7a-a2ba059d7b86 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:18:59.370200 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ed19df-7f92-4086-bc7a-a2ba059d7b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:18:59.390195 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-86ed19df-7f92-4086-bc7a-a2ba059d7b86 None None] MFA Rules not processed for user `9164f14fe6894daba1a9f2d8f1f4929c`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:18:59.391416 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-86ed19df-7f92-4086-bc7a-a2ba059d7b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:18:59.400929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 687/1353] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 16 00:18:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:00.079644 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=72 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:01.135086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4886c-627d-4eb5-8192-2e448540e888 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:01.135724 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4886c-627d-4eb5-8192-2e448540e888 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:01.135724 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da4886c-627d-4eb5-8192-2e448540e888 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:01.136971 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 667/1354] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 16 00:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:01.141917 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055deb17-acdf-4858-b3ed-b9d952efadff None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:01.142342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055deb17-acdf-4858-b3ed-b9d952efadff None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:01.142611 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055deb17-acdf-4858-b3ed-b9d952efadff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:01.161112 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-055deb17-acdf-4858-b3ed-b9d952efadff None None] MFA Rules not processed for user `9164f14fe6894daba1a9f2d8f1f4929c`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:01.162888 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-055deb17-acdf-4858-b3ed-b9d952efadff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:01.171678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 688/1355] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 16 00:19:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:04.959209 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17baa23-a116-4496-a1f7-94d4896e0cb7 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:04.959867 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17baa23-a116-4496-a1f7-94d4896e0cb7 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:04.959867 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17baa23-a116-4496-a1f7-94d4896e0cb7 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:04.961206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 668/1356] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:19:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:04.966767 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccaf45-74ee-4e2e-9b29-9107a732d2e0 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:04.967151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccaf45-74ee-4e2e-9b29-9107a732d2e0 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:04.967254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bccaf45-74ee-4e2e-9b29-9107a732d2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:04.986363 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-6bccaf45-74ee-4e2e-9b29-9107a732d2e0 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:04.987978 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-6bccaf45-74ee-4e2e-9b29-9107a732d2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:04.996798 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 689/1357] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:05.054536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c5760-170a-444b-9962-38849e9c1f4b None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:05.056320 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c5760-170a-444b-9962-38849e9c1f4b None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:05.057248 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c5760-170a-444b-9962-38849e9c1f4b None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:05.061298 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 669/1358] 10.222.0.44 () {54 vars in 961 bytes} [Thu Jun 16 00:19:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:05.081850 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3211860-ec26-41e9-9aa7-1f51f9e9b43f None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:05.082470 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3211860-ec26-41e9-9aa7-1f51f9e9b43f None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:05.082936 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3211860-ec26-41e9-9aa7-1f51f9e9b43f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:05.134971 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-d3211860-ec26-41e9-9aa7-1f51f9e9b43f None None] MFA Rules not processed for user `40432493f16b4df681daf5a1af87832a`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:05.136285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-d3211860-ec26-41e9-9aa7-1f51f9e9b43f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:05.227383 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 690/1359] 10.222.0.44 () {58 vars in 1058 bytes} [Thu Jun 16 00:19:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:05.233647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c5760-170a-444b-9962-38849e9c1f4b None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:05.249037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c5760-170a-444b-9962-38849e9c1f4b None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:05.254792 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7d9d7-cf77-4c7b-8cd1-a8a123b2f83f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:05.256216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7d9d7-cf77-4c7b-8cd1-a8a123b2f83f service nova] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:05.256505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7d9d7-cf77-4c7b-8cd1-a8a123b2f83f service nova] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:05.256780 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7d9d7-cf77-4c7b-8cd1-a8a123b2f83f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:05.265400 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7d9d7-cf77-4c7b-8cd1-a8a123b2f83f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:05.267214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7d9d7-cf77-4c7b-8cd1-a8a123b2f83f service nova] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:05.278457 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 670/1360] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:07.599199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8011e99-843f-45e5-9f60-b0d0a39eb017 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:07.599793 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8011e99-843f-45e5-9f60-b0d0a39eb017 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:07.599793 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8011e99-843f-45e5-9f60-b0d0a39eb017 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:07.601352 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 691/1361] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:07.606508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0046aa8-04ca-4a8a-acc1-2e28b6ba657b None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:07.606923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0046aa8-04ca-4a8a-acc1-2e28b6ba657b None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:07.607071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0046aa8-04ca-4a8a-acc1-2e28b6ba657b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:07.626868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-c0046aa8-04ca-4a8a-acc1-2e28b6ba657b None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:07.628244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-c0046aa8-04ca-4a8a-acc1-2e28b6ba657b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:07.637966 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 671/1362] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:07.685017 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8011e99-843f-45e5-9f60-b0d0a39eb017 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:07.701532 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8011e99-843f-45e5-9f60-b0d0a39eb017 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:07.707299 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2cdf7-c33e-4e8c-b341-ce593b63c782 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:07.708758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2cdf7-c33e-4e8c-b341-ce593b63c782 service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:07.709051 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2cdf7-c33e-4e8c-b341-ce593b63c782 service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:07.709336 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2cdf7-c33e-4e8c-b341-ce593b63c782 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:07.719007 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2cdf7-c33e-4e8c-b341-ce593b63c782 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:07.720680 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c2cdf7-c33e-4e8c-b341-ce593b63c782 service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:07.731278 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 692/1363] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:10.207229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d402510-7699-49ee-bdd3-9bee2b668949 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:10.207792 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d402510-7699-49ee-bdd3-9bee2b668949 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:10.207916 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d402510-7699-49ee-bdd3-9bee2b668949 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:10.209226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 672/1364] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:10.214692 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4a756-63e0-4ac4-9a32-cdf1b7d2356f None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:10.215134 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4a756-63e0-4ac4-9a32-cdf1b7d2356f None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:10.215285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4a756-63e0-4ac4-9a32-cdf1b7d2356f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:10.233063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-48f4a756-63e0-4ac4-9a32-cdf1b7d2356f None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:10.234265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-48f4a756-63e0-4ac4-9a32-cdf1b7d2356f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:10.242843 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 693/1365] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:10.288158 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f0b88-0266-4906-989a-7dfd93e19d0d None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:10.288448 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f0b88-0266-4906-989a-7dfd93e19d0d None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:10.288733 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4f0b88-0266-4906-989a-7dfd93e19d0d None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:10.290127 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 673/1366] 10.222.0.44 () {54 vars in 961 bytes} [Thu Jun 16 00:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:10.295347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b437e-ab6c-4919-9e7d-41eaa725fde7 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:10.295701 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b437e-ab6c-4919-9e7d-41eaa725fde7 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:10.295989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b437e-ab6c-4919-9e7d-41eaa725fde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:10.314613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-c05b437e-ab6c-4919-9e7d-41eaa725fde7 None None] MFA Rules not processed for user `40432493f16b4df681daf5a1af87832a`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:10.315906 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-c05b437e-ab6c-4919-9e7d-41eaa725fde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:10.325809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 694/1367] 10.222.0.44 () {58 vars in 1058 bytes} [Thu Jun 16 00:19:10 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:19:10.334040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f0b88-0266-4906-989a-7dfd93e19d0d None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:10.348161 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4f0b88-0266-4906-989a-7dfd93e19d0d None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:10.354712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812591fa-f955-476d-b855-97b30623aa4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:10.355530 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812591fa-f955-476d-b855-97b30623aa4d service nova] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:10.356063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812591fa-f955-476d-b855-97b30623aa4d service nova] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:10.356356 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812591fa-f955-476d-b855-97b30623aa4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:10.367361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812591fa-f955-476d-b855-97b30623aa4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:10.368559 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812591fa-f955-476d-b855-97b30623aa4d service nova] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:10.381411 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 674/1368] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:12.587148 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3792b-3e88-4b62-8fbc-749caa2cf077 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:12.587581 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3792b-3e88-4b62-8fbc-749caa2cf077 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:12.587987 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b3792b-3e88-4b62-8fbc-749caa2cf077 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:12.589511 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 695/1369] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:19:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:19:12.594738 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca29490-0ca0-44ff-b76e-9f77bf648561 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:12.595194 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca29490-0ca0-44ff-b76e-9f77bf648561 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:12.595366 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca29490-0ca0-44ff-b76e-9f77bf648561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:12.614491 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-7ca29490-0ca0-44ff-b76e-9f77bf648561 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:12.616011 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-7ca29490-0ca0-44ff-b76e-9f77bf648561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:12.624207 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 675/1370] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:12.668731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3792b-3e88-4b62-8fbc-749caa2cf077 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:12.684472 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b3792b-3e88-4b62-8fbc-749caa2cf077 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:12.690015 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2c533-9bda-4d01-b7b0-ff2668ea6297 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:12.690783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2c533-9bda-4d01-b7b0-ff2668ea6297 service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:12.691172 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2c533-9bda-4d01-b7b0-ff2668ea6297 service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:12.691552 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2c533-9bda-4d01-b7b0-ff2668ea6297 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:12.700791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2c533-9bda-4d01-b7b0-ff2668ea6297 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:12.702488 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda2c533-9bda-4d01-b7b0-ff2668ea6297 service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:12.713276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 696/1371] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:19:13.113433 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4492892-c755-4e98-85eb-5289af6d0e22 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:13.113729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4492892-c755-4e98-85eb-5289af6d0e22 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:13.114214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4492892-c755-4e98-85eb-5289af6d0e22 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:13.115915 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 676/1372] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:19:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:13.121206 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29afb85-c657-40cd-a02f-33ada34f11f7 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:13.121509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29afb85-c657-40cd-a02f-33ada34f11f7 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:13.121821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29afb85-c657-40cd-a02f-33ada34f11f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:13.140353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-f29afb85-c657-40cd-a02f-33ada34f11f7 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:13.141559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-f29afb85-c657-40cd-a02f-33ada34f11f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:13.150319 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 697/1373] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:13.450665 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f16c87-0a24-4c7d-af42-c96cdb1c1ba5 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:13.450665 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f16c87-0a24-4c7d-af42-c96cdb1c1ba5 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:13.450665 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f16c87-0a24-4c7d-af42-c96cdb1c1ba5 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:13.454104 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 677/1374] 10.222.0.44 () {54 vars in 963 bytes} [Thu Jun 16 00:19:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:13.457063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e88443-5e65-4e8d-b6c1-1b0309287f2c None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:13.457434 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e88443-5e65-4e8d-b6c1-1b0309287f2c None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:13.457793 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e88443-5e65-4e8d-b6c1-1b0309287f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:13.465608 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:13.509935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-25e88443-5e65-4e8d-b6c1-1b0309287f2c None None] MFA Rules not processed for user `33ba9644ca064e95b43650424baef79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:13.511260 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-25e88443-5e65-4e8d-b6c1-1b0309287f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:13.584869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f16c87-0a24-4c7d-af42-c96cdb1c1ba5 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:13.587162 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 698/1375] 10.222.0.44 () {58 vars in 1060 bytes} [Thu Jun 16 00:19:13 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:13.598804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f16c87-0a24-4c7d-af42-c96cdb1c1ba5 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:13.603597 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a90991-53d9-495b-ba0a-a728a380c16a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:13.604473 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a90991-53d9-495b-ba0a-a728a380c16a service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:13.604766 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a90991-53d9-495b-ba0a-a728a380c16a service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:13.605042 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a90991-53d9-495b-ba0a-a728a380c16a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:13.617263 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a90991-53d9-495b-ba0a-a728a380c16a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:13.618991 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a90991-53d9-495b-ba0a-a728a380c16a service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:13.646382 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 678/1376] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:19:14.903456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9636b-75c3-4a44-83e0-4cb412ead6ab None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:14.904025 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9636b-75c3-4a44-83e0-4cb412ead6ab None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:14.904116 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce9636b-75c3-4a44-83e0-4cb412ead6ab None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:14.905451 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 699/1377] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:14.911211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdb8c4-3f2f-4278-bad1-44e625a45b22 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:14.911595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdb8c4-3f2f-4278-bad1-44e625a45b22 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:14.911799 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdb8c4-3f2f-4278-bad1-44e625a45b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:14.929634 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-cccdb8c4-3f2f-4278-bad1-44e625a45b22 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:14.930847 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-cccdb8c4-3f2f-4278-bad1-44e625a45b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:14.938674 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 679/1378] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:14.982860 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9636b-75c3-4a44-83e0-4cb412ead6ab None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:14.998106 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce9636b-75c3-4a44-83e0-4cb412ead6ab None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:15.003588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3bb9f1-a251-44fd-bdc4-bfde54802364 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:15.004288 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bb9f1-a251-44fd-bdc4-bfde54802364 service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:15.004579 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bb9f1-a251-44fd-bdc4-bfde54802364 service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:15.004862 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bb9f1-a251-44fd-bdc4-bfde54802364 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:15.013535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3bb9f1-a251-44fd-bdc4-bfde54802364 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:15.015118 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3bb9f1-a251-44fd-bdc4-bfde54802364 service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:15.024466 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 700/1379] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:17.194231 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d688a1-d899-46ca-874f-8c306247c0d8 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:17.194816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d688a1-d899-46ca-874f-8c306247c0d8 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:17.194816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d688a1-d899-46ca-874f-8c306247c0d8 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:17.196278 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 680/1380] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:17.202449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7644f8c-ee9c-4bda-bfdf-9a30c84dfcb4 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:17.203446 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7644f8c-ee9c-4bda-bfdf-9a30c84dfcb4 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:17.204605 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7644f8c-ee9c-4bda-bfdf-9a30c84dfcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:17.229815 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-c7644f8c-ee9c-4bda-bfdf-9a30c84dfcb4 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:17.231171 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-c7644f8c-ee9c-4bda-bfdf-9a30c84dfcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:17.239691 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 701/1381] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:17.283557 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d688a1-d899-46ca-874f-8c306247c0d8 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:17.298519 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d688a1-d899-46ca-874f-8c306247c0d8 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:17.304074 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcda6f4-233f-42c0-ac9f-4bea7ddcf134 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:17.304849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcda6f4-233f-42c0-ac9f-4bea7ddcf134 service nova] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:17.305232 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcda6f4-233f-42c0-ac9f-4bea7ddcf134 service nova] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:17.305674 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcda6f4-233f-42c0-ac9f-4bea7ddcf134 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:17.314950 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcda6f4-233f-42c0-ac9f-4bea7ddcf134 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:17.317369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcda6f4-233f-42c0-ac9f-4bea7ddcf134 service nova] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:17.327927 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 681/1382] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:19.474970 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3390b-a396-4579-b4f5-3ba87d9b2cb3 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:19.475487 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3390b-a396-4579-b4f5-3ba87d9b2cb3 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:19.475583 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c3390b-a396-4579-b4f5-3ba87d9b2cb3 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:19.476937 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 702/1383] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:19.482028 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60527488-66b9-48c0-8da9-c55c19b0b5f5 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:19.482430 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60527488-66b9-48c0-8da9-c55c19b0b5f5 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:19.482579 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60527488-66b9-48c0-8da9-c55c19b0b5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:19.501299 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-60527488-66b9-48c0-8da9-c55c19b0b5f5 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:19.502600 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-60527488-66b9-48c0-8da9-c55c19b0b5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:19.524774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 682/1384] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:19.553089 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3390b-a396-4579-b4f5-3ba87d9b2cb3 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:19.568972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c3390b-a396-4579-b4f5-3ba87d9b2cb3 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:19.575969 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70060d61-2a07-496b-9890-8cde951f2c48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:19.576751 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70060d61-2a07-496b-9890-8cde951f2c48 service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:19.577112 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70060d61-2a07-496b-9890-8cde951f2c48 service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:19.577416 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70060d61-2a07-496b-9890-8cde951f2c48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:19.588857 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70060d61-2a07-496b-9890-8cde951f2c48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:19.590437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70060d61-2a07-496b-9890-8cde951f2c48 service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:19.601929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 703/1385] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:21.874865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da82c2-718b-471c-b0a4-146aa3fdc8ab None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:21.875436 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da82c2-718b-471c-b0a4-146aa3fdc8ab None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:21.875436 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3da82c2-718b-471c-b0a4-146aa3fdc8ab None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:21.876845 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 683/1386] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:19:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:21.883006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43504b9-42f4-4249-b58c-d44d9a6cd299 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:21.883427 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43504b9-42f4-4249-b58c-d44d9a6cd299 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:21.883669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43504b9-42f4-4249-b58c-d44d9a6cd299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:21.901623 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-b43504b9-42f4-4249-b58c-d44d9a6cd299 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:21.902815 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-b43504b9-42f4-4249-b58c-d44d9a6cd299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:21.911298 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 704/1387] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:21.956241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da82c2-718b-471c-b0a4-146aa3fdc8ab None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:21.974825 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3da82c2-718b-471c-b0a4-146aa3fdc8ab None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:21.981888 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fec294-1a11-45ef-aac0-8577bdd16116 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:21.982748 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fec294-1a11-45ef-aac0-8577bdd16116 service nova] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:21.983114 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fec294-1a11-45ef-aac0-8577bdd16116 service nova] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:21.983483 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fec294-1a11-45ef-aac0-8577bdd16116 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:21.994895 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fec294-1a11-45ef-aac0-8577bdd16116 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:21.996570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fec294-1a11-45ef-aac0-8577bdd16116 service nova] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:22.006958 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 684/1388] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:24.148405 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff4791-2093-4c93-9498-0e6494e7e7c3 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:24.149249 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff4791-2093-4c93-9498-0e6494e7e7c3 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:24.149541 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff4791-2093-4c93-9498-0e6494e7e7c3 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:24.150959 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 705/1389] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:19:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:19:24.156295 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ce24b-9c14-4da6-9150-f91c4bb5572f None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:24.156720 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ce24b-9c14-4da6-9150-f91c4bb5572f None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:24.156859 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ce24b-9c14-4da6-9150-f91c4bb5572f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:24.175373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-3d1ce24b-9c14-4da6-9150-f91c4bb5572f None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:24.176605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-3d1ce24b-9c14-4da6-9150-f91c4bb5572f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:24.184422 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 685/1390] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:24.227184 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff4791-2093-4c93-9498-0e6494e7e7c3 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:24.241809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff4791-2093-4c93-9498-0e6494e7e7c3 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:24.247072 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b24efb9-b214-412c-ba91-9b352c749333 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:24.247738 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24efb9-b214-412c-ba91-9b352c749333 service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:24.248028 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24efb9-b214-412c-ba91-9b352c749333 service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:24.248296 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b24efb9-b214-412c-ba91-9b352c749333 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:24.257419 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24efb9-b214-412c-ba91-9b352c749333 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:24.259024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b24efb9-b214-412c-ba91-9b352c749333 service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:24.270079 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 706/1391] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:26.435489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38802734-1ad5-4bf5-8133-99a2acaabfe7 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:26.436275 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38802734-1ad5-4bf5-8133-99a2acaabfe7 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:26.436275 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38802734-1ad5-4bf5-8133-99a2acaabfe7 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:26.437510 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 686/1392] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:26.443870 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129942d4-d496-43ab-a1bb-6e028358bf3b None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:26.444338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129942d4-d496-43ab-a1bb-6e028358bf3b None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:26.444603 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129942d4-d496-43ab-a1bb-6e028358bf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:26.469096 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-129942d4-d496-43ab-a1bb-6e028358bf3b None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:26.470974 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-129942d4-d496-43ab-a1bb-6e028358bf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:26.481396 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 707/1393] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:26.535506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38802734-1ad5-4bf5-8133-99a2acaabfe7 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:26.551372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38802734-1ad5-4bf5-8133-99a2acaabfe7 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:26.557581 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7e3e7-d3c9-4297-8d17-47aeebedf547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:26.558235 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7e3e7-d3c9-4297-8d17-47aeebedf547 service nova] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:26.558526 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7e3e7-d3c9-4297-8d17-47aeebedf547 service nova] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:26.558810 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7e3e7-d3c9-4297-8d17-47aeebedf547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:26.568475 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7e3e7-d3c9-4297-8d17-47aeebedf547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:26.570087 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b7e3e7-d3c9-4297-8d17-47aeebedf547 service nova] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:26.581380 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 687/1394] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:28.801044 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af6142-e249-4537-9646-c75852cf8308 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:28.801422 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af6142-e249-4537-9646-c75852cf8308 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:28.801619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af6142-e249-4537-9646-c75852cf8308 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:28.803018 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 708/1395] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:28.808898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d3c3d-50ba-4bcb-ab58-6d6fdfb9ffde None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:28.809468 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d3c3d-50ba-4bcb-ab58-6d6fdfb9ffde None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:28.809468 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029d3c3d-50ba-4bcb-ab58-6d6fdfb9ffde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:28.826736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-029d3c3d-50ba-4bcb-ab58-6d6fdfb9ffde None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:28.827949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-029d3c3d-50ba-4bcb-ab58-6d6fdfb9ffde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:28.836358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 688/1396] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:28.842933 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba96ec1-805f-4e32-8b51-4025466e426c None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:28.843221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba96ec1-805f-4e32-8b51-4025466e426c None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:28.843498 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba96ec1-805f-4e32-8b51-4025466e426c None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:28.844904 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 709/1397] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:28.850491 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f47530-8a2d-43b4-bdfc-a20d253545db None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:28.850782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f47530-8a2d-43b4-bdfc-a20d253545db None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:28.851077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f47530-8a2d-43b4-bdfc-a20d253545db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:28.869237 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-e1f47530-8a2d-43b4-bdfc-a20d253545db None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:28.870422 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e1f47530-8a2d-43b4-bdfc-a20d253545db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:28.878304 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 689/1398] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:28.884380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba96ec1-805f-4e32-8b51-4025466e426c None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:28.899133 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba96ec1-805f-4e32-8b51-4025466e426c None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:28.904536 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c790580-163f-44aa-93db-6f79bc01b29d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:28.905261 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c790580-163f-44aa-93db-6f79bc01b29d service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:28.905553 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c790580-163f-44aa-93db-6f79bc01b29d service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:28.906318 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c790580-163f-44aa-93db-6f79bc01b29d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:28.915185 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c790580-163f-44aa-93db-6f79bc01b29d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:28.916802 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c790580-163f-44aa-93db-6f79bc01b29d service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:28.926711 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 710/1399] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:28.933919 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3abdd8-c9e3-4f7c-8b6b-7f08b7f2789d None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:28.934199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3abdd8-c9e3-4f7c-8b6b-7f08b7f2789d None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:28.934471 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3abdd8-c9e3-4f7c-8b6b-7f08b7f2789d None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:28.935850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 690/1400] 10.222.0.44 () {54 vars in 962 bytes} [Thu Jun 16 00:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:28.941209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d708b-a94d-47d9-9e01-13b6463f3a4c None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:28.941517 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d708b-a94d-47d9-9e01-13b6463f3a4c None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:28.941780 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d708b-a94d-47d9-9e01-13b6463f3a4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:28.991312 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-384d708b-a94d-47d9-9e01-13b6463f3a4c None None] MFA Rules not processed for user `faaab5440b7041faa5a6f9ea18c188c4`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:28.992559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-384d708b-a94d-47d9-9e01-13b6463f3a4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:29.037569 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:29.060395 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 711/1401] 10.222.0.44 () {58 vars in 1059 bytes} [Thu Jun 16 00:19:28 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:29.068083 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3abdd8-c9e3-4f7c-8b6b-7f08b7f2789d None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:29.079418 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3abdd8-c9e3-4f7c-8b6b-7f08b7f2789d None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:29.083557 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d99ab-ef04-48a9-aab2-802436890dbb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faaab5440b7041faa5a6f9ea18c188c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:29.084240 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d99ab-ef04-48a9-aab2-802436890dbb service glance] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:29.084521 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d99ab-ef04-48a9-aab2-802436890dbb service glance] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:29.084802 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d99ab-ef04-48a9-aab2-802436890dbb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:29.094983 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d99ab-ef04-48a9-aab2-802436890dbb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:29.097034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d99ab-ef04-48a9-aab2-802436890dbb service glance] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:29.107673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 691/1402] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:29.823460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88837464-7852-46e0-9fa6-39ca4bf23ba7 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:29.823940 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88837464-7852-46e0-9fa6-39ca4bf23ba7 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:29.824070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88837464-7852-46e0-9fa6-39ca4bf23ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:29.871694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-88837464-7852-46e0-9fa6-39ca4bf23ba7 None None] MFA Rules not processed for user `39bbc5ff02d24f40b796bd2245a7431a`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:29.872891 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-88837464-7852-46e0-9fa6-39ca4bf23ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:29.935168 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 712/1403] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 00:19:29 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:29.975431 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caebc9c-72e7-408d-9fa8-c5b6fa9c41f0 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:29.975940 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caebc9c-72e7-408d-9fa8-c5b6fa9c41f0 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:29.976156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caebc9c-72e7-408d-9fa8-c5b6fa9c41f0 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:29.977587 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 692/1404] 10.222.0.44 () {54 vars in 942 bytes} [Thu Jun 16 00:19:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:29.983889 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d9631-fbf7-4a0e-a447-6d592c5034af None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:29.984185 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d9631-fbf7-4a0e-a447-6d592c5034af None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:29.984465 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54d9631-fbf7-4a0e-a447-6d592c5034af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:30.031933 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-e54d9631-fbf7-4a0e-a447-6d592c5034af None None] MFA Rules not processed for user `9918c4a8c6a64812b61fc235ab8e7bec`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:30.033629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-e54d9631-fbf7-4a0e-a447-6d592c5034af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:30.107171 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 713/1405] 10.222.0.44 () {58 vars in 1039 bytes} [Thu Jun 16 00:19:29 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:19:30.117490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caebc9c-72e7-408d-9fa8-c5b6fa9c41f0 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:30.125032 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=64 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:30.131604 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caebc9c-72e7-408d-9fa8-c5b6fa9c41f0 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:30.136550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00a159-d34b-4357-bd50-ada3820748cf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918c4a8c6a64812b61fc235ab8e7bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:30.137195 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00a159-d34b-4357-bd50-ada3820748cf service swift] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:30.137481 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00a159-d34b-4357-bd50-ada3820748cf service swift] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:30.137760 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00a159-d34b-4357-bd50-ada3820748cf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:30.146048 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00a159-d34b-4357-bd50-ada3820748cf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:30.147653 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00a159-d34b-4357-bd50-ada3820748cf service swift] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:30.155574 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 693/1406] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 00:19:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:19:31.116052 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe942f-031a-4243-bb66-d7c0485acf6d None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:31.116546 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe942f-031a-4243-bb66-d7c0485acf6d None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:31.116645 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fe942f-031a-4243-bb66-d7c0485acf6d None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:31.118317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 714/1407] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:19:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:19:31.124880 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9e411-d45d-4d43-8eac-a746c9acc548 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:31.124880 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9e411-d45d-4d43-8eac-a746c9acc548 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:31.124880 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c9e411-d45d-4d43-8eac-a746c9acc548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:31.142361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-b2c9e411-d45d-4d43-8eac-a746c9acc548 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:31.143565 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-b2c9e411-d45d-4d43-8eac-a746c9acc548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:31.152878 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 694/1408] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:19:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:31.199221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe942f-031a-4243-bb66-d7c0485acf6d None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:31.217818 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fe942f-031a-4243-bb66-d7c0485acf6d None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:31.224977 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e7a053-b60d-4456-98e4-fe85fb64e62b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:31.226834 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7a053-b60d-4456-98e4-fe85fb64e62b service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:31.226834 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7a053-b60d-4456-98e4-fe85fb64e62b service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:31.227361 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e7a053-b60d-4456-98e4-fe85fb64e62b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:31.241472 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7a053-b60d-4456-98e4-fe85fb64e62b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:31.243112 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e7a053-b60d-4456-98e4-fe85fb64e62b service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:31.256435 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 715/1409] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:41.137011 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=8 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:41.250453 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=97 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:19:52.640081 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629b7ef-f0b8-4979-b4e5-6fe2ce954db5 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:52.641290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629b7ef-f0b8-4979-b4e5-6fe2ce954db5 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:52.641290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e629b7ef-f0b8-4979-b4e5-6fe2ce954db5 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:52.642570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 695/1410] 10.222.0.44 () {54 vars in 918 bytes} [Thu Jun 16 00:19:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:52.647511 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ee07a-15e9-445a-b382-84a55042da81 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:52.648042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ee07a-15e9-445a-b382-84a55042da81 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:52.648146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ee07a-15e9-445a-b382-84a55042da81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:52.666761 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-f52ee07a-15e9-445a-b382-84a55042da81 None None] MFA Rules not processed for user `9164f14fe6894daba1a9f2d8f1f4929c`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:52.667920 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-f52ee07a-15e9-445a-b382-84a55042da81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:52.676308 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 716/1411] 10.222.0.44 () {58 vars in 1015 bytes} [Thu Jun 16 00:19:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:52.690661 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8391e4-14c2-41a7-bca1-42e3cf6287f7 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:52.690952 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8391e4-14c2-41a7-bca1-42e3cf6287f7 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:52.691230 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8391e4-14c2-41a7-bca1-42e3cf6287f7 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:52.692600 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 696/1412] 10.222.0.44 () {54 vars in 918 bytes} [Thu Jun 16 00:19:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:52.696938 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267b757-bdc8-4995-9c50-1af6bc5d004d None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:52.697233 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267b757-bdc8-4995-9c50-1af6bc5d004d None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:52.697513 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7267b757-bdc8-4995-9c50-1af6bc5d004d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:52.715332 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-7267b757-bdc8-4995-9c50-1af6bc5d004d None None] MFA Rules not processed for user `40432493f16b4df681daf5a1af87832a`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:52.716547 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-7267b757-bdc8-4995-9c50-1af6bc5d004d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:52.725698 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 717/1413] 10.222.0.44 () {58 vars in 1015 bytes} [Thu Jun 16 00:19:52 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:55.305270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db6651-9842-4aa1-9512-916dc7441484 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:55.305836 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db6651-9842-4aa1-9512-916dc7441484 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:55.305836 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21db6651-9842-4aa1-9512-916dc7441484 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:55.307186 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 697/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:19:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:55.312511 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332e5c3-0de5-4f1b-9e7d-4c34d88d7c80 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:55.312940 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332e5c3-0de5-4f1b-9e7d-4c34d88d7c80 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:55.313177 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332e5c3-0de5-4f1b-9e7d-4c34d88d7c80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:55.330965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-9332e5c3-0de5-4f1b-9e7d-4c34d88d7c80 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:55.332201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-9332e5c3-0de5-4f1b-9e7d-4c34d88d7c80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:55.339889 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 718/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:19:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:55.382752 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db6651-9842-4aa1-9512-916dc7441484 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:55.398858 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21db6651-9842-4aa1-9512-916dc7441484 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:55.404312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1493f637-be34-4b59-96f4-9a8e41fd60cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:55.404949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493f637-be34-4b59-96f4-9a8e41fd60cd service nova] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:55.405238 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493f637-be34-4b59-96f4-9a8e41fd60cd service nova] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:55.405518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493f637-be34-4b59-96f4-9a8e41fd60cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:55.414179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493f637-be34-4b59-96f4-9a8e41fd60cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:55.415819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1493f637-be34-4b59-96f4-9a8e41fd60cd service nova] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:55.425181 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 698/1416] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:19:56.373014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0155de-235a-40f3-96cc-b583001db550 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:56.373581 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0155de-235a-40f3-96cc-b583001db550 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:56.373581 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0155de-235a-40f3-96cc-b583001db550 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:56.374923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 719/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:56.380312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4038c8-0bfe-4d1b-9a15-4e9fb70df719 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:56.380716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4038c8-0bfe-4d1b-9a15-4e9fb70df719 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:56.380874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4038c8-0bfe-4d1b-9a15-4e9fb70df719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:56.399025 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-ca4038c8-0bfe-4d1b-9a15-4e9fb70df719 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:56.400521 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-ca4038c8-0bfe-4d1b-9a15-4e9fb70df719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:56.409527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 699/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:19:56.559167 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0155de-235a-40f3-96cc-b583001db550 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:56.573963 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0155de-235a-40f3-96cc-b583001db550 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:56.579318 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60d8e9-c1fb-4fb9-b1d6-df7b33b6e784 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:56.579987 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60d8e9-c1fb-4fb9-b1d6-df7b33b6e784 service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:56.580273 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60d8e9-c1fb-4fb9-b1d6-df7b33b6e784 service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:56.580549 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60d8e9-c1fb-4fb9-b1d6-df7b33b6e784 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:56.589134 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60d8e9-c1fb-4fb9-b1d6-df7b33b6e784 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:56.590719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60d8e9-c1fb-4fb9-b1d6-df7b33b6e784 service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:56.600093 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 720/1419] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:57.519286 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532f4a8-b254-4b2f-8b43-526c74eb02cd None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:57.519867 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532f4a8-b254-4b2f-8b43-526c74eb02cd None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:57.519867 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3532f4a8-b254-4b2f-8b43-526c74eb02cd None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:57.521296 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 700/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:57.526187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc066130-57c7-4c81-bce6-5f9f1a36a6d7 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:57.526584 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc066130-57c7-4c81-bce6-5f9f1a36a6d7 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:57.526751 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc066130-57c7-4c81-bce6-5f9f1a36a6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:57.544989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-fc066130-57c7-4c81-bce6-5f9f1a36a6d7 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:57.546192 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-fc066130-57c7-4c81-bce6-5f9f1a36a6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:57.554292 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 721/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:19:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:57.708105 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532f4a8-b254-4b2f-8b43-526c74eb02cd None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:57.722218 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3532f4a8-b254-4b2f-8b43-526c74eb02cd None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:57.727482 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec27da5-e59c-4817-ba06-8900919925f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:57.728230 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec27da5-e59c-4817-ba06-8900919925f1 service nova] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:57.728517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec27da5-e59c-4817-ba06-8900919925f1 service nova] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:57.728789 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec27da5-e59c-4817-ba06-8900919925f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:57.737059 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec27da5-e59c-4817-ba06-8900919925f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:57.738660 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec27da5-e59c-4817-ba06-8900919925f1 service nova] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:57.747808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 701/1422] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:58.646258 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca3ac2-e94a-4a14-91ef-58c4d4f4ef8e None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:58.646836 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca3ac2-e94a-4a14-91ef-58c4d4f4ef8e None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:58.646836 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dca3ac2-e94a-4a14-91ef-58c4d4f4ef8e None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:58.648214 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 722/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:58.653018 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c6d5d-a387-440f-bbee-6f7e51da2fe6 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:58.653403 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c6d5d-a387-440f-bbee-6f7e51da2fe6 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:58.653725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c6d5d-a387-440f-bbee-6f7e51da2fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:58.671937 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-fa1c6d5d-a387-440f-bbee-6f7e51da2fe6 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:58.673117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-fa1c6d5d-a387-440f-bbee-6f7e51da2fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:58.681317 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 702/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:19:58.832154 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca3ac2-e94a-4a14-91ef-58c4d4f4ef8e None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:58.846867 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dca3ac2-e94a-4a14-91ef-58c4d4f4ef8e None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:58.852204 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d67047-da73-4efb-b3e1-83b677b2cc8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:58.852830 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d67047-da73-4efb-b3e1-83b677b2cc8f service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:58.853114 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d67047-da73-4efb-b3e1-83b677b2cc8f service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:58.853391 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d67047-da73-4efb-b3e1-83b677b2cc8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:58.862126 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d67047-da73-4efb-b3e1-83b677b2cc8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:58.863725 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d67047-da73-4efb-b3e1-83b677b2cc8f service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:58.872935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 723/1425] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:19:59.771403 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca502a65-40bc-4b38-97b0-e2213709ceb7 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:59.772002 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca502a65-40bc-4b38-97b0-e2213709ceb7 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:59.772002 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca502a65-40bc-4b38-97b0-e2213709ceb7 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:59.773378 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 703/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:19:59.778275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c1f5c-17e3-4460-99df-9f43d50d76a2 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:59.778713 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c1f5c-17e3-4460-99df-9f43d50d76a2 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:59.778822 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90c1f5c-17e3-4460-99df-9f43d50d76a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:59.797619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-b90c1f5c-17e3-4460-99df-9f43d50d76a2 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:19:59.798694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-b90c1f5c-17e3-4460-99df-9f43d50d76a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:19:59.806738 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 724/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:19:59.958570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca502a65-40bc-4b38-97b0-e2213709ceb7 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:19:59.973101 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca502a65-40bc-4b38-97b0-e2213709ceb7 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:19:59.978367 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75ee108-c420-45e2-9321-0ce0b9bf139a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:19:59.978992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ee108-c420-45e2-9321-0ce0b9bf139a service nova] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:19:59.979274 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ee108-c420-45e2-9321-0ce0b9bf139a service nova] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:19:59.979546 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75ee108-c420-45e2-9321-0ce0b9bf139a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:19:59.988249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ee108-c420-45e2-9321-0ce0b9bf139a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:19:59.989822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75ee108-c420-45e2-9321-0ce0b9bf139a service nova] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:19:59.998915 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 704/1428] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:19:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:00.843310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465433c-60f5-4d6c-bc9e-38704c9fcdc8 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:00.843830 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465433c-60f5-4d6c-bc9e-38704c9fcdc8 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:00.843941 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6465433c-60f5-4d6c-bc9e-38704c9fcdc8 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:00.845286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 725/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:20:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:00.850118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7043e5-8fed-411e-ad3f-ead2b13bcd49 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:00.850532 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7043e5-8fed-411e-ad3f-ead2b13bcd49 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:00.850683 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7043e5-8fed-411e-ad3f-ead2b13bcd49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:00.868777 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-da7043e5-8fed-411e-ad3f-ead2b13bcd49 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:00.869969 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-da7043e5-8fed-411e-ad3f-ead2b13bcd49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:00.878539 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 705/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:20:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:01.030208 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465433c-60f5-4d6c-bc9e-38704c9fcdc8 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:01.044413 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6465433c-60f5-4d6c-bc9e-38704c9fcdc8 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:01.050339 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c43cb5-1bba-4d0e-bfd4-7249835f46b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:01.050915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c43cb5-1bba-4d0e-bfd4-7249835f46b2 service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:01.051203 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c43cb5-1bba-4d0e-bfd4-7249835f46b2 service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:01.051486 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c43cb5-1bba-4d0e-bfd4-7249835f46b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:01.059529 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c43cb5-1bba-4d0e-bfd4-7249835f46b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:01.061139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c43cb5-1bba-4d0e-bfd4-7249835f46b2 service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:01.070878 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 726/1431] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:01.914703 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75edbb4-dab6-46ce-968f-0478f1e6190c None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:01.915247 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75edbb4-dab6-46ce-968f-0478f1e6190c None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:01.915247 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75edbb4-dab6-46ce-968f-0478f1e6190c None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:01.916674 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 706/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:01.921486 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9bd4d-004a-4839-b002-b0453583c506 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:01.921904 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9bd4d-004a-4839-b002-b0453583c506 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:01.922097 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c9bd4d-004a-4839-b002-b0453583c506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:01.939806 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-49c9bd4d-004a-4839-b002-b0453583c506 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:01.941009 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-49c9bd4d-004a-4839-b002-b0453583c506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:01.948846 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 727/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:02.099397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75edbb4-dab6-46ce-968f-0478f1e6190c None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:02.113961 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75edbb4-dab6-46ce-968f-0478f1e6190c None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:02.119361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acae4e2-3d4d-451b-9a70-00d60885151a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:02.120030 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acae4e2-3d4d-451b-9a70-00d60885151a service nova] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:02.120317 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acae4e2-3d4d-451b-9a70-00d60885151a service nova] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:02.120593 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acae4e2-3d4d-451b-9a70-00d60885151a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:02.128549 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acae4e2-3d4d-451b-9a70-00d60885151a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:02.130136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acae4e2-3d4d-451b-9a70-00d60885151a service nova] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:02.139511 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 707/1434] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:02.982236 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e989a36-5060-436a-8a0f-58ea7477a642 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:02.982768 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e989a36-5060-436a-8a0f-58ea7477a642 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:02.982768 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e989a36-5060-436a-8a0f-58ea7477a642 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:02.984204 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 728/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:02.989327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb71e1-05af-4016-ada1-cde32fe6a7d9 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:02.989750 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb71e1-05af-4016-ada1-cde32fe6a7d9 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:02.989898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcb71e1-05af-4016-ada1-cde32fe6a7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:03.008372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-0bcb71e1-05af-4016-ada1-cde32fe6a7d9 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:03.009572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-0bcb71e1-05af-4016-ada1-cde32fe6a7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:03.017292 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 708/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:20:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:03.168258 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e989a36-5060-436a-8a0f-58ea7477a642 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:03.182316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e989a36-5060-436a-8a0f-58ea7477a642 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:03.187697 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1852bf7-5609-4344-979c-f316474d4d10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:03.188330 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1852bf7-5609-4344-979c-f316474d4d10 service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:03.188620 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1852bf7-5609-4344-979c-f316474d4d10 service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:03.188902 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1852bf7-5609-4344-979c-f316474d4d10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:03.197453 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1852bf7-5609-4344-979c-f316474d4d10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:03.199026 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1852bf7-5609-4344-979c-f316474d4d10 service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:03.208959 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 729/1437] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:20:04.054742 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5adc9-a08c-4483-94ab-c502ac2be007 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:04.055268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5adc9-a08c-4483-94ab-c502ac2be007 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:04.055268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b5adc9-a08c-4483-94ab-c502ac2be007 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:04.056592 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 709/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:20:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:04.061479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090002a-7a40-4927-850c-5b9a7695577d None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:04.061877 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090002a-7a40-4927-850c-5b9a7695577d None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:04.062031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090002a-7a40-4927-850c-5b9a7695577d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:04.080127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-6090002a-7a40-4927-850c-5b9a7695577d None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:04.081308 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-6090002a-7a40-4927-850c-5b9a7695577d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:04.089286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 730/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:04.238280 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5adc9-a08c-4483-94ab-c502ac2be007 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:04.252490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b5adc9-a08c-4483-94ab-c502ac2be007 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:04.258374 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7e5d16-af6a-4e4e-8dcf-f9f409c00a33 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:04.259005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e5d16-af6a-4e4e-8dcf-f9f409c00a33 service nova] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:04.259290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e5d16-af6a-4e4e-8dcf-f9f409c00a33 service nova] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:04.259566 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7e5d16-af6a-4e4e-8dcf-f9f409c00a33 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:04.267929 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e5d16-af6a-4e4e-8dcf-f9f409c00a33 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:04.269518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7e5d16-af6a-4e4e-8dcf-f9f409c00a33 service nova] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:04.278908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 710/1440] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:06.284745 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c1f76-d5ca-46da-a746-fc3a1186c81e None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:06.285393 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c1f76-d5ca-46da-a746-fc3a1186c81e None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:06.285393 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c1f76-d5ca-46da-a746-fc3a1186c81e None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:06.286709 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 731/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:06.292228 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe600b-1d3a-4e4e-8c96-0173f4bfe022 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:06.292658 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe600b-1d3a-4e4e-8c96-0173f4bfe022 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:06.292859 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fe600b-1d3a-4e4e-8c96-0173f4bfe022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:06.310599 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-25fe600b-1d3a-4e4e-8c96-0173f4bfe022 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:06.311819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-25fe600b-1d3a-4e4e-8c96-0173f4bfe022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:06.320208 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 711/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:20:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:20:06.357465 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c1f76-d5ca-46da-a746-fc3a1186c81e None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:06.368717 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c1f76-d5ca-46da-a746-fc3a1186c81e None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:06.372193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b680ea0-249d-4b1b-9046-477fe122ff1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:06.372819 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b680ea0-249d-4b1b-9046-477fe122ff1a service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:06.373103 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b680ea0-249d-4b1b-9046-477fe122ff1a service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:06.373381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b680ea0-249d-4b1b-9046-477fe122ff1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:06.382722 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b680ea0-249d-4b1b-9046-477fe122ff1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:06.384190 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b680ea0-249d-4b1b-9046-477fe122ff1a service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:06.393346 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 732/1443] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:08.750766 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f50b7-5bdf-48ba-8756-c9a0a57fa772 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:08.751331 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f50b7-5bdf-48ba-8756-c9a0a57fa772 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:08.751331 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68f50b7-5bdf-48ba-8756-c9a0a57fa772 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:08.752757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 712/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:20:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:08.758178 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb73c7-e6a6-4244-956b-df46ff0fd7f9 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:08.758588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb73c7-e6a6-4244-956b-df46ff0fd7f9 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:08.758737 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb73c7-e6a6-4244-956b-df46ff0fd7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:08.776597 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-f1fb73c7-e6a6-4244-956b-df46ff0fd7f9 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:08.777777 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-f1fb73c7-e6a6-4244-956b-df46ff0fd7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:08.785550 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 733/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:20:08.823263 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f50b7-5bdf-48ba-8756-c9a0a57fa772 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:08.824977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a68f50b7-5bdf-48ba-8756-c9a0a57fa772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:08.838442 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68f50b7-5bdf-48ba-8756-c9a0a57fa772 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:08.841931 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46771b4e-2348-415e-8698-7a07f744f49e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:08.842566 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46771b4e-2348-415e-8698-7a07f744f49e service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:08.842849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46771b4e-2348-415e-8698-7a07f744f49e service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:08.843126 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46771b4e-2348-415e-8698-7a07f744f49e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:08.852390 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46771b4e-2348-415e-8698-7a07f744f49e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:08.853830 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46771b4e-2348-415e-8698-7a07f744f49e service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:08.863202 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 713/1446] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:11.276214 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b51e46-23fe-47a0-a479-c245deda6614 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:11.276744 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b51e46-23fe-47a0-a479-c245deda6614 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:11.276844 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b51e46-23fe-47a0-a479-c245deda6614 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:11.278151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 734/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 16 00:20:11.283433 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01401c3-48f4-46fe-8ffe-7ae022387418 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:11.283861 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01401c3-48f4-46fe-8ffe-7ae022387418 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:11.284040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01401c3-48f4-46fe-8ffe-7ae022387418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:11.302617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-b01401c3-48f4-46fe-8ffe-7ae022387418 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:11.303832 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-b01401c3-48f4-46fe-8ffe-7ae022387418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:11.311507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 714/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:20:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:11.349288 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b51e46-23fe-47a0-a479-c245deda6614 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:11.359933 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b51e46-23fe-47a0-a479-c245deda6614 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:11.363394 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2690032d-640e-4350-a4bf-bd2d83d380f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:11.364058 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690032d-640e-4350-a4bf-bd2d83d380f5 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:11.364346 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690032d-640e-4350-a4bf-bd2d83d380f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:11.365416 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2690032d-640e-4350-a4bf-bd2d83d380f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:11.374250 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690032d-640e-4350-a4bf-bd2d83d380f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:11.375722 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2690032d-640e-4350-a4bf-bd2d83d380f5 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:11.384984 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 735/1449] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:13.620845 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb240739-9602-4a4e-9763-314278c683e7 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:13.621461 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb240739-9602-4a4e-9763-314278c683e7 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:13.621461 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb240739-9602-4a4e-9763-314278c683e7 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:13.622793 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 715/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:20:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:13.628032 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fab09-a672-4285-9b76-541f249a40f0 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:13.628462 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fab09-a672-4285-9b76-541f249a40f0 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:13.628719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0fab09-a672-4285-9b76-541f249a40f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:13.648037 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-9d0fab09-a672-4285-9b76-541f249a40f0 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:13.649299 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-9d0fab09-a672-4285-9b76-541f249a40f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:13.657583 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 736/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:20:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:13.695344 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb240739-9602-4a4e-9763-314278c683e7 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:13.706028 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb240739-9602-4a4e-9763-314278c683e7 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:13.710228 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408bcbf-4ea5-4b10-b24a-eb1930704a81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:13.710903 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408bcbf-4ea5-4b10-b24a-eb1930704a81 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:13.711201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408bcbf-4ea5-4b10-b24a-eb1930704a81 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:13.711497 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408bcbf-4ea5-4b10-b24a-eb1930704a81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:13.720945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408bcbf-4ea5-4b10-b24a-eb1930704a81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:13.722460 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2408bcbf-4ea5-4b10-b24a-eb1930704a81 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:13.732328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 716/1452] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:15.929675 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd8ae1-ee15-44a1-8d6a-76573e1807c9 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:15.930239 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd8ae1-ee15-44a1-8d6a-76573e1807c9 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:15.930239 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcd8ae1-ee15-44a1-8d6a-76573e1807c9 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:15.931541 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 737/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:15.936882 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a89437-9759-443e-a761-1b0b92014e17 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:15.937337 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a89437-9759-443e-a761-1b0b92014e17 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:15.937450 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a89437-9759-443e-a761-1b0b92014e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:15.955418 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-73a89437-9759-443e-a761-1b0b92014e17 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:15.956655 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-73a89437-9759-443e-a761-1b0b92014e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:15.964911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 717/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:20:16.002659 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd8ae1-ee15-44a1-8d6a-76573e1807c9 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:16.013997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcd8ae1-ee15-44a1-8d6a-76573e1807c9 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:16.017548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60693a1f-d98f-4c79-9be1-f83771366264 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:16.018176 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60693a1f-d98f-4c79-9be1-f83771366264 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:16.018462 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60693a1f-d98f-4c79-9be1-f83771366264 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:16.018741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60693a1f-d98f-4c79-9be1-f83771366264 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:16.028286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60693a1f-d98f-4c79-9be1-f83771366264 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:16.029720 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60693a1f-d98f-4c79-9be1-f83771366264 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:16.039116 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 738/1455] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:18.226492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3071f-7c19-4bef-9b1c-74e5fdf9468d None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:18.227028 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3071f-7c19-4bef-9b1c-74e5fdf9468d None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:18.227028 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3071f-7c19-4bef-9b1c-74e5fdf9468d None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:18.228460 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 718/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:20:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:18.233775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c443e-50db-4289-aeb2-b83c06ad94e7 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:18.234195 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c443e-50db-4289-aeb2-b83c06ad94e7 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:18.234356 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c443e-50db-4289-aeb2-b83c06ad94e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:18.252661 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-d32c443e-50db-4289-aeb2-b83c06ad94e7 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:18.253860 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-d32c443e-50db-4289-aeb2-b83c06ad94e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:18.261653 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 739/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:20:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:18.298992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3071f-7c19-4bef-9b1c-74e5fdf9468d None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:18.310168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3071f-7c19-4bef-9b1c-74e5fdf9468d None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:18.313639 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee9be89-49fa-444e-999e-54547d439b9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:18.314270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9be89-49fa-444e-999e-54547d439b9d service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:18.314560 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9be89-49fa-444e-999e-54547d439b9d service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:18.314838 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee9be89-49fa-444e-999e-54547d439b9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:18.324252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9be89-49fa-444e-999e-54547d439b9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:18.325704 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee9be89-49fa-444e-999e-54547d439b9d service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:18.335079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 719/1458] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:20.517700 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966da0c-be8e-48d0-b05a-a1b3b9d85a50 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:20.518265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966da0c-be8e-48d0-b05a-a1b3b9d85a50 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:20.518265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c966da0c-be8e-48d0-b05a-a1b3b9d85a50 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:20.519650 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 740/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:20:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:20.525397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298895ed-aa0a-49ec-94f0-3e2566d1c343 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:20.525804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298895ed-aa0a-49ec-94f0-3e2566d1c343 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:20.525978 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298895ed-aa0a-49ec-94f0-3e2566d1c343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:20.543787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-298895ed-aa0a-49ec-94f0-3e2566d1c343 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:20.544986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-298895ed-aa0a-49ec-94f0-3e2566d1c343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:20.552764 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 720/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:20:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:20.589923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966da0c-be8e-48d0-b05a-a1b3b9d85a50 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:20.600539 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c966da0c-be8e-48d0-b05a-a1b3b9d85a50 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:20.604695 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8596b416-dcc7-4117-ab6f-11fd28af5bd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:20.605328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596b416-dcc7-4117-ab6f-11fd28af5bd5 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:20.605612 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596b416-dcc7-4117-ab6f-11fd28af5bd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:20.605889 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8596b416-dcc7-4117-ab6f-11fd28af5bd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:20.614607 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596b416-dcc7-4117-ab6f-11fd28af5bd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:20.616108 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8596b416-dcc7-4117-ab6f-11fd28af5bd5 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:20.625651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 741/1461] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:22.781767 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04acb9-e7f0-4b86-bace-6d00fc882700 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:22.782332 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04acb9-e7f0-4b86-bace-6d00fc882700 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:22.782332 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04acb9-e7f0-4b86-bace-6d00fc882700 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:22.783735 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 721/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:22.789809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedc6ac-55da-40d1-bb5a-159dd8c5cbb9 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:22.790236 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedc6ac-55da-40d1-bb5a-159dd8c5cbb9 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:22.790371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caedc6ac-55da-40d1-bb5a-159dd8c5cbb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:22.796370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=79 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:22.809020 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-caedc6ac-55da-40d1-bb5a-159dd8c5cbb9 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:22.810268 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-caedc6ac-55da-40d1-bb5a-159dd8c5cbb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:22.818227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 742/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:20:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:22.855528 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04acb9-e7f0-4b86-bace-6d00fc882700 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:22.860999 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=73 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:22.867262 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04acb9-e7f0-4b86-bace-6d00fc882700 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:22.871053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed418e2-a7bc-4dca-89ad-8f281bd5f099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:22.871717 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed418e2-a7bc-4dca-89ad-8f281bd5f099 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:22.872004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed418e2-a7bc-4dca-89ad-8f281bd5f099 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:22.872281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed418e2-a7bc-4dca-89ad-8f281bd5f099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:22.881015 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed418e2-a7bc-4dca-89ad-8f281bd5f099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:22.882440 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed418e2-a7bc-4dca-89ad-8f281bd5f099 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:22.891607 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 722/1464] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:24.998884 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc461c-631f-4c32-9950-9fdaf48025b9 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:24.999455 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc461c-631f-4c32-9950-9fdaf48025b9 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:24.999455 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcc461c-631f-4c32-9950-9fdaf48025b9 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:25.000888 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 743/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:20:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:25.005950 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6505a-ef02-4034-9da8-549f9c4279ba None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:25.006420 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6505a-ef02-4034-9da8-549f9c4279ba None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:25.006528 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a6505a-ef02-4034-9da8-549f9c4279ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:25.024582 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-39a6505a-ef02-4034-9da8-549f9c4279ba None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:25.025777 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-39a6505a-ef02-4034-9da8-549f9c4279ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:25.033462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 723/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:25.070230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc461c-631f-4c32-9950-9fdaf48025b9 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:25.080906 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcc461c-631f-4c32-9950-9fdaf48025b9 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:25.084454 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84beca2-e3bb-4a04-9911-0af3e6d99759 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:25.085089 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84beca2-e3bb-4a04-9911-0af3e6d99759 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:25.085377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84beca2-e3bb-4a04-9911-0af3e6d99759 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:25.085680 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84beca2-e3bb-4a04-9911-0af3e6d99759 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:25.095006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84beca2-e3bb-4a04-9911-0af3e6d99759 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:25.096485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84beca2-e3bb-4a04-9911-0af3e6d99759 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:25.106351 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 744/1467] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:27.219089 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a73e08-69ba-4e02-a67f-6186ea1f9500 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:27.219691 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a73e08-69ba-4e02-a67f-6186ea1f9500 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:27.219691 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a73e08-69ba-4e02-a67f-6186ea1f9500 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:27.221053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 724/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:20:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:27.226354 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7ee9c-e4fa-4f42-bc69-02d5cc31ffe3 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:27.226786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7ee9c-e4fa-4f42-bc69-02d5cc31ffe3 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:27.226924 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7ee9c-e4fa-4f42-bc69-02d5cc31ffe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:27.248760 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-39b7ee9c-e4fa-4f42-bc69-02d5cc31ffe3 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:27.249960 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-39b7ee9c-e4fa-4f42-bc69-02d5cc31ffe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:27.257769 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 745/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:20:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:27.295056 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a73e08-69ba-4e02-a67f-6186ea1f9500 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:27.306712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a73e08-69ba-4e02-a67f-6186ea1f9500 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:27.310372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221612e-4658-4b85-ad7e-b93be8e91da9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:27.311053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221612e-4658-4b85-ad7e-b93be8e91da9 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:27.311344 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221612e-4658-4b85-ad7e-b93be8e91da9 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:27.311634 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221612e-4658-4b85-ad7e-b93be8e91da9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:27.323125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221612e-4658-4b85-ad7e-b93be8e91da9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:27.324624 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221612e-4658-4b85-ad7e-b93be8e91da9 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:27.334543 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 725/1470] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:37.243324 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=11 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:37.330263 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=14 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:20:47.258583 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61908ce9-8464-4316-8e02-8cfbfb977b44 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:47.259208 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61908ce9-8464-4316-8e02-8cfbfb977b44 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:47.259208 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61908ce9-8464-4316-8e02-8cfbfb977b44 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:47.260571 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 746/1471] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:20:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:47.266371 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d180c-fa6a-46fc-9367-34a8d1d794da None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:47.266798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d180c-fa6a-46fc-9367-34a8d1d794da None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:47.266935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d180c-fa6a-46fc-9367-34a8d1d794da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:47.284879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-3f1d180c-fa6a-46fc-9367-34a8d1d794da None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:47.286099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-3f1d180c-fa6a-46fc-9367-34a8d1d794da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:47.293939 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 726/1472] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:47.339603 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a6e27-4897-4336-892a-fe2bde025340 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:47.339926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a6e27-4897-4336-892a-fe2bde025340 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:47.340244 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a6e27-4897-4336-892a-fe2bde025340 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:47.342205 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 747/1473] 10.222.0.44 () {54 vars in 962 bytes} [Thu Jun 16 00:20:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:47.346876 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef0400-9d0d-45e4-899b-f879f50fc5de None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:47.347170 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef0400-9d0d-45e4-899b-f879f50fc5de None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:47.347445 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afef0400-9d0d-45e4-899b-f879f50fc5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:47.365626 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-afef0400-9d0d-45e4-899b-f879f50fc5de None None] MFA Rules not processed for user `faaab5440b7041faa5a6f9ea18c188c4`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:47.366834 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-afef0400-9d0d-45e4-899b-f879f50fc5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:47.373191 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 727/1474] 10.222.0.44 () {58 vars in 1059 bytes} [Thu Jun 16 00:20:47 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:47.380389 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a6e27-4897-4336-892a-fe2bde025340 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:47.391423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a6e27-4897-4336-892a-fe2bde025340 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:47.394964 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d90478b-8515-49a9-a002-1355ef97a482 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faaab5440b7041faa5a6f9ea18c188c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:47.395587 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90478b-8515-49a9-a002-1355ef97a482 service glance] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:47.395970 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90478b-8515-49a9-a002-1355ef97a482 service glance] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:47.396254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d90478b-8515-49a9-a002-1355ef97a482 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:47.405754 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90478b-8515-49a9-a002-1355ef97a482 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:47.407180 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d90478b-8515-49a9-a002-1355ef97a482 service glance] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:47.416536 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 748/1475] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:49.629183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432f8d4-7966-44ed-af94-0b57543785d2 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:49.629751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432f8d4-7966-44ed-af94-0b57543785d2 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:49.629751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0432f8d4-7966-44ed-af94-0b57543785d2 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:49.631115 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 728/1476] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:20:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:49.636221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04282ef8-22d9-4e31-93c9-807adef69ac4 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:49.636625 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04282ef8-22d9-4e31-93c9-807adef69ac4 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:49.636777 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04282ef8-22d9-4e31-93c9-807adef69ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:49.655104 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-04282ef8-22d9-4e31-93c9-807adef69ac4 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:49.656331 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-04282ef8-22d9-4e31-93c9-807adef69ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:49.664304 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 749/1477] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:49.688332 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432f8d4-7966-44ed-af94-0b57543785d2 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:49.700640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0432f8d4-7966-44ed-af94-0b57543785d2 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:49.705106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6ce9d-c813-4755-a987-be3f8d4511e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:49.705747 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6ce9d-c813-4755-a987-be3f8d4511e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:49.706034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6ce9d-c813-4755-a987-be3f8d4511e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:49.706345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6ce9d-c813-4755-a987-be3f8d4511e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:49.707075 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6ce9d-c813-4755-a987-be3f8d4511e1 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:49.708868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: WARNING py.warnings [None req-3ff6ce9d-c813-4755-a987-be3f8d4511e1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:20:49.708868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: warnings.warn(msg) Jun 16 00:20:49.708868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: Jun 16 00:20:49.710018 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6ce9d-c813-4755-a987-be3f8d4511e1 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:49.728698 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 729/1478] 10.222.0.44 () {56 vars in 1108 bytes} [Thu Jun 16 00:20:49 2022] GET /identity/v3/projects => generated 2553 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:20:51.849909 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b90e12-e720-48da-add2-2207f5fe778b None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:51.850466 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b90e12-e720-48da-add2-2207f5fe778b None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:51.850466 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b90e12-e720-48da-add2-2207f5fe778b None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:51.851871 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 750/1479] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:20:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:51.857083 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11ae56-d382-4017-a5b3-970ed2617114 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:51.857547 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11ae56-d382-4017-a5b3-970ed2617114 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:51.857659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a11ae56-d382-4017-a5b3-970ed2617114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:51.875708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-6a11ae56-d382-4017-a5b3-970ed2617114 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:51.876887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-6a11ae56-d382-4017-a5b3-970ed2617114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:51.884750 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 730/1480] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:51.926858 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b90e12-e720-48da-add2-2207f5fe778b None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:51.941002 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b90e12-e720-48da-add2-2207f5fe778b None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:51.946304 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f215bfb4-ff6a-4fcd-8b7b-c6792f5674ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:51.946930 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215bfb4-ff6a-4fcd-8b7b-c6792f5674ca service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:51.947212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215bfb4-ff6a-4fcd-8b7b-c6792f5674ca service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:51.947493 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f215bfb4-ff6a-4fcd-8b7b-c6792f5674ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:51.955949 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215bfb4-ff6a-4fcd-8b7b-c6792f5674ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:51.957519 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f215bfb4-ff6a-4fcd-8b7b-c6792f5674ca service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:51.966682 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 751/1481] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:54.283886 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bb55b-2bff-4ef7-b9d6-ee2fe55ded2a None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:54.284451 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bb55b-2bff-4ef7-b9d6-ee2fe55ded2a None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:54.284451 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21bb55b-2bff-4ef7-b9d6-ee2fe55ded2a None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:54.285838 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 731/1482] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:20:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:54.290936 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7870c-795f-48c6-a00b-4c0d4983ebeb None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:54.291341 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7870c-795f-48c6-a00b-4c0d4983ebeb None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:54.291502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be7870c-795f-48c6-a00b-4c0d4983ebeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:54.309069 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-5be7870c-795f-48c6-a00b-4c0d4983ebeb None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:54.310264 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-5be7870c-795f-48c6-a00b-4c0d4983ebeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:54.318526 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 752/1483] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:54.353976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bb55b-2bff-4ef7-b9d6-ee2fe55ded2a None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:54.364759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21bb55b-2bff-4ef7-b9d6-ee2fe55ded2a None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:54.368383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51dd07b-d6fd-4646-b6aa-8a3ffbcadb6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:54.369045 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dd07b-d6fd-4646-b6aa-8a3ffbcadb6b service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:54.369332 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dd07b-d6fd-4646-b6aa-8a3ffbcadb6b service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:54.369609 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dd07b-d6fd-4646-b6aa-8a3ffbcadb6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:54.379427 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51dd07b-d6fd-4646-b6aa-8a3ffbcadb6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:54.380892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51dd07b-d6fd-4646-b6aa-8a3ffbcadb6b service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:54.390716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 732/1484] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:56.543573 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f418d1-4cc7-41c4-80dd-80d673b0c3e4 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:56.544072 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f418d1-4cc7-41c4-80dd-80d673b0c3e4 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:56.544201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f418d1-4cc7-41c4-80dd-80d673b0c3e4 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:56.545934 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 753/1485] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:20:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:56.551072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc4640-e099-4a4e-827d-f993bca7a6ea None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:56.551526 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc4640-e099-4a4e-827d-f993bca7a6ea None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:56.551783 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc4640-e099-4a4e-827d-f993bca7a6ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:56.570079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-b1bc4640-e099-4a4e-827d-f993bca7a6ea None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:56.571282 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-b1bc4640-e099-4a4e-827d-f993bca7a6ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:56.579875 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 733/1486] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:56.621017 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f418d1-4cc7-41c4-80dd-80d673b0c3e4 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:56.632489 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f418d1-4cc7-41c4-80dd-80d673b0c3e4 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:56.635958 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6b767-a537-42e1-9117-c79fa52ccfb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:56.636593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6b767-a537-42e1-9117-c79fa52ccfb0 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:56.636880 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6b767-a537-42e1-9117-c79fa52ccfb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:56.637159 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6b767-a537-42e1-9117-c79fa52ccfb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:56.646528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6b767-a537-42e1-9117-c79fa52ccfb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:56.648005 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6b767-a537-42e1-9117-c79fa52ccfb0 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:56.657465 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 754/1487] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:20:58.848824 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3bfaf-c5b5-4264-aa78-9f6d3cb1a8fe None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:58.849350 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3bfaf-c5b5-4264-aa78-9f6d3cb1a8fe None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:58.849350 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe3bfaf-c5b5-4264-aa78-9f6d3cb1a8fe None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:58.850759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 734/1488] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:20:58.855997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e521c-9f01-45be-a78e-5536d5e29477 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:58.856451 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e521c-9f01-45be-a78e-5536d5e29477 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:58.856564 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e521c-9f01-45be-a78e-5536d5e29477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:58.873908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-5f0e521c-9f01-45be-a78e-5536d5e29477 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:20:58.875642 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-5f0e521c-9f01-45be-a78e-5536d5e29477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:20:58.883555 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 755/1489] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:20:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:20:58.922923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3bfaf-c5b5-4264-aa78-9f6d3cb1a8fe None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:20:58.933628 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe3bfaf-c5b5-4264-aa78-9f6d3cb1a8fe None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:20:58.937776 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f59993d-2b26-4c5a-b401-55cafc888fdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:20:58.938415 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59993d-2b26-4c5a-b401-55cafc888fdf service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:20:58.938701 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59993d-2b26-4c5a-b401-55cafc888fdf service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:20:58.938993 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f59993d-2b26-4c5a-b401-55cafc888fdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:20:58.948027 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59993d-2b26-4c5a-b401-55cafc888fdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:20:58.949473 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f59993d-2b26-4c5a-b401-55cafc888fdf service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:20:58.959451 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 735/1490] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:20:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:21:01.226923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa27787-96c2-4131-a508-baf328c461d5 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:01.227472 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa27787-96c2-4131-a508-baf328c461d5 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:01.227580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa27787-96c2-4131-a508-baf328c461d5 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:01.228942 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 756/1491] 10.222.0.44 () {54 vars in 926 bytes} [Thu Jun 16 00:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:21:01.234903 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d8065-5021-4713-8144-b45094501b97 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:01.235318 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d8065-5021-4713-8144-b45094501b97 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:01.235456 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653d8065-5021-4713-8144-b45094501b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:01.253450 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-653d8065-5021-4713-8144-b45094501b97 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:21:01.254646 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-653d8065-5021-4713-8144-b45094501b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:21:01.262459 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 736/1492] 10.222.0.44 () {58 vars in 1023 bytes} [Thu Jun 16 00:21:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:21:01.300724 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa27787-96c2-4131-a508-baf328c461d5 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:21:01.311148 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa27787-96c2-4131-a508-baf328c461d5 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:21:01.314742 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7398f57-3c82-428a-a698-c5ac184d4fbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:21:01.315364 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7398f57-3c82-428a-a698-c5ac184d4fbf service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:21:01.315668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7398f57-3c82-428a-a698-c5ac184d4fbf service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:21:01.315946 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7398f57-3c82-428a-a698-c5ac184d4fbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:21:01.324669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7398f57-3c82-428a-a698-c5ac184d4fbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:21:01.326091 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7398f57-3c82-428a-a698-c5ac184d4fbf service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:21:01.335255 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 757/1493] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:21:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:21:11.248047 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=33 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:21:11.331164 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=33 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:25.225147 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572a419-92f7-4c1d-8298-2bfedc5fafe7 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:25.226213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572a419-92f7-4c1d-8298-2bfedc5fafe7 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:25.226213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d572a419-92f7-4c1d-8298-2bfedc5fafe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:25.244376 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-d572a419-92f7-4c1d-8298-2bfedc5fafe7 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:22:25.245567 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d572a419-92f7-4c1d-8298-2bfedc5fafe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:25.253509 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 737/1494] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:22:25.263040 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76c1d8-c123-46a5-a22a-007a21779789 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:25.263520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76c1d8-c123-46a5-a22a-007a21779789 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:25.263653 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76c1d8-c123-46a5-a22a-007a21779789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:25.281069 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-dd76c1d8-c123-46a5-a22a-007a21779789 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:22:25.282265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-dd76c1d8-c123-46a5-a22a-007a21779789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:25.290551 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 758/1495] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:22:25.294902 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572a419-92f7-4c1d-8298-2bfedc5fafe7 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:25.305001 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d572a419-92f7-4c1d-8298-2bfedc5fafe7 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:25.309466 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c8a80-6ddd-4150-bd67-021d9ad80a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:25.310109 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c8a80-6ddd-4150-bd67-021d9ad80a02 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:25.310393 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c8a80-6ddd-4150-bd67-021d9ad80a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:25.310670 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213c8a80-6ddd-4150-bd67-021d9ad80a02 admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:25.311381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c8a80-6ddd-4150-bd67-021d9ad80a02 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:22:25.311724 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c8a80-6ddd-4150-bd67-021d9ad80a02 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:25.312734 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: WARNING py.warnings [None req-213c8a80-6ddd-4150-bd67-021d9ad80a02 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:22:25.312734 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: warnings.warn(msg) Jun 16 00:22:25.312734 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: Jun 16 00:22:25.313616 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213c8a80-6ddd-4150-bd67-021d9ad80a02 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:25.325173 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 738/1496] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:22:25.332929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76c1d8-c123-46a5-a22a-007a21779789 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:25.341902 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76c1d8-c123-46a5-a22a-007a21779789 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:25.346361 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716acbc-7827-4ec3-9268-2f2f3b7072e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:25.347003 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716acbc-7827-4ec3-9268-2f2f3b7072e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:25.347286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716acbc-7827-4ec3-9268-2f2f3b7072e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:25.347590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716acbc-7827-4ec3-9268-2f2f3b7072e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:25.348318 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716acbc-7827-4ec3-9268-2f2f3b7072e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:25.350085 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: WARNING py.warnings [None req-6716acbc-7827-4ec3-9268-2f2f3b7072e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:22:25.350085 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: warnings.warn(msg) Jun 16 00:22:25.350085 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: Jun 16 00:22:25.351830 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716acbc-7827-4ec3-9268-2f2f3b7072e9 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:25.387598 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 759/1497] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:22:25 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:22:25.391604 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c8a80-6ddd-4150-bd67-021d9ad80a02 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:25.401290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213c8a80-6ddd-4150-bd67-021d9ad80a02 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:25.455503 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33deca26-6b75-4df5-9b23-4c751c888fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:25.456217 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33deca26-6b75-4df5-9b23-4c751c888fca admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:25.456534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33deca26-6b75-4df5-9b23-4c751c888fca admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:25.456814 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33deca26-6b75-4df5-9b23-4c751c888fca admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:25.457511 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33deca26-6b75-4df5-9b23-4c751c888fca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:25.458522 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: WARNING py.warnings [None req-33deca26-6b75-4df5-9b23-4c751c888fca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:22:25.458522 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: warnings.warn(msg) Jun 16 00:22:25.458522 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: Jun 16 00:22:25.460251 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33deca26-6b75-4df5-9b23-4c751c888fca admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:25.479508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 739/1498] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:22:25 2022] POST /identity/v3/users => generated 289 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:22:25.483501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716acbc-7827-4ec3-9268-2f2f3b7072e9 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:25.493556 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716acbc-7827-4ec3-9268-2f2f3b7072e9 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:25.498025 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5152b-2334-4383-a35c-cb97423c2fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:25.498680 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5152b-2334-4383-a35c-cb97423c2fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:25.498965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5152b-2334-4383-a35c-cb97423c2fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:25.499242 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b5152b-2334-4383-a35c-cb97423c2fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:25.499996 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5152b-2334-4383-a35c-cb97423c2fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:25.500994 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: WARNING py.warnings [None req-55b5152b-2334-4383-a35c-cb97423c2fa6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:22:25.500994 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: warnings.warn(msg) Jun 16 00:22:25.500994 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: Jun 16 00:22:25.501870 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b5152b-2334-4383-a35c-cb97423c2fa6 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:25.514506 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 760/1499] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:22:25.518329 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33deca26-6b75-4df5-9b23-4c751c888fca admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:25.528642 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33deca26-6b75-4df5-9b23-4c751c888fca admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:25.533170 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e409a3f-f9d6-4454-b69c-1296b66e37e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:25.534068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e409a3f-f9d6-4454-b69c-1296b66e37e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:25.534374 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e409a3f-f9d6-4454-b69c-1296b66e37e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:25.534698 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e409a3f-f9d6-4454-b69c-1296b66e37e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:25.535421 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e409a3f-f9d6-4454-b69c-1296b66e37e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:25.536470 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: WARNING py.warnings [None req-3e409a3f-f9d6-4454-b69c-1296b66e37e3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:22:25.536470 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: warnings.warn(msg) Jun 16 00:22:25.536470 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: Jun 16 00:22:25.537359 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e409a3f-f9d6-4454-b69c-1296b66e37e3 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:25.551002 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 740/1500] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:22:25 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:22:25.554960 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5152b-2334-4383-a35c-cb97423c2fa6 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:25.564699 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b5152b-2334-4383-a35c-cb97423c2fa6 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:25.569104 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360b6024-51f4-472f-ad47-2b283bd89ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:25.569970 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b6024-51f4-472f-ad47-2b283bd89ed4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:25.570250 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b6024-51f4-472f-ad47-2b283bd89ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:25.570524 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360b6024-51f4-472f-ad47-2b283bd89ed4 admin admin] PATH_INFO: `/v3/projects/d279d9e1515447978798d3f1b12f7d90/users/4077cd2c15ac4594a024f22b63b1a2b1/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:25.585291 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b6024-51f4-472f-ad47-2b283bd89ed4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d279d9e1515447978798d3f1b12f7d90, user_id=4077cd2c15ac4594a024f22b63b1a2b1, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:25.586346 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: WARNING py.warnings [None req-360b6024-51f4-472f-ad47-2b283bd89ed4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:22:25.586346 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: warnings.warn(msg) Jun 16 00:22:25.586346 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: Jun 16 00:22:25.588383 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360b6024-51f4-472f-ad47-2b283bd89ed4 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:25.603109 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 761/1501] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:22:25 2022] PUT /identity/v3/projects/d279d9e1515447978798d3f1b12f7d90/users/4077cd2c15ac4594a024f22b63b1a2b1/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:22:25.614135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668be066-c90d-4da1-9f37-0f6be233962e None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:25.614426 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668be066-c90d-4da1-9f37-0f6be233962e None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:25.614705 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668be066-c90d-4da1-9f37-0f6be233962e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:25.641253 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-668be066-c90d-4da1-9f37-0f6be233962e None None] MFA Rules not processed for user `4077cd2c15ac4594a024f22b63b1a2b1`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:22:25.642442 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-668be066-c90d-4da1-9f37-0f6be233962e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:25.703742 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 741/1502] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:22:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:22:25.717159 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334047eb-f698-4225-b56d-f0d1ee7d0eae None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:25.717446 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334047eb-f698-4225-b56d-f0d1ee7d0eae None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:25.717720 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334047eb-f698-4225-b56d-f0d1ee7d0eae None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:25.719073 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 762/1503] 10.222.0.44 () {54 vars in 963 bytes} [Thu Jun 16 00:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:22:25.723742 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521d496-26ba-4791-903e-d2bf0b9e6ad5 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:25.724037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521d496-26ba-4791-903e-d2bf0b9e6ad5 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:25.724316 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b521d496-26ba-4791-903e-d2bf0b9e6ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:25.742160 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-b521d496-26ba-4791-903e-d2bf0b9e6ad5 None None] MFA Rules not processed for user `33ba9644ca064e95b43650424baef79f`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:22:25.743345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-b521d496-26ba-4791-903e-d2bf0b9e6ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:25.787118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:25.796041 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 742/1504] 10.222.0.44 () {58 vars in 1060 bytes} [Thu Jun 16 00:22:25 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:22:25.803757 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334047eb-f698-4225-b56d-f0d1ee7d0eae None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:25.814497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334047eb-f698-4225-b56d-f0d1ee7d0eae None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:25.818022 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e23f7-5164-4139-931a-80ea53e73cd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:25.818657 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e23f7-5164-4139-931a-80ea53e73cd7 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:25.818966 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e23f7-5164-4139-931a-80ea53e73cd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:25.819804 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9e23f7-5164-4139-931a-80ea53e73cd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:25.828095 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e23f7-5164-4139-931a-80ea53e73cd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:25.829513 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9e23f7-5164-4139-931a-80ea53e73cd7 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:25.838854 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 763/1505] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:22:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:22:25.879800 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedf24e-0249-4786-a0bb-7369412f48fe None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:25.880097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedf24e-0249-4786-a0bb-7369412f48fe None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:25.880379 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdedf24e-0249-4786-a0bb-7369412f48fe None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:25.882169 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 743/1506] 10.222.0.44 () {52 vars in 829 bytes} [Thu Jun 16 00:22:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:22:25.885779 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e23f7-5164-4139-931a-80ea53e73cd7 service cinder] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:25.946042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9e23f7-5164-4139-931a-80ea53e73cd7 service cinder] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:25.950383 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4090d-e8e1-4435-9e1e-b07f4dde9281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:25.951272 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4090d-e8e1-4435-9e1e-b07f4dde9281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:25.951556 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4090d-e8e1-4435-9e1e-b07f4dde9281 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:25.951857 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4090d-e8e1-4435-9e1e-b07f4dde9281 admin admin] PATH_INFO: `/v3/users/4077cd2c15ac4594a024f22b63b1a2b1` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:25.953028 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4090d-e8e1-4435-9e1e-b07f4dde9281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4077cd2c15ac4594a024f22b63b1a2b1)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:25.954068 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: WARNING py.warnings [None req-c7f4090d-e8e1-4435-9e1e-b07f4dde9281 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:22:25.954068 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: warnings.warn(msg) Jun 16 00:22:25.954068 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: Jun 16 00:22:25.955268 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4090d-e8e1-4435-9e1e-b07f4dde9281 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:26.018769 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c7f4090d-e8e1-4435-9e1e-b07f4dde9281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4077cd2c15ac4594a024f22b63b1a2b1'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:22:26.028288 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c7f4090d-e8e1-4435-9e1e-b07f4dde9281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4077cd2c15ac4594a024f22b63b1a2b1'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:22:26.028952 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c7f4090d-e8e1-4435-9e1e-b07f4dde9281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4077cd2c15ac4594a024f22b63b1a2b1'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:22:26.029647 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c7f4090d-e8e1-4435-9e1e-b07f4dde9281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4077cd2c15ac4594a024f22b63b1a2b1'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:22:26.047031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c7f4090d-e8e1-4435-9e1e-b07f4dde9281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4077cd2c15ac4594a024f22b63b1a2b1'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:22:26.055347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:26.066586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 764/1507] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:22:25 2022] DELETE /identity/v3/users/4077cd2c15ac4594a024f22b63b1a2b1 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:22:26.071450 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757cccf-7e16-479f-bc27-7b79165b83cb None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:26.071768 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757cccf-7e16-479f-bc27-7b79165b83cb None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:26.072074 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1757cccf-7e16-479f-bc27-7b79165b83cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:26.090910 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-1757cccf-7e16-479f-bc27-7b79165b83cb None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:22:26.092124 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-1757cccf-7e16-479f-bc27-7b79165b83cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:26.150148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 744/1508] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:22:26.159453 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4090d-e8e1-4435-9e1e-b07f4dde9281 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:26.160930 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-c7f4090d-e8e1-4435-9e1e-b07f4dde9281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:26.218794 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4090d-e8e1-4435-9e1e-b07f4dde9281 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:26.222556 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3205258-d2cd-482b-a8a5-387851d97038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:26.223224 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3205258-d2cd-482b-a8a5-387851d97038 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:26.223509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3205258-d2cd-482b-a8a5-387851d97038 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:26.223809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3205258-d2cd-482b-a8a5-387851d97038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:26.232563 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3205258-d2cd-482b-a8a5-387851d97038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:26.233989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3205258-d2cd-482b-a8a5-387851d97038 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:26.243632 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 765/1509] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:22:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:22:26.572330 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757cccf-7e16-479f-bc27-7b79165b83cb None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:22:26.573847 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-1757cccf-7e16-479f-bc27-7b79165b83cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:22:26.585618 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1757cccf-7e16-479f-bc27-7b79165b83cb None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:22:26.592844 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ae41b5-8d03-411f-9c79-9cea8f177bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:22:26.593727 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae41b5-8d03-411f-9c79-9cea8f177bbf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:22:26.593997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae41b5-8d03-411f-9c79-9cea8f177bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:22:26.594271 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ae41b5-8d03-411f-9c79-9cea8f177bbf admin admin] PATH_INFO: `/v3/projects/d279d9e1515447978798d3f1b12f7d90` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:22:26.595488 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae41b5-8d03-411f-9c79-9cea8f177bbf admin admin] RBAC: Authorizing `identity:delete_project(project_id=d279d9e1515447978798d3f1b12f7d90)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:22:26.597473 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: WARNING py.warnings [None req-17ae41b5-8d03-411f-9c79-9cea8f177bbf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:22:26.597473 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: warnings.warn(msg) Jun 16 00:22:26.597473 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: Jun 16 00:22:26.599000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ae41b5-8d03-411f-9c79-9cea8f177bbf admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:22:26.661473 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-17ae41b5-8d03-411f-9c79-9cea8f177bbf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd279d9e1515447978798d3f1b12f7d90', 'request_id': 'req-17ae41b5-8d03-411f-9c79-9cea8f177bbf'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:22:26.668053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-17ae41b5-8d03-411f-9c79-9cea8f177bbf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd279d9e1515447978798d3f1b12f7d90', 'request_id': 'req-17ae41b5-8d03-411f-9c79-9cea8f177bbf'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:22:26.681861 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-17ae41b5-8d03-411f-9c79-9cea8f177bbf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd279d9e1515447978798d3f1b12f7d90', 'request_id': 'req-17ae41b5-8d03-411f-9c79-9cea8f177bbf'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:22:26.697250 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-17ae41b5-8d03-411f-9c79-9cea8f177bbf admin admin] The token cache is being invalidate because project d279d9e1515447978798d3f1b12f7d90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:22:26.697556 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-17ae41b5-8d03-411f-9c79-9cea8f177bbf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:22:26.698265 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-17ae41b5-8d03-411f-9c79-9cea8f177bbf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:22:26.699842 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 745/1510] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:22:26 2022] DELETE /identity/v3/projects/d279d9e1515447978798d3f1b12f7d90 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:22:36.239084 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=29 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:22:36.694109 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:05.031892 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdecd8-756c-457d-af7a-32074cc55058 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:05.032499 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdecd8-756c-457d-af7a-32074cc55058 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:05.032499 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acdecd8-756c-457d-af7a-32074cc55058 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:05.033835 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 766/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:24:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:24:05.039202 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b893585-8010-4fa0-8001-8223f9d23ea2 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:05.039607 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b893585-8010-4fa0-8001-8223f9d23ea2 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:05.039822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b893585-8010-4fa0-8001-8223f9d23ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:05.058300 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-1b893585-8010-4fa0-8001-8223f9d23ea2 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:05.059423 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-1b893585-8010-4fa0-8001-8223f9d23ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:05.117275 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 746/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:24:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:05.285028 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdecd8-756c-457d-af7a-32074cc55058 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:05.286790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-5acdecd8-756c-457d-af7a-32074cc55058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:05.362223 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acdecd8-756c-457d-af7a-32074cc55058 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:05.367401 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af52d34-4999-48d1-a904-4ec1dd59b344 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:05.368075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af52d34-4999-48d1-a904-4ec1dd59b344 service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:05.368360 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af52d34-4999-48d1-a904-4ec1dd59b344 service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:05.368635 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af52d34-4999-48d1-a904-4ec1dd59b344 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:05.376581 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af52d34-4999-48d1-a904-4ec1dd59b344 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:05.378167 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af52d34-4999-48d1-a904-4ec1dd59b344 service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:05.387331 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 767/1513] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:24:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:24:06.252869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bdff3-a746-4da4-9f2f-3b7d4da12afc None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:06.253413 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bdff3-a746-4da4-9f2f-3b7d4da12afc None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:06.253413 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1bdff3-a746-4da4-9f2f-3b7d4da12afc None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:06.254811 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 747/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:24:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:24:06.260346 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa0349-b28b-467c-8f8f-c2f58f57f0fb None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:06.260767 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa0349-b28b-467c-8f8f-c2f58f57f0fb None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:06.260921 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa0349-b28b-467c-8f8f-c2f58f57f0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:06.278973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-aeaa0349-b28b-467c-8f8f-c2f58f57f0fb None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:06.280245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-aeaa0349-b28b-467c-8f8f-c2f58f57f0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:06.288495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 768/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:24:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:06.439490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1bdff3-a746-4da4-9f2f-3b7d4da12afc None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:06.453893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1bdff3-a746-4da4-9f2f-3b7d4da12afc None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:06.459237 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f45479-f1a8-4c2e-b1a3-dc1e6224b463 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:06.459928 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f45479-f1a8-4c2e-b1a3-dc1e6224b463 service nova] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:06.460219 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f45479-f1a8-4c2e-b1a3-dc1e6224b463 service nova] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:06.460501 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f45479-f1a8-4c2e-b1a3-dc1e6224b463 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:06.468617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f45479-f1a8-4c2e-b1a3-dc1e6224b463 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:06.470218 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f45479-f1a8-4c2e-b1a3-dc1e6224b463 service nova] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:06.480016 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 748/1516] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:24:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:24:07.202713 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fc24a-b65d-4373-bc48-7f0318cd63cf None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:07.203004 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fc24a-b65d-4373-bc48-7f0318cd63cf None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:07.203284 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759fc24a-b65d-4373-bc48-7f0318cd63cf None None] PATH_INFO: `/v3` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:07.204639 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 769/1517] 10.222.0.45 () {54 vars in 925 bytes} [Thu Jun 16 00:24:07 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:24:07.211254 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb5529-72dc-4e96-b33c-bf43f97f3d13 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:07.211546 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb5529-72dc-4e96-b33c-bf43f97f3d13 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:07.211858 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0eb5529-72dc-4e96-b33c-bf43f97f3d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:07.229542 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-b0eb5529-72dc-4e96-b33c-bf43f97f3d13 None None] MFA Rules not processed for user `9164f14fe6894daba1a9f2d8f1f4929c`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:07.230754 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-b0eb5529-72dc-4e96-b33c-bf43f97f3d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:07.292083 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 749/1518] 10.222.0.45 () {58 vars in 1015 bytes} [Thu Jun 16 00:24:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:16.273733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=37 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:16.283637 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e9477-0d1d-4d7d-a326-dc38d4ffb813 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:16.283944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e9477-0d1d-4d7d-a326-dc38d4ffb813 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:16.284228 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628e9477-0d1d-4d7d-a326-dc38d4ffb813 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:16.285598 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 770/1519] 10.222.0.44 () {54 vars in 960 bytes} [Thu Jun 16 00:24:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:24:16.290614 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7331835-09b8-4b60-8d73-419f3280cd78 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:16.291040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7331835-09b8-4b60-8d73-419f3280cd78 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:16.291179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7331835-09b8-4b60-8d73-419f3280cd78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:16.308765 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-f7331835-09b8-4b60-8d73-419f3280cd78 None None] MFA Rules not processed for user `9164f14fe6894daba1a9f2d8f1f4929c`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:16.309953 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-f7331835-09b8-4b60-8d73-419f3280cd78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:16.318629 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 750/1520] 10.222.0.44 () {58 vars in 1057 bytes} [Thu Jun 16 00:24:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:16.326432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e9477-0d1d-4d7d-a326-dc38d4ffb813 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:16.340003 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628e9477-0d1d-4d7d-a326-dc38d4ffb813 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:16.344848 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b6c751-8b36-4a4c-a962-c31b20262ade service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9164f14fe6894daba1a9f2d8f1f4929c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:16.345470 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6c751-8b36-4a4c-a962-c31b20262ade service placement] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:16.345751 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6c751-8b36-4a4c-a962-c31b20262ade service placement] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:16.346028 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b6c751-8b36-4a4c-a962-c31b20262ade service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:16.354116 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6c751-8b36-4a4c-a962-c31b20262ade service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:16.355713 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b6c751-8b36-4a4c-a962-c31b20262ade service placement] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:16.365019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 771/1521] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:24:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:24:17.793004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8724c4-fa7f-40ae-9c9c-c6b182b3a951 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:17.793903 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8724c4-fa7f-40ae-9c9c-c6b182b3a951 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:17.793903 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8724c4-fa7f-40ae-9c9c-c6b182b3a951 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:17.794964 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 751/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:24:17.802618 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9e403-3a5e-43ff-a2be-1aa02b991847 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:17.802618 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9e403-3a5e-43ff-a2be-1aa02b991847 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:17.803396 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a9e403-3a5e-43ff-a2be-1aa02b991847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:17.824786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-b6a9e403-3a5e-43ff-a2be-1aa02b991847 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:17.825988 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-b6a9e403-3a5e-43ff-a2be-1aa02b991847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:17.835406 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 772/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:24:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:24:17.992395 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8724c4-fa7f-40ae-9c9c-c6b182b3a951 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:18.007944 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8724c4-fa7f-40ae-9c9c-c6b182b3a951 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:18.013357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2086f7e3-b17b-461f-bc43-61df07f0ac87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:18.014005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086f7e3-b17b-461f-bc43-61df07f0ac87 service nova] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:18.014294 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086f7e3-b17b-461f-bc43-61df07f0ac87 service nova] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:18.014574 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2086f7e3-b17b-461f-bc43-61df07f0ac87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:18.023501 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086f7e3-b17b-461f-bc43-61df07f0ac87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:18.025297 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2086f7e3-b17b-461f-bc43-61df07f0ac87 service nova] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:18.034976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 752/1524] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:24:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:24:18.973709 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbfe35-3673-4b8f-98c2-b52353b6f889 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:18.974276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbfe35-3673-4b8f-98c2-b52353b6f889 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:18.974276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5dbfe35-3673-4b8f-98c2-b52353b6f889 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:18.975698 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 773/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Jun 16 00:24:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:24:18.980667 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb168d0-c8e6-4933-a967-1410e4aca62f None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:18.981114 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb168d0-c8e6-4933-a967-1410e4aca62f None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:18.981221 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb168d0-c8e6-4933-a967-1410e4aca62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:19.001212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-eeb168d0-c8e6-4933-a967-1410e4aca62f None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:19.002909 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-eeb168d0-c8e6-4933-a967-1410e4aca62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:19.011690 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 753/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Jun 16 00:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:19.165581 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbfe35-3673-4b8f-98c2-b52353b6f889 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:19.180221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5dbfe35-3673-4b8f-98c2-b52353b6f889 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:19.185774 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9880d8-7100-47b2-800d-e641eb1bb7f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:19.186399 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9880d8-7100-47b2-800d-e641eb1bb7f7 service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:19.186681 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9880d8-7100-47b2-800d-e641eb1bb7f7 service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:19.186955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9880d8-7100-47b2-800d-e641eb1bb7f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:19.194945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9880d8-7100-47b2-800d-e641eb1bb7f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:19.196557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9880d8-7100-47b2-800d-e641eb1bb7f7 service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:19.205666 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 774/1527] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:24:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:24:23.510073 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb993a2-a4ed-479c-bf18-4ba07855260c None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:23.510643 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb993a2-a4ed-479c-bf18-4ba07855260c None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:23.510643 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb993a2-a4ed-479c-bf18-4ba07855260c None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:23.512036 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 754/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:24:23.517366 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d100447-1a00-4307-bff8-885d0cece11a None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:23.517839 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d100447-1a00-4307-bff8-885d0cece11a None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:23.517946 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d100447-1a00-4307-bff8-885d0cece11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:23.535385 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-7d100447-1a00-4307-bff8-885d0cece11a None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:23.536599 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-7d100447-1a00-4307-bff8-885d0cece11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:23.544847 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 775/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:24:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:24:23.580706 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb993a2-a4ed-479c-bf18-4ba07855260c None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:23.582380 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-5cb993a2-a4ed-479c-bf18-4ba07855260c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:23.638591 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb993a2-a4ed-479c-bf18-4ba07855260c None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:23.642365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48210192-c170-436a-8163-28f7294abc9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:23.642998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48210192-c170-436a-8163-28f7294abc9b service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:23.643285 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48210192-c170-436a-8163-28f7294abc9b service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:23.643560 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48210192-c170-436a-8163-28f7294abc9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:23.652325 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48210192-c170-436a-8163-28f7294abc9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:23.653758 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48210192-c170-436a-8163-28f7294abc9b service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:23.658633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:23.664136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 755/1530] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:24:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:24:25.748549 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2c388-3131-420c-86fc-9622db83ff5d None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:25.749124 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2c388-3131-420c-86fc-9622db83ff5d None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:25.749124 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b2c388-3131-420c-86fc-9622db83ff5d None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:25.750475 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 776/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:24:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:24:25.755736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4327ae1-666d-4d19-a8d0-bfae6681311c None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:25.756724 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4327ae1-666d-4d19-a8d0-bfae6681311c None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:25.756915 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4327ae1-666d-4d19-a8d0-bfae6681311c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:25.776342 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-c4327ae1-666d-4d19-a8d0-bfae6681311c None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:25.777552 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-c4327ae1-666d-4d19-a8d0-bfae6681311c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:25.785417 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 756/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:24:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:25.821128 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2c388-3131-420c-86fc-9622db83ff5d None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:25.831695 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b2c388-3131-420c-86fc-9622db83ff5d None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:25.835154 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5e9a1c-9ac4-4930-ac34-2db0e70dae9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:25.835814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e9a1c-9ac4-4930-ac34-2db0e70dae9e service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:25.836096 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e9a1c-9ac4-4930-ac34-2db0e70dae9e service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:25.836372 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e9a1c-9ac4-4930-ac34-2db0e70dae9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:25.845017 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e9a1c-9ac4-4930-ac34-2db0e70dae9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:25.846448 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5e9a1c-9ac4-4930-ac34-2db0e70dae9e service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:25.856288 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 777/1533] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:24:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:24:29.307509 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e54bc6-0170-448e-9a07-efa2e2b176f3 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:29.308101 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e54bc6-0170-448e-9a07-efa2e2b176f3 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:29.308101 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e54bc6-0170-448e-9a07-efa2e2b176f3 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:29.309462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 757/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:24:29.314539 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b57127-f355-438a-af30-a14522ae907e None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:29.314942 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b57127-f355-438a-af30-a14522ae907e None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:29.315105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b57127-f355-438a-af30-a14522ae907e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:29.333055 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-70b57127-f355-438a-af30-a14522ae907e None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:29.334886 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-70b57127-f355-438a-af30-a14522ae907e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:29.342659 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 778/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:24:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:29.622424 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e54bc6-0170-448e-9a07-efa2e2b176f3 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:29.624098 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-f5e54bc6-0170-448e-9a07-efa2e2b176f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:29.680334 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e54bc6-0170-448e-9a07-efa2e2b176f3 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:29.683835 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c63a6a0-4780-42e9-b9a6-85178d74d9d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:29.684468 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63a6a0-4780-42e9-b9a6-85178d74d9d3 service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:29.684746 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63a6a0-4780-42e9-b9a6-85178d74d9d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:29.685016 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c63a6a0-4780-42e9-b9a6-85178d74d9d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:29.694122 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c63a6a0-4780-42e9-b9a6-85178d74d9d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:29.695538 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c63a6a0-4780-42e9-b9a6-85178d74d9d3 service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:29.704662 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 758/1536] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:24:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:24:31.822951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ab9ce-cd3f-4784-b1ec-31af0e4ee958 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:31.823418 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ab9ce-cd3f-4784-b1ec-31af0e4ee958 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:31.823538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555ab9ce-cd3f-4784-b1ec-31af0e4ee958 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:31.824927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 779/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu Jun 16 00:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:24:31.830223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3a101-2706-455b-873c-8b6eee216921 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:31.830609 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3a101-2706-455b-873c-8b6eee216921 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:31.830802 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c3a101-2706-455b-873c-8b6eee216921 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:31.848244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-28c3a101-2706-455b-873c-8b6eee216921 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:24:31.849931 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-28c3a101-2706-455b-873c-8b6eee216921 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:31.857474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 759/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu Jun 16 00:24:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:24:32.119408 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ab9ce-cd3f-4784-b1ec-31af0e4ee958 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:24:32.121115 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-555ab9ce-cd3f-4784-b1ec-31af0e4ee958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:24:32.134319 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555ab9ce-cd3f-4784-b1ec-31af0e4ee958 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:24:32.137873 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da5324-7c78-49ba-9c7c-9ca66f7a8203 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:24:32.138517 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da5324-7c78-49ba-9c7c-9ca66f7a8203 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:24:32.138807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da5324-7c78-49ba-9c7c-9ca66f7a8203 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:24:32.139090 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da5324-7c78-49ba-9c7c-9ca66f7a8203 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:24:32.150191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da5324-7c78-49ba-9c7c-9ca66f7a8203 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:24:32.151656 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da5324-7c78-49ba-9c7c-9ca66f7a8203 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:24:32.165637 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 780/1539] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:24:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:24:41.843172 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=32 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:24:42.158140 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=33 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:01.154693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a2d63-34ef-4ed9-9b04-21c2b813bee7 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:01.154693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a2d63-34ef-4ed9-9b04-21c2b813bee7 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:01.154693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4a2d63-34ef-4ed9-9b04-21c2b813bee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:01.173399 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-0d4a2d63-34ef-4ed9-9b04-21c2b813bee7 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:01.174834 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-0d4a2d63-34ef-4ed9-9b04-21c2b813bee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:01.186758 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 760/1540] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Jun 16 00:26:01.197307 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d41991-2e70-468c-9fb4-e0799c959664 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:01.198885 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d41991-2e70-468c-9fb4-e0799c959664 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:01.198885 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d41991-2e70-468c-9fb4-e0799c959664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:01.229315 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-73d41991-2e70-468c-9fb4-e0799c959664 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:01.230838 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-73d41991-2e70-468c-9fb4-e0799c959664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:01.242343 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 781/1541] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:01.247196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a2d63-34ef-4ed9-9b04-21c2b813bee7 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:01.260242 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4a2d63-34ef-4ed9-9b04-21c2b813bee7 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:01.268456 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23633fe1-f539-4640-8e22-ce55b5b41373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:01.269686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23633fe1-f539-4640-8e22-ce55b5b41373 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:01.269978 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23633fe1-f539-4640-8e22-ce55b5b41373 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:01.270257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23633fe1-f539-4640-8e22-ce55b5b41373 admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:01.271110 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23633fe1-f539-4640-8e22-ce55b5b41373 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:01.271420 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23633fe1-f539-4640-8e22-ce55b5b41373 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:01.273085 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23633fe1-f539-4640-8e22-ce55b5b41373 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:01.290688 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 761/1542] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:26:01.298718 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d41991-2e70-468c-9fb4-e0799c959664 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:01.308389 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d41991-2e70-468c-9fb4-e0799c959664 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:01.320471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fbff6-65cc-4a4d-8475-2d0ea1908924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:01.321467 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fbff6-65cc-4a4d-8475-2d0ea1908924 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:01.321980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fbff6-65cc-4a4d-8475-2d0ea1908924 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:01.322473 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7fbff6-65cc-4a4d-8475-2d0ea1908924 admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:01.323396 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fbff6-65cc-4a4d-8475-2d0ea1908924 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:01.325544 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7fbff6-65cc-4a4d-8475-2d0ea1908924 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:01.372369 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 782/1543] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:01 2022] POST /identity/v3/projects => generated 393 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:01.376708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23633fe1-f539-4640-8e22-ce55b5b41373 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:01.393551 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23633fe1-f539-4640-8e22-ce55b5b41373 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:01.484514 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eece3b0-a73e-4f79-ba5e-7374bf47103c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:01.485207 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eece3b0-a73e-4f79-ba5e-7374bf47103c admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:01.485496 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eece3b0-a73e-4f79-ba5e-7374bf47103c admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:01.485779 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eece3b0-a73e-4f79-ba5e-7374bf47103c admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:01.486496 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eece3b0-a73e-4f79-ba5e-7374bf47103c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:01.489045 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eece3b0-a73e-4f79-ba5e-7374bf47103c admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:01.518950 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 762/1544] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:01 2022] POST /identity/v3/users => generated 297 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:26:01.523349 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fbff6-65cc-4a4d-8475-2d0ea1908924 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:01.537415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7fbff6-65cc-4a4d-8475-2d0ea1908924 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:01.555707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe013592-0348-4398-9a32-5e846cb3005f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:01.556735 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe013592-0348-4398-9a32-5e846cb3005f admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:01.557248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe013592-0348-4398-9a32-5e846cb3005f admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:01.557736 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe013592-0348-4398-9a32-5e846cb3005f admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:01.558685 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe013592-0348-4398-9a32-5e846cb3005f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:01.560554 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe013592-0348-4398-9a32-5e846cb3005f admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:01.580233 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 783/1545] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:01.584419 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eece3b0-a73e-4f79-ba5e-7374bf47103c admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:01.603980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eece3b0-a73e-4f79-ba5e-7374bf47103c admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:01.614182 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab53040-5ccd-4e7a-9ba7-a0d58231fdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:01.615302 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab53040-5ccd-4e7a-9ba7-a0d58231fdd6 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:01.615596 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab53040-5ccd-4e7a-9ba7-a0d58231fdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:01.617005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab53040-5ccd-4e7a-9ba7-a0d58231fdd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:01.617835 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab53040-5ccd-4e7a-9ba7-a0d58231fdd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:01.619801 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab53040-5ccd-4e7a-9ba7-a0d58231fdd6 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:01.637079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 763/1546] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:01 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:01.641374 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe013592-0348-4398-9a32-5e846cb3005f admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:01.655565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe013592-0348-4398-9a32-5e846cb3005f admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:01.664621 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd8703-92a9-4bfe-a0a7-e2dafaf0eb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:01.666102 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd8703-92a9-4bfe-a0a7-e2dafaf0eb32 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:01.666666 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd8703-92a9-4bfe-a0a7-e2dafaf0eb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:01.667215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bd8703-92a9-4bfe-a0a7-e2dafaf0eb32 admin admin] PATH_INFO: `/v3/projects/3f0f1114473045f899e99736ff9765df/users/8a57c3f4e4d7479c9f301195cd9764cc/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:01.688905 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd8703-92a9-4bfe-a0a7-e2dafaf0eb32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f0f1114473045f899e99736ff9765df, user_id=8a57c3f4e4d7479c9f301195cd9764cc, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:01.692582 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bd8703-92a9-4bfe-a0a7-e2dafaf0eb32 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:01.715430 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 784/1547] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:01 2022] PUT /identity/v3/projects/3f0f1114473045f899e99736ff9765df/users/8a57c3f4e4d7479c9f301195cd9764cc/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:01.721552 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff428a8-3e5d-4dd3-82d8-89780b3f24b3 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:01.721884 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff428a8-3e5d-4dd3-82d8-89780b3f24b3 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:01.722391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff428a8-3e5d-4dd3-82d8-89780b3f24b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:01.749839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-2ff428a8-3e5d-4dd3-82d8-89780b3f24b3 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:01.751661 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-2ff428a8-3e5d-4dd3-82d8-89780b3f24b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:01.837281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 764/1548] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:01.853411 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd8703-92a9-4bfe-a0a7-e2dafaf0eb32 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:01.951680 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bd8703-92a9-4bfe-a0a7-e2dafaf0eb32 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:01.955595 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f816567-edcc-4717-a811-9c3b5462c601 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:01.956322 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f816567-edcc-4717-a811-9c3b5462c601 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:01.956610 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f816567-edcc-4717-a811-9c3b5462c601 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:01.956886 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f816567-edcc-4717-a811-9c3b5462c601 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:01.967929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f816567-edcc-4717-a811-9c3b5462c601 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:01.969437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f816567-edcc-4717-a811-9c3b5462c601 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:01.987230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 785/1549] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:01.988046 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e48f11-b812-4414-bf0c-a6b5ec71961c None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:01.988046 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e48f11-b812-4414-bf0c-a6b5ec71961c None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:01.988375 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e48f11-b812-4414-bf0c-a6b5ec71961c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.026672 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-20e48f11-b812-4414-bf0c-a6b5ec71961c None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:02.037079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-20e48f11-b812-4414-bf0c-a6b5ec71961c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:02.059636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 765/1550] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:02.063008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cd2b3-c331-4b32-8cee-339e46c02856 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.063302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cd2b3-c331-4b32-8cee-339e46c02856 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.063585 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7cd2b3-c331-4b32-8cee-339e46c02856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.064535 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953ee1c-a24b-4605-b703-3c79375222f9 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.065045 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953ee1c-a24b-4605-b703-3c79375222f9 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.065438 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6953ee1c-a24b-4605-b703-3c79375222f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.097285 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-6953ee1c-a24b-4605-b703-3c79375222f9 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:02.098630 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-6953ee1c-a24b-4605-b703-3c79375222f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:02.107240 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-ae7cd2b3-c331-4b32-8cee-339e46c02856 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:02.108947 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-ae7cd2b3-c331-4b32-8cee-339e46c02856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:02.121587 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 766/1551] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:02.123084 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b990a91-bc64-4156-a5e2-3e0138311a21 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.123494 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b990a91-bc64-4156-a5e2-3e0138311a21 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.123896 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b990a91-bc64-4156-a5e2-3e0138311a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.142248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 786/1552] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:02.143455 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cd2b3-c331-4b32-8cee-339e46c02856 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:02.157705 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-0b990a91-bc64-4156-a5e2-3e0138311a21 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:02.165321 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-0b990a91-bc64-4156-a5e2-3e0138311a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:02.178094 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7cd2b3-c331-4b32-8cee-339e46c02856 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:02.195226 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01b33c-b46f-4ba8-9304-627d7d9d75ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:02.196809 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 767/1553] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:02.197606 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01b33c-b46f-4ba8-9304-627d7d9d75ef admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.198106 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01b33c-b46f-4ba8-9304-627d7d9d75ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.199590 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e54603-6d0c-4c1d-86cd-d43ddc53675d None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.199590 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e54603-6d0c-4c1d-86cd-d43ddc53675d None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.199590 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e54603-6d0c-4c1d-86cd-d43ddc53675d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.200220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01b33c-b46f-4ba8-9304-627d7d9d75ef admin admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.200783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01b33c-b46f-4ba8-9304-627d7d9d75ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:02.201112 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01b33c-b46f-4ba8-9304-627d7d9d75ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:02.204782 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: WARNING py.warnings [None req-5d01b33c-b46f-4ba8-9304-627d7d9d75ef admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:26:02.204782 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: warnings.warn(msg) Jun 16 00:26:02.204782 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: Jun 16 00:26:02.208953 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01b33c-b46f-4ba8-9304-627d7d9d75ef admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:02.238880 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-99e54603-6d0c-4c1d-86cd-d43ddc53675d None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:02.240384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-99e54603-6d0c-4c1d-86cd-d43ddc53675d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:02.243637 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 787/1554] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:26:02.245426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278bdf1-f8d6-43a3-9e86-aeda6b8ceb24 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.245752 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278bdf1-f8d6-43a3-9e86-aeda6b8ceb24 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.246307 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3278bdf1-f8d6-43a3-9e86-aeda6b8ceb24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.266266 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 768/1555] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:02.267807 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21327207-0bd9-4f7f-aa39-94eb3e0a52b8 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.271536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21327207-0bd9-4f7f-aa39-94eb3e0a52b8 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.272299 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21327207-0bd9-4f7f-aa39-94eb3e0a52b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.290082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-3278bdf1-f8d6-43a3-9e86-aeda6b8ceb24 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:02.293470 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-3278bdf1-f8d6-43a3-9e86-aeda6b8ceb24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:02.300885 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-21327207-0bd9-4f7f-aa39-94eb3e0a52b8 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:02.302106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-21327207-0bd9-4f7f-aa39-94eb3e0a52b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:02.303169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 788/1556] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:02.304600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12513e-4e9d-4314-89f8-a326e6f81a2b None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.304897 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12513e-4e9d-4314-89f8-a326e6f81a2b None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.305234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12513e-4e9d-4314-89f8-a326e6f81a2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.325206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 769/1557] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:02.327656 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21327207-0bd9-4f7f-aa39-94eb3e0a52b8 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:02.332076 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-4e12513e-4e9d-4314-89f8-a326e6f81a2b None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:02.333437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-4e12513e-4e9d-4314-89f8-a326e6f81a2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:02.346193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 789/1558] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:02.346193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12513e-4e9d-4314-89f8-a326e6f81a2b None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:02.346500 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21327207-0bd9-4f7f-aa39-94eb3e0a52b8 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:02.351488 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e422b8a7-73e9-4ceb-a769-2fb77a5bb633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:02.352451 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422b8a7-73e9-4ceb-a769-2fb77a5bb633 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.352747 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422b8a7-73e9-4ceb-a769-2fb77a5bb633 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.352885 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12513e-4e9d-4314-89f8-a326e6f81a2b None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:02.353076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e422b8a7-73e9-4ceb-a769-2fb77a5bb633 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.353747 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422b8a7-73e9-4ceb-a769-2fb77a5bb633 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:02.354774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: WARNING py.warnings [None req-e422b8a7-73e9-4ceb-a769-2fb77a5bb633 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:26:02.354774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: warnings.warn(msg) Jun 16 00:26:02.354774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: Jun 16 00:26:02.356015 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e422b8a7-73e9-4ceb-a769-2fb77a5bb633 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:02.357914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef69b2-fe0d-452a-8742-11845b8b2b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:02.358802 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef69b2-fe0d-452a-8742-11845b8b2b1c admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.359366 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef69b2-fe0d-452a-8742-11845b8b2b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.359850 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef69b2-fe0d-452a-8742-11845b8b2b1c admin admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.360739 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef69b2-fe0d-452a-8742-11845b8b2b1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:02.361187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef69b2-fe0d-452a-8742-11845b8b2b1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:02.362987 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ef69b2-fe0d-452a-8742-11845b8b2b1c admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:02.376337 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 790/1559] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:26:02.377639 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e27f2-7207-40bd-979d-e5cfb6ce6b17 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.377931 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e27f2-7207-40bd-979d-e5cfb6ce6b17 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.378254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3e27f2-7207-40bd-979d-e5cfb6ce6b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.394729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 770/1560] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:02 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:02.397929 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a324bd2-9a91-4f71-ba21-9cfa18f27f0f None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.398518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a324bd2-9a91-4f71-ba21-9cfa18f27f0f None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.399444 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a324bd2-9a91-4f71-ba21-9cfa18f27f0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.405378 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-1c3e27f2-7207-40bd-979d-e5cfb6ce6b17 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:02.406729 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-1c3e27f2-7207-40bd-979d-e5cfb6ce6b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:02.411219 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:02.427395 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-8a324bd2-9a91-4f71-ba21-9cfa18f27f0f None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:02.429224 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-8a324bd2-9a91-4f71-ba21-9cfa18f27f0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:02.465534 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:02.489719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 791/1561] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:02.491353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65823593-493b-4e07-8472-747725a4ca53 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.491803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65823593-493b-4e07-8472-747725a4ca53 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.492187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65823593-493b-4e07-8472-747725a4ca53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.520554 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 771/1562] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:02.520554 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a324bd2-9a91-4f71-ba21-9cfa18f27f0f None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:02.522341 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-65823593-493b-4e07-8472-747725a4ca53 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:02.524322 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-65823593-493b-4e07-8472-747725a4ca53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:02.525190 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a324bd2-9a91-4f71-ba21-9cfa18f27f0f None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:02.530772 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adf6e4-26d6-4cfa-b465-4447e874090a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:02.531853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adf6e4-26d6-4cfa-b465-4447e874090a admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.532209 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adf6e4-26d6-4cfa-b465-4447e874090a admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.532558 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48adf6e4-26d6-4cfa-b465-4447e874090a admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.533383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48adf6e4-26d6-4cfa-b465-4447e874090a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:02.533765 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48adf6e4-26d6-4cfa-b465-4447e874090a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:02.537556 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 792/1563] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:02.537723 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48adf6e4-26d6-4cfa-b465-4447e874090a admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:02.537824 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519637cc-9237-4342-9384-c1acfe5ada21 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.537824 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519637cc-9237-4342-9384-c1acfe5ada21 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.537824 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519637cc-9237-4342-9384-c1acfe5ada21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.550986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 772/1564] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:26:02.551938 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adf6e4-26d6-4cfa-b465-4447e874090a admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:02.558999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-519637cc-9237-4342-9384-c1acfe5ada21 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:02.560975 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-519637cc-9237-4342-9384-c1acfe5ada21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:02.564039 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48adf6e4-26d6-4cfa-b465-4447e874090a admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:02.570227 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce9f8f-6674-4317-af5f-f02767a3ee26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:02.570794 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce9f8f-6674-4317-af5f-f02767a3ee26 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.571202 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 793/1565] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:02.572125 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519637cc-9237-4342-9384-c1acfe5ada21 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:02.574825 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce9f8f-6674-4317-af5f-f02767a3ee26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.575126 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce9f8f-6674-4317-af5f-f02767a3ee26 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.575886 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce9f8f-6674-4317-af5f-f02767a3ee26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:02.578165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adce9f8f-6674-4317-af5f-f02767a3ee26 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:02.583711 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519637cc-9237-4342-9384-c1acfe5ada21 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:02.589261 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181cad37-e676-4b36-9b70-5738ddaefacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:02.590523 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cad37-e676-4b36-9b70-5738ddaefacb admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.591024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cad37-e676-4b36-9b70-5738ddaefacb admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.591411 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181cad37-e676-4b36-9b70-5738ddaefacb admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.592578 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cad37-e676-4b36-9b70-5738ddaefacb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:02.593969 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: WARNING py.warnings [None req-181cad37-e676-4b36-9b70-5738ddaefacb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:26:02.593969 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: warnings.warn(msg) Jun 16 00:26:02.593969 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: Jun 16 00:26:02.595552 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181cad37-e676-4b36-9b70-5738ddaefacb admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:02.616085 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 773/1566] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:02 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:02.616085 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaa790-45d6-4872-95fe-0f5d981188e1 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.616085 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaa790-45d6-4872-95fe-0f5d981188e1 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.616085 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaaa790-45d6-4872-95fe-0f5d981188e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.626490 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 794/1567] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:02 2022] POST /identity/v3/users => generated 286 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:02.626490 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d30192-3e98-47f1-8e0f-65de00d37c9f None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.626490 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d30192-3e98-47f1-8e0f-65de00d37c9f None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.626490 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d30192-3e98-47f1-8e0f-65de00d37c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.641545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-bdaaa790-45d6-4872-95fe-0f5d981188e1 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:02.642882 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-bdaaa790-45d6-4872-95fe-0f5d981188e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:02.648214 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-72d30192-3e98-47f1-8e0f-65de00d37c9f None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:02.649626 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-72d30192-3e98-47f1-8e0f-65de00d37c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:02.708072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 774/1568] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:02.708959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaaa790-45d6-4872-95fe-0f5d981188e1 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:02.718751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaaa790-45d6-4872-95fe-0f5d981188e1 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:02.723043 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 795/1569] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:02.723795 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a80931-435e-4e00-a13c-c11783250dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:02.724463 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a80931-435e-4e00-a13c-c11783250dc4 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.724749 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a80931-435e-4e00-a13c-c11783250dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.725032 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a80931-435e-4e00-a13c-c11783250dc4 admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.725822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a80931-435e-4e00-a13c-c11783250dc4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:02.726074 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a80931-435e-4e00-a13c-c11783250dc4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:02.727675 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d30192-3e98-47f1-8e0f-65de00d37c9f None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:02.727802 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a80931-435e-4e00-a13c-c11783250dc4 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:02.738300 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d30192-3e98-47f1-8e0f-65de00d37c9f None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:02.741488 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 775/1570] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:26:02.742303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a80931-435e-4e00-a13c-c11783250dc4 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:02.750433 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe4d32-813d-4485-9de0-1af6eb0f272c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:02.751109 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe4d32-813d-4485-9de0-1af6eb0f272c admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.751402 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe4d32-813d-4485-9de0-1af6eb0f272c admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.751714 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe4d32-813d-4485-9de0-1af6eb0f272c admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.752423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe4d32-813d-4485-9de0-1af6eb0f272c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:02.754890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe4d32-813d-4485-9de0-1af6eb0f272c admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:02.755039 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a80931-435e-4e00-a13c-c11783250dc4 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:02.760353 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647b476-bec0-4e13-bfdb-d6333f5b43c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:02.761138 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647b476-bec0-4e13-bfdb-d6333f5b43c9 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.761522 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647b476-bec0-4e13-bfdb-d6333f5b43c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.761938 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5647b476-bec0-4e13-bfdb-d6333f5b43c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.762753 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647b476-bec0-4e13-bfdb-d6333f5b43c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:02.763169 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647b476-bec0-4e13-bfdb-d6333f5b43c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:02.765151 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5647b476-bec0-4e13-bfdb-d6333f5b43c9 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:02.781285 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 776/1571] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:26:02.785755 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647b476-bec0-4e13-bfdb-d6333f5b43c9 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:02.790620 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 796/1572] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:02 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:02.792808 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe4d32-813d-4485-9de0-1af6eb0f272c admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:02.797390 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5647b476-bec0-4e13-bfdb-d6333f5b43c9 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:02.843864 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:02.865017 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388262a7-b275-45a8-a573-ac05cc51a627 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:02.865710 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388262a7-b275-45a8-a573-ac05cc51a627 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.865996 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388262a7-b275-45a8-a573-ac05cc51a627 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.866273 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388262a7-b275-45a8-a573-ac05cc51a627 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.867004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388262a7-b275-45a8-a573-ac05cc51a627 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:02.869058 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388262a7-b275-45a8-a573-ac05cc51a627 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:02.885202 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe4d32-813d-4485-9de0-1af6eb0f272c admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:02.891292 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8f19f-c33b-4568-be29-04dcaff8be95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:02.892274 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8f19f-c33b-4568-be29-04dcaff8be95 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.892637 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8f19f-c33b-4568-be29-04dcaff8be95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.893015 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe8f19f-c33b-4568-be29-04dcaff8be95 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.894536 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8f19f-c33b-4568-be29-04dcaff8be95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:02.896614 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe8f19f-c33b-4568-be29-04dcaff8be95 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:02.907921 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 777/1573] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:02 2022] POST /identity/v3/users => generated 290 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:02.912299 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 797/1574] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:02 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:02.912299 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8f19f-c33b-4568-be29-04dcaff8be95 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:02.912524 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388262a7-b275-45a8-a573-ac05cc51a627 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:02.923110 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe8f19f-c33b-4568-be29-04dcaff8be95 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:02.927183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388262a7-b275-45a8-a573-ac05cc51a627 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:02.934161 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade8e32-c223-4ad3-ab2f-340fb9335480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:02.934997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade8e32-c223-4ad3-ab2f-340fb9335480 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.935222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade8e32-c223-4ad3-ab2f-340fb9335480 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.935503 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade8e32-c223-4ad3-ab2f-340fb9335480 admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.936991 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2a81e-5265-4ea6-a3db-997d62f6b161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:02.938150 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2a81e-5265-4ea6-a3db-997d62f6b161 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.938540 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2a81e-5265-4ea6-a3db-997d62f6b161 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.939187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf2a81e-5265-4ea6-a3db-997d62f6b161 admin admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.939923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2a81e-5265-4ea6-a3db-997d62f6b161 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:02.940391 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2a81e-5265-4ea6-a3db-997d62f6b161 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:02.940977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade8e32-c223-4ad3-ab2f-340fb9335480 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:02.941543 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade8e32-c223-4ad3-ab2f-340fb9335480 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:02.943088 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf2a81e-5265-4ea6-a3db-997d62f6b161 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:02.945064 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade8e32-c223-4ad3-ab2f-340fb9335480 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:02.961676 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 778/1575] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:26:02.962967 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade8e32-c223-4ad3-ab2f-340fb9335480 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:02.969669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 798/1576] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:26:02.971806 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2a81e-5265-4ea6-a3db-997d62f6b161 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:02.977288 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade8e32-c223-4ad3-ab2f-340fb9335480 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:02.982400 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07b89e-c0b0-4029-9532-a939fdc33c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:02.983522 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07b89e-c0b0-4029-9532-a939fdc33c36 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.983998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07b89e-c0b0-4029-9532-a939fdc33c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.984756 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f07b89e-c0b0-4029-9532-a939fdc33c36 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.985616 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07b89e-c0b0-4029-9532-a939fdc33c36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:02.988446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f07b89e-c0b0-4029-9532-a939fdc33c36 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:02.988764 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf2a81e-5265-4ea6-a3db-997d62f6b161 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:02.995477 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c67124-f29c-4a1f-9b5e-1c8e06b8ebde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:02.996185 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c67124-f29c-4a1f-9b5e-1c8e06b8ebde admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:02.996469 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c67124-f29c-4a1f-9b5e-1c8e06b8ebde admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:02.996753 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c67124-f29c-4a1f-9b5e-1c8e06b8ebde admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:02.997505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c67124-f29c-4a1f-9b5e-1c8e06b8ebde admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:02.999643 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c67124-f29c-4a1f-9b5e-1c8e06b8ebde admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:03.026516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 779/1577] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:02 2022] POST /identity/v3/projects => generated 371 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:03.027717 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07b89e-c0b0-4029-9532-a939fdc33c36 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:03.038462 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 799/1578] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:02 2022] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:03.039141 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c67124-f29c-4a1f-9b5e-1c8e06b8ebde admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:03.044270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:03.104501 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f07b89e-c0b0-4029-9532-a939fdc33c36 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:03.109616 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e9962-5dc3-4c1f-aa33-319edf8d4b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:03.110507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e9962-5dc3-4c1f-aa33-319edf8d4b98 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:03.110956 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e9962-5dc3-4c1f-aa33-319edf8d4b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:03.111806 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e9962-5dc3-4c1f-aa33-319edf8d4b98 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:03.112679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e9962-5dc3-4c1f-aa33-319edf8d4b98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:03.114935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e9962-5dc3-4c1f-aa33-319edf8d4b98 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:03.115068 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c67124-f29c-4a1f-9b5e-1c8e06b8ebde admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:03.119981 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33102f56-1a04-4963-a69b-e169a23afacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:03.120738 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33102f56-1a04-4963-a69b-e169a23afacc admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:03.121026 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33102f56-1a04-4963-a69b-e169a23afacc admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:03.121465 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33102f56-1a04-4963-a69b-e169a23afacc admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:03.124840 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33102f56-1a04-4963-a69b-e169a23afacc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:03.127770 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33102f56-1a04-4963-a69b-e169a23afacc admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:03.142193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 800/1579] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:03.145885 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33102f56-1a04-4963-a69b-e169a23afacc admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:03.149796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 780/1580] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:03 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:03.149796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e9962-5dc3-4c1f-aa33-319edf8d4b98 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:03.158828 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e9962-5dc3-4c1f-aa33-319edf8d4b98 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:03.165301 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded49335-bb96-4e00-a50d-00f21b9a344b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:03.165969 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded49335-bb96-4e00-a50d-00f21b9a344b admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:03.166254 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded49335-bb96-4e00-a50d-00f21b9a344b admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:03.166529 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded49335-bb96-4e00-a50d-00f21b9a344b admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:03.167754 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33102f56-1a04-4963-a69b-e169a23afacc admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:03.167951 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded49335-bb96-4e00-a50d-00f21b9a344b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:03.171826 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded49335-bb96-4e00-a50d-00f21b9a344b admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:03.175968 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8acc78-6edd-4fb0-94cd-7eecd9e97385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:03.177821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8acc78-6edd-4fb0-94cd-7eecd9e97385 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:03.178323 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8acc78-6edd-4fb0-94cd-7eecd9e97385 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:03.178753 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8acc78-6edd-4fb0-94cd-7eecd9e97385 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:03.179749 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8acc78-6edd-4fb0-94cd-7eecd9e97385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:03.182131 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8acc78-6edd-4fb0-94cd-7eecd9e97385 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:03.200891 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 801/1581] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:03.202457 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8acc78-6edd-4fb0-94cd-7eecd9e97385 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:03.211884 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 781/1582] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:03 2022] POST /identity/v3/projects => generated 363 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:03.213480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded49335-bb96-4e00-a50d-00f21b9a344b admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:03.217736 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8acc78-6edd-4fb0-94cd-7eecd9e97385 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:03.301451 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f4c5d-5f5d-4264-a543-9afc2a298486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:03.302138 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f4c5d-5f5d-4264-a543-9afc2a298486 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:03.302425 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f4c5d-5f5d-4264-a543-9afc2a298486 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:03.302753 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f4c5d-5f5d-4264-a543-9afc2a298486 admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:03.303463 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f4c5d-5f5d-4264-a543-9afc2a298486 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:03.305408 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f4c5d-5f5d-4264-a543-9afc2a298486 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:03.309415 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded49335-bb96-4e00-a50d-00f21b9a344b admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:03.314643 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190409d-9dd9-406b-a56d-2f262835c842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:03.315485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190409d-9dd9-406b-a56d-2f262835c842 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:03.315683 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190409d-9dd9-406b-a56d-2f262835c842 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:03.315933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e190409d-9dd9-406b-a56d-2f262835c842 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:03.316631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190409d-9dd9-406b-a56d-2f262835c842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:03.318876 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e190409d-9dd9-406b-a56d-2f262835c842 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:03.329187 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:INSERT=11 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:03.349039 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 782/1583] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:03 2022] POST /identity/v3/users => generated 286 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:03.349039 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190409d-9dd9-406b-a56d-2f262835c842 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:03.349344 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 802/1584] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:03 2022] POST /identity/v3/projects => generated 383 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:03.349671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f4c5d-5f5d-4264-a543-9afc2a298486 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:03.359556 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e190409d-9dd9-406b-a56d-2f262835c842 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:03.438373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f4c5d-5f5d-4264-a543-9afc2a298486 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:03.445800 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b410174-1d0a-4550-9674-6f06ec8e3f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:03.445957 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303a102-b18f-4392-886f-9cf96b5b8d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:03.446535 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b410174-1d0a-4550-9674-6f06ec8e3f36 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:03.446712 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303a102-b18f-4392-886f-9cf96b5b8d7a admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:03.446916 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b410174-1d0a-4550-9674-6f06ec8e3f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:03.447135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b410174-1d0a-4550-9674-6f06ec8e3f36 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:03.447262 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303a102-b18f-4392-886f-9cf96b5b8d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:03.447559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a303a102-b18f-4392-886f-9cf96b5b8d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:03.447868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b410174-1d0a-4550-9674-6f06ec8e3f36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:03.448440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303a102-b18f-4392-886f-9cf96b5b8d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:03.450075 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b410174-1d0a-4550-9674-6f06ec8e3f36 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:03.450214 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a303a102-b18f-4392-886f-9cf96b5b8d7a admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:03.467300 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 803/1585] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:03.467822 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303a102-b18f-4392-886f-9cf96b5b8d7a admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:03.480043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 783/1586] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:03 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:03.480043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b410174-1d0a-4550-9674-6f06ec8e3f36 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:03.488287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a303a102-b18f-4392-886f-9cf96b5b8d7a admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:03.493996 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903ecd4-ade6-4fe9-ae13-dab26f35d7e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:03.494668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903ecd4-ade6-4fe9-ae13-dab26f35d7e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:03.494880 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b410174-1d0a-4550-9674-6f06ec8e3f36 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:03.495003 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903ecd4-ade6-4fe9-ae13-dab26f35d7e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:03.495211 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5903ecd4-ade6-4fe9-ae13-dab26f35d7e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:03.496016 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903ecd4-ade6-4fe9-ae13-dab26f35d7e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:03.498153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5903ecd4-ade6-4fe9-ae13-dab26f35d7e1 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:03.500583 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:03.501440 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f8e9e-a7f2-4ee3-95e6-c628f29fe072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:03.502432 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f8e9e-a7f2-4ee3-95e6-c628f29fe072 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:03.502863 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f8e9e-a7f2-4ee3-95e6-c628f29fe072 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:03.503852 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742f8e9e-a7f2-4ee3-95e6-c628f29fe072 admin admin] PATH_INFO: `/v3/projects/de27b90e7b904729a7e43c799e0584cf/users/0e1aa49762f340eea2a95e80bb0dbd24/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:03.513767 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 804/1587] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:03.514896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903ecd4-ade6-4fe9-ae13-dab26f35d7e1 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:03.522701 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f8e9e-a7f2-4ee3-95e6-c628f29fe072 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de27b90e7b904729a7e43c799e0584cf, user_id=0e1aa49762f340eea2a95e80bb0dbd24, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:03.523940 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: WARNING py.warnings [None req-742f8e9e-a7f2-4ee3-95e6-c628f29fe072 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:26:03.523940 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: warnings.warn(msg) Jun 16 00:26:03.523940 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: Jun 16 00:26:03.527091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742f8e9e-a7f2-4ee3-95e6-c628f29fe072 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:03.527321 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5903ecd4-ade6-4fe9-ae13-dab26f35d7e1 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:03.534014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e62de-bd45-48dd-8cad-dc0d65649d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:03.535298 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e62de-bd45-48dd-8cad-dc0d65649d79 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:03.535713 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e62de-bd45-48dd-8cad-dc0d65649d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:03.536056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0e62de-bd45-48dd-8cad-dc0d65649d79 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:03.536851 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e62de-bd45-48dd-8cad-dc0d65649d79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:03.539011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0e62de-bd45-48dd-8cad-dc0d65649d79 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:03.552462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 784/1588] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:03 2022] PUT /identity/v3/projects/de27b90e7b904729a7e43c799e0584cf/users/0e1aa49762f340eea2a95e80bb0dbd24/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:03.553612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f8e9e-a7f2-4ee3-95e6-c628f29fe072 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:03.575787 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 805/1589] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:03 2022] POST /identity/v3/users => generated 282 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:03.576621 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e62de-bd45-48dd-8cad-dc0d65649d79 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:03.595038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0e62de-bd45-48dd-8cad-dc0d65649d79 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:03.673989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742f8e9e-a7f2-4ee3-95e6-c628f29fe072 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:03.682076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876dea9-b79e-48dc-8e94-b607d13c300b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:03.682957 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876dea9-b79e-48dc-8e94-b607d13c300b admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:03.683241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876dea9-b79e-48dc-8e94-b607d13c300b admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:03.683520 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2876dea9-b79e-48dc-8e94-b607d13c300b admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:03.684943 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876dea9-b79e-48dc-8e94-b607d13c300b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:03.690305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2bd86-d6a6-49fc-afe0-9026fad9c196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:03.691185 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2bd86-d6a6-49fc-afe0-9026fad9c196 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:03.691477 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2bd86-d6a6-49fc-afe0-9026fad9c196 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:03.691793 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a2bd86-d6a6-49fc-afe0-9026fad9c196 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:03.692020 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2876dea9-b79e-48dc-8e94-b607d13c300b admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:03.692611 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2bd86-d6a6-49fc-afe0-9026fad9c196 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:03.694984 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a2bd86-d6a6-49fc-afe0-9026fad9c196 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:03.718413 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 785/1590] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:03.719883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876dea9-b79e-48dc-8e94-b607d13c300b admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:03.729558 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 806/1591] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:03 2022] POST /identity/v3/users => generated 292 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:03.731400 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2bd86-d6a6-49fc-afe0-9026fad9c196 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:03.737116 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2876dea9-b79e-48dc-8e94-b607d13c300b admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:03.742037 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a2bd86-d6a6-49fc-afe0-9026fad9c196 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:03.745641 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac14a88-dece-4566-8e23-2d7207e0d707 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:03.746557 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac14a88-dece-4566-8e23-2d7207e0d707 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:03.746849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac14a88-dece-4566-8e23-2d7207e0d707 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:03.747132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac14a88-dece-4566-8e23-2d7207e0d707 admin admin] PATH_INFO: `/v3/projects/516387296aef4322926e0ba1389aace0/users/129de9f58bcf4766a7c15e932d5b92ff/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:03.748933 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496169eb-c370-4169-b78d-a4eeab08c48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:03.749890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496169eb-c370-4169-b78d-a4eeab08c48b admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:03.750382 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496169eb-c370-4169-b78d-a4eeab08c48b admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:03.750894 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496169eb-c370-4169-b78d-a4eeab08c48b admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:03.752704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496169eb-c370-4169-b78d-a4eeab08c48b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:03.755828 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496169eb-c370-4169-b78d-a4eeab08c48b admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:03.775868 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 807/1592] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:03.775868 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496169eb-c370-4169-b78d-a4eeab08c48b admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:03.786054 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac14a88-dece-4566-8e23-2d7207e0d707 admin admin] RBAC: Authorizing `identity:create_grant(project_id=516387296aef4322926e0ba1389aace0, user_id=129de9f58bcf4766a7c15e932d5b92ff, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:03.789479 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac14a88-dece-4566-8e23-2d7207e0d707 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:03.794167 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496169eb-c370-4169-b78d-a4eeab08c48b admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:03.804791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f43ccf-1ab4-44ef-a384-350ae82dd723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:03.805479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f43ccf-1ab4-44ef-a384-350ae82dd723 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:03.805810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f43ccf-1ab4-44ef-a384-350ae82dd723 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:03.806092 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f43ccf-1ab4-44ef-a384-350ae82dd723 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:03.806876 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f43ccf-1ab4-44ef-a384-350ae82dd723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:03.807412 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 786/1593] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:03 2022] PUT /identity/v3/projects/516387296aef4322926e0ba1389aace0/users/129de9f58bcf4766a7c15e932d5b92ff/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:03.808854 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f43ccf-1ab4-44ef-a384-350ae82dd723 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:03.808983 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dda3df-95f0-4767-bb3a-133daf6bc089 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:03.809156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dda3df-95f0-4767-bb3a-133daf6bc089 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:03.809416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dda3df-95f0-4767-bb3a-133daf6bc089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:03.823797 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 808/1594] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:03.823797 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f43ccf-1ab4-44ef-a384-350ae82dd723 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:03.836452 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f43ccf-1ab4-44ef-a384-350ae82dd723 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:03.945474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-d5dda3df-95f0-4767-bb3a-133daf6bc089 None None] MFA Rules not processed for user `0e1aa49762f340eea2a95e80bb0dbd24`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:03.945474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d5dda3df-95f0-4767-bb3a-133daf6bc089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:03.945474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:03.946451 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae52829-e31b-4c6c-9e2f-89514fa424cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:03.946451 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae52829-e31b-4c6c-9e2f-89514fa424cc admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:03.946451 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae52829-e31b-4c6c-9e2f-89514fa424cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:03.946451 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae52829-e31b-4c6c-9e2f-89514fa424cc admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:03.946948 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae52829-e31b-4c6c-9e2f-89514fa424cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:03.946948 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae52829-e31b-4c6c-9e2f-89514fa424cc admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:03.964231 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 809/1595] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:03.965264 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae52829-e31b-4c6c-9e2f-89514fa424cc admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:03.976792 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae52829-e31b-4c6c-9e2f-89514fa424cc admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:03.984334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3ce1e-7c48-4951-b28e-42fe53a3ae26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:03.985173 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3ce1e-7c48-4951-b28e-42fe53a3ae26 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:03.985577 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3ce1e-7c48-4951-b28e-42fe53a3ae26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:03.985960 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc3ce1e-7c48-4951-b28e-42fe53a3ae26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:03.986802 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3ce1e-7c48-4951-b28e-42fe53a3ae26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:03.989092 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc3ce1e-7c48-4951-b28e-42fe53a3ae26 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:04.000223 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 810/1596] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:04.001301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3ce1e-7c48-4951-b28e-42fe53a3ae26 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:04.016652 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 787/1597] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:04.017945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dda3df-95f0-4767-bb3a-133daf6bc089 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:04.028118 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc3ce1e-7c48-4951-b28e-42fe53a3ae26 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:04.033796 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab00b0f-54e3-437c-b242-a004cba23bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:04.034990 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab00b0f-54e3-437c-b242-a004cba23bc8 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:04.035349 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab00b0f-54e3-437c-b242-a004cba23bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:04.035558 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab00b0f-54e3-437c-b242-a004cba23bc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:04.036635 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab00b0f-54e3-437c-b242-a004cba23bc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:04.038910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab00b0f-54e3-437c-b242-a004cba23bc8 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:04.042024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dda3df-95f0-4767-bb3a-133daf6bc089 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:04.053410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d99171-92ea-423c-a3cd-cfc0c06793ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:04.054915 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d99171-92ea-423c-a3cd-cfc0c06793ba admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:04.055513 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d99171-92ea-423c-a3cd-cfc0c06793ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:04.055985 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d99171-92ea-423c-a3cd-cfc0c06793ba admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:04.056882 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d99171-92ea-423c-a3cd-cfc0c06793ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:04.057537 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 811/1598] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:04.058863 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14695dd0-83d0-423c-92e8-7e6bbe9c3ec7 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:04.059165 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14695dd0-83d0-423c-92e8-7e6bbe9c3ec7 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:04.059501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14695dd0-83d0-423c-92e8-7e6bbe9c3ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:04.060365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d99171-92ea-423c-a3cd-cfc0c06793ba admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:04.079532 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 788/1599] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:04.081456 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d99171-92ea-423c-a3cd-cfc0c06793ba admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:04.084165 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-14695dd0-83d0-423c-92e8-7e6bbe9c3ec7 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:04.085520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-14695dd0-83d0-423c-92e8-7e6bbe9c3ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:04.092427 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d99171-92ea-423c-a3cd-cfc0c06793ba admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:04.095051 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 812/1600] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:04.098289 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593f6f4-8cf1-4d33-b9e9-794fab193dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:04.099492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593f6f4-8cf1-4d33-b9e9-794fab193dd7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:04.099588 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593f6f4-8cf1-4d33-b9e9-794fab193dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:04.099823 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14695dd0-83d0-423c-92e8-7e6bbe9c3ec7 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:04.100000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593f6f4-8cf1-4d33-b9e9-794fab193dd7 admin admin] PATH_INFO: `/v3/projects/0c33c87aaefe432993340c02b0afb579/users/a7fc6e9a0b644be98b10f953e8532305/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:04.109128 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14695dd0-83d0-423c-92e8-7e6bbe9c3ec7 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:04.114466 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b932a0-a6ec-4e8f-93b9-58a6eb866fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:04.115238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b932a0-a6ec-4e8f-93b9-58a6eb866fcc admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:04.115423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b932a0-a6ec-4e8f-93b9-58a6eb866fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:04.115750 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b932a0-a6ec-4e8f-93b9-58a6eb866fcc admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:04.116487 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b932a0-a6ec-4e8f-93b9-58a6eb866fcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:04.117666 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593f6f4-8cf1-4d33-b9e9-794fab193dd7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c33c87aaefe432993340c02b0afb579, user_id=a7fc6e9a0b644be98b10f953e8532305, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:04.118104 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b932a0-a6ec-4e8f-93b9-58a6eb866fcc admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:04.120596 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593f6f4-8cf1-4d33-b9e9-794fab193dd7 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:04.130351 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 813/1601] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:04.131186 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b932a0-a6ec-4e8f-93b9-58a6eb866fcc admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:04.136928 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 789/1602] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:04 2022] PUT /identity/v3/projects/0c33c87aaefe432993340c02b0afb579/users/a7fc6e9a0b644be98b10f953e8532305/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:04.138571 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4762f94-092a-486d-ac2d-c8e85b7eef72 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:04.139026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4762f94-092a-486d-ac2d-c8e85b7eef72 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:04.139748 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4762f94-092a-486d-ac2d-c8e85b7eef72 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:04.141446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 790/1603] 10.222.0.44 () {54 vars in 961 bytes} [Thu Jun 16 00:26:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:26:04.142289 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4762f94-092a-486d-ac2d-c8e85b7eef72 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:04.149987 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:04.152984 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b932a0-a6ec-4e8f-93b9-58a6eb866fcc admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:04.218461 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaaaad2-5e69-4e92-a1be-7c583bdcce8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:04.220296 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaaad2-5e69-4e92-a1be-7c583bdcce8a admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:04.220585 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaaad2-5e69-4e92-a1be-7c583bdcce8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:04.220871 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaaaad2-5e69-4e92-a1be-7c583bdcce8a admin admin] PATH_INFO: `/v3/projects/6f287106f64d4ff887b7f0b153f60b9f/users/f43114a6bba048dbbb680788399f0284/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:04.226368 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4762f94-092a-486d-ac2d-c8e85b7eef72 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:04.231832 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ea473-0017-4abb-8bfb-85b745f07668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:04.232701 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ea473-0017-4abb-8bfb-85b745f07668 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:04.232994 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ea473-0017-4abb-8bfb-85b745f07668 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:04.233273 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ea473-0017-4abb-8bfb-85b745f07668 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:04.234008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ea473-0017-4abb-8bfb-85b745f07668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:04.235679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ea473-0017-4abb-8bfb-85b745f07668 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:04.237799 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaaaad2-5e69-4e92-a1be-7c583bdcce8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f287106f64d4ff887b7f0b153f60b9f, user_id=f43114a6bba048dbbb680788399f0284, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:04.241062 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaaaad2-5e69-4e92-a1be-7c583bdcce8a admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:04.247791 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 791/1604] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:04 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:04.248725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ea473-0017-4abb-8bfb-85b745f07668 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:04.260107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ea473-0017-4abb-8bfb-85b745f07668 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:04.264426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 814/1605] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:04 2022] PUT /identity/v3/projects/6f287106f64d4ff887b7f0b153f60b9f/users/f43114a6bba048dbbb680788399f0284/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:04.264426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaaaad2-5e69-4e92-a1be-7c583bdcce8a admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:04.322407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaaaad2-5e69-4e92-a1be-7c583bdcce8a admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:04.326211 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df673d-5964-4c2d-814a-e8dba02a703c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:04.326944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df673d-5964-4c2d-814a-e8dba02a703c service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:04.327232 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df673d-5964-4c2d-814a-e8dba02a703c service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:04.327516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df673d-5964-4c2d-814a-e8dba02a703c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:04.329973 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d295e9a-9346-4a3f-bd88-e7d526ca9bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:04.330885 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d295e9a-9346-4a3f-bd88-e7d526ca9bb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:04.331782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d295e9a-9346-4a3f-bd88-e7d526ca9bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:04.332062 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d295e9a-9346-4a3f-bd88-e7d526ca9bb7 admin admin] PATH_INFO: `/v3/projects/0a869108ba4446c4b767d186c5db253f/users/a6c145cb49f54dd88307f416ff1bb92b/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:04.338394 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df673d-5964-4c2d-814a-e8dba02a703c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:04.339916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df673d-5964-4c2d-814a-e8dba02a703c service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:04.347894 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d295e9a-9346-4a3f-bd88-e7d526ca9bb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a869108ba4446c4b767d186c5db253f, user_id=a6c145cb49f54dd88307f416ff1bb92b, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:04.350095 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 815/1606] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:04.350702 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d295e9a-9346-4a3f-bd88-e7d526ca9bb7 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:04.351202 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df673d-5964-4c2d-814a-e8dba02a703c service neutron] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:04.363249 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df673d-5964-4c2d-814a-e8dba02a703c service neutron] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:04.371666 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 792/1607] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:04 2022] PUT /identity/v3/projects/0a869108ba4446c4b767d186c5db253f/users/a6c145cb49f54dd88307f416ff1bb92b/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:04.372894 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a5b09-8cbf-48e5-b82f-d9837fba693e None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:04.374923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a5b09-8cbf-48e5-b82f-d9837fba693e None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:04.375386 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a5b09-8cbf-48e5-b82f-d9837fba693e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:04.405467 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:04.418463 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-a75a5b09-8cbf-48e5-b82f-d9837fba693e None None] MFA Rules not processed for user `40432493f16b4df681daf5a1af87832a`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:04.422427 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a75a5b09-8cbf-48e5-b82f-d9837fba693e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:04.466507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ea1e3-8d3a-4a6d-8463-6205e8029c33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:04.467682 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ea1e3-8d3a-4a6d-8463-6205e8029c33 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:04.468468 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ea1e3-8d3a-4a6d-8463-6205e8029c33 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:04.468754 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ea1e3-8d3a-4a6d-8463-6205e8029c33 admin admin] PATH_INFO: `/v3/projects/328074cc79a04a7fadb45daeadc122d9/users/c9f9551112824c4d937502ed6ae59620/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:04.497896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ea1e3-8d3a-4a6d-8463-6205e8029c33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=328074cc79a04a7fadb45daeadc122d9, user_id=c9f9551112824c4d937502ed6ae59620, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:04.500789 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ea1e3-8d3a-4a6d-8463-6205e8029c33 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:04.541682 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 816/1608] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:04 2022] PUT /identity/v3/projects/328074cc79a04a7fadb45daeadc122d9/users/c9f9551112824c4d937502ed6ae59620/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:04.543251 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeced97-4b1e-430a-9aae-abba8ad86ef2 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:04.543561 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeced97-4b1e-430a-9aae-abba8ad86ef2 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:04.543843 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeced97-4b1e-430a-9aae-abba8ad86ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:04.556175 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 793/1609] 10.222.0.44 () {58 vars in 1058 bytes} [Thu Jun 16 00:26:04 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:04.557050 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a5b09-8cbf-48e5-b82f-d9837fba693e None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:04.575589 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a5b09-8cbf-48e5-b82f-d9837fba693e None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:04.596682 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:04.603264 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-dfeced97-4b1e-430a-9aae-abba8ad86ef2 None None] MFA Rules not processed for user `a7fc6e9a0b644be98b10f953e8532305`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:04.605517 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-dfeced97-4b1e-430a-9aae-abba8ad86ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:04.683243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90af26-5442-4d24-8a7d-325a7627d1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:04.684099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90af26-5442-4d24-8a7d-325a7627d1ca admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:04.684439 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90af26-5442-4d24-8a7d-325a7627d1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:04.684716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90af26-5442-4d24-8a7d-325a7627d1ca admin admin] PATH_INFO: `/v3/projects/def39ced63b64e3aa65c9542ae512e7e/users/f0c5a5705f34440abce48190674a76d5/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:04.714353 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90af26-5442-4d24-8a7d-325a7627d1ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=def39ced63b64e3aa65c9542ae512e7e, user_id=f0c5a5705f34440abce48190674a76d5, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:04.714595 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 817/1610] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:04.716742 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e28c2-15b9-4b2e-b995-db2ea25ce909 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:04.717148 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e28c2-15b9-4b2e-b995-db2ea25ce909 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:04.717539 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e28c2-15b9-4b2e-b995-db2ea25ce909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:04.721880 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90af26-5442-4d24-8a7d-325a7627d1ca admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:04.742580 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 794/1611] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:04 2022] PUT /identity/v3/projects/def39ced63b64e3aa65c9542ae512e7e/users/f0c5a5705f34440abce48190674a76d5/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:04.742580 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2ba52-3e48-4a66-ab7b-ed8bfa3053cc None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:04.742580 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2ba52-3e48-4a66-ab7b-ed8bfa3053cc None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:04.742580 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f2ba52-3e48-4a66-ab7b-ed8bfa3053cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:04.761064 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-a6f2ba52-3e48-4a66-ab7b-ed8bfa3053cc None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:04.762425 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a6f2ba52-3e48-4a66-ab7b-ed8bfa3053cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:04.776600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-a12e28c2-15b9-4b2e-b995-db2ea25ce909 None None] MFA Rules not processed for user `f43114a6bba048dbbb680788399f0284`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:04.783810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-a12e28c2-15b9-4b2e-b995-db2ea25ce909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:04.835073 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 795/1612] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:04.836864 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e405e-fa27-4586-bf24-82fb9f1a66d7 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:04.837311 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e405e-fa27-4586-bf24-82fb9f1a66d7 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:04.837695 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4e405e-fa27-4586-bf24-82fb9f1a66d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:04.870865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-cf4e405e-fa27-4586-bf24-82fb9f1a66d7 None None] MFA Rules not processed for user `c9f9551112824c4d937502ed6ae59620`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:04.871987 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-cf4e405e-fa27-4586-bf24-82fb9f1a66d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:04.883836 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:04.926681 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 818/1613] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:04.928186 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e28c2-15b9-4b2e-b995-db2ea25ce909 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:04.962550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 796/1614] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:04 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:04.962550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0400125-58b5-45e8-a1b1-f21fd480f4fd None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:04.962550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0400125-58b5-45e8-a1b1-f21fd480f4fd None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:04.962550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0400125-58b5-45e8-a1b1-f21fd480f4fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:04.985785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-d0400125-58b5-45e8-a1b1-f21fd480f4fd None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:04.987056 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d0400125-58b5-45e8-a1b1-f21fd480f4fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:05.012492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 797/1615] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:05.015558 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ac7e7-64e9-413d-8b5e-f1c58e046213 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:05.015886 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ac7e7-64e9-413d-8b5e-f1c58e046213 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:05.016165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2ac7e7-64e9-413d-8b5e-f1c58e046213 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:05.019888 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 798/1616] 10.222.0.44 () {54 vars in 961 bytes} [Thu Jun 16 00:26:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:26:05.020694 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ac7e7-64e9-413d-8b5e-f1c58e046213 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:05.090222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e28c2-15b9-4b2e-b995-db2ea25ce909 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:05.098148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2ac7e7-64e9-413d-8b5e-f1c58e046213 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:05.101908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d5760-eaa1-4da1-b4db-cdb1d7cfedd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:05.102564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d5760-eaa1-4da1-b4db-cdb1d7cfedd3 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:05.102849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d5760-eaa1-4da1-b4db-cdb1d7cfedd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:05.103129 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3d5760-eaa1-4da1-b4db-cdb1d7cfedd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:05.107834 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e7f34f-824b-4f44-9f50-0ea8546c067f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:05.114017 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7f34f-824b-4f44-9f50-0ea8546c067f service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:05.115138 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7f34f-824b-4f44-9f50-0ea8546c067f service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:05.115495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d5760-eaa1-4da1-b4db-cdb1d7cfedd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:05.115838 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e7f34f-824b-4f44-9f50-0ea8546c067f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:05.117179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3d5760-eaa1-4da1-b4db-cdb1d7cfedd3 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:05.141768 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 799/1617] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:05.142746 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d5760-eaa1-4da1-b4db-cdb1d7cfedd3 service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:05.155675 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3d5760-eaa1-4da1-b4db-cdb1d7cfedd3 service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:05.162317 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a222a01-2255-470b-a269-b5d280bcc8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:05.163134 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a222a01-2255-470b-a269-b5d280bcc8a3 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:05.163427 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a222a01-2255-470b-a269-b5d280bcc8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:05.163761 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a222a01-2255-470b-a269-b5d280bcc8a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:05.164467 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a222a01-2255-470b-a269-b5d280bcc8a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:05.168911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a222a01-2255-470b-a269-b5d280bcc8a3 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:05.221244 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:05.224279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 800/1618] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:05 2022] POST /identity/v3/projects => generated 367 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:05.230288 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a222a01-2255-470b-a269-b5d280bcc8a3 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:05.321705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7f34f-824b-4f44-9f50-0ea8546c067f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:05.324175 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e7f34f-824b-4f44-9f50-0ea8546c067f service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:05.368126 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 819/1619] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:05.372881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a222a01-2255-470b-a269-b5d280bcc8a3 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:05.383901 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e94aa-2982-47e1-b89d-d8275890101a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:05.387022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e94aa-2982-47e1-b89d-d8275890101a service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:05.387343 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e94aa-2982-47e1-b89d-d8275890101a service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:05.387647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e94aa-2982-47e1-b89d-d8275890101a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:05.388132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0665b-89a1-4d95-8ef5-6c24f9ccbee0 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:05.388435 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0665b-89a1-4d95-8ef5-6c24f9ccbee0 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:05.394429 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec0665b-89a1-4d95-8ef5-6c24f9ccbee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:05.467834 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:05.489753 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-3ec0665b-89a1-4d95-8ef5-6c24f9ccbee0 None None] MFA Rules not processed for user `40432493f16b4df681daf5a1af87832a`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:05.492403 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-3ec0665b-89a1-4d95-8ef5-6c24f9ccbee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:05.503694 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e94aa-2982-47e1-b89d-d8275890101a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:05.506607 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e94aa-2982-47e1-b89d-d8275890101a service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:05.529971 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 801/1620] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:05 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:05.531369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e94aa-2982-47e1-b89d-d8275890101a service cinder] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:05.537843 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-154e94aa-2982-47e1-b89d-d8275890101a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:05.682142 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e94aa-2982-47e1-b89d-d8275890101a service cinder] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:05.692995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23177e73-c29c-4d34-b333-64a4d19ea06a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:05.693830 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23177e73-c29c-4d34-b333-64a4d19ea06a service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:05.695508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23177e73-c29c-4d34-b333-64a4d19ea06a service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:05.696022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23177e73-c29c-4d34-b333-64a4d19ea06a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:05.704003 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 820/1621] 10.222.0.44 () {58 vars in 1058 bytes} [Thu Jun 16 00:26:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:05.705825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0665b-89a1-4d95-8ef5-6c24f9ccbee0 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:05.842038 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23177e73-c29c-4d34-b333-64a4d19ea06a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:05.845442 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23177e73-c29c-4d34-b333-64a4d19ea06a service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:05.846925 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec0665b-89a1-4d95-8ef5-6c24f9ccbee0 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:05.859089 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deef19e-4ea1-4ced-b4a0-d857e6f5603c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:05.861483 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deef19e-4ea1-4ced-b4a0-d857e6f5603c admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:05.861780 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deef19e-4ea1-4ced-b4a0-d857e6f5603c admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:05.862064 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deef19e-4ea1-4ced-b4a0-d857e6f5603c admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:05.868818 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deef19e-4ea1-4ced-b4a0-d857e6f5603c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:05.870479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deef19e-4ea1-4ced-b4a0-d857e6f5603c admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:05.871272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 802/1622] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:05.878578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23177e73-c29c-4d34-b333-64a4d19ea06a service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:05.916713 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 821/1623] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:05 2022] POST /identity/v3/users => generated 290 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:05.918604 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deef19e-4ea1-4ced-b4a0-d857e6f5603c admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:05.921263 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23177e73-c29c-4d34-b333-64a4d19ea06a service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:05.941417 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c7ef9d-8864-4b19-a92a-7b91b28913da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:05.942029 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deef19e-4ea1-4ced-b4a0-d857e6f5603c admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:05.942639 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7ef9d-8864-4b19-a92a-7b91b28913da service nova] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:05.942933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7ef9d-8864-4b19-a92a-7b91b28913da service nova] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:05.944354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c7ef9d-8864-4b19-a92a-7b91b28913da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:05.954246 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b11a3-8274-4003-bc7f-95d3a9356a71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:05.954949 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b11a3-8274-4003-bc7f-95d3a9356a71 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:05.955242 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b11a3-8274-4003-bc7f-95d3a9356a71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:05.955527 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b11a3-8274-4003-bc7f-95d3a9356a71 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:05.959814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b11a3-8274-4003-bc7f-95d3a9356a71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:05.962569 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4b11a3-8274-4003-bc7f-95d3a9356a71 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:05.998831 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 822/1624] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:06.000689 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b11a3-8274-4003-bc7f-95d3a9356a71 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:06.030042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4b11a3-8274-4003-bc7f-95d3a9356a71 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:06.043256 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fc2f15-8d94-464a-a52a-c8d6ed02c054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:06.045771 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc2f15-8d94-464a-a52a-c8d6ed02c054 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:06.046072 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc2f15-8d94-464a-a52a-c8d6ed02c054 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:06.047810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fc2f15-8d94-464a-a52a-c8d6ed02c054 admin admin] PATH_INFO: `/v3/projects/23c472aaeec44113b9e9d30e1fa20a90/users/740ea31263c945ad97656185a3686b7f/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:06.078205 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc2f15-8d94-464a-a52a-c8d6ed02c054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23c472aaeec44113b9e9d30e1fa20a90, user_id=740ea31263c945ad97656185a3686b7f, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:06.082787 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fc2f15-8d94-464a-a52a-c8d6ed02c054 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:06.107722 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 823/1625] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:05 2022] PUT /identity/v3/projects/23c472aaeec44113b9e9d30e1fa20a90/users/740ea31263c945ad97656185a3686b7f/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:06.111793 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dba3d7-c3e1-45c1-961d-7bcc5763aaf7 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:06.113956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dba3d7-c3e1-45c1-961d-7bcc5763aaf7 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:06.114548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dba3d7-c3e1-45c1-961d-7bcc5763aaf7 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:06.117995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 824/1626] 10.222.0.44 () {54 vars in 912 bytes} [Thu Jun 16 00:26:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:26:06.119185 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dba3d7-c3e1-45c1-961d-7bcc5763aaf7 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:06.124211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7ef9d-8864-4b19-a92a-7b91b28913da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:06.130462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c7ef9d-8864-4b19-a92a-7b91b28913da service nova] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:06.158105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:06.167039 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 803/1627] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:06.182845 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e83b3-e011-4d56-a0db-31e47e62a4f8 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:06.183216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e83b3-e011-4d56-a0db-31e47e62a4f8 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:06.183430 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3e83b3-e011-4d56-a0db-31e47e62a4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:06.246380 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-bd3e83b3-e011-4d56-a0db-31e47e62a4f8 None None] MFA Rules not processed for user `40432493f16b4df681daf5a1af87832a`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:06.250310 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-bd3e83b3-e011-4d56-a0db-31e47e62a4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:06.280069 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dba3d7-c3e1-45c1-961d-7bcc5763aaf7 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:06.294273 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017952fb-3a51-4332-95e9-7d358abb4fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:06.296671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017952fb-3a51-4332-95e9-7d358abb4fde admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:06.297050 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017952fb-3a51-4332-95e9-7d358abb4fde admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:06.298825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017952fb-3a51-4332-95e9-7d358abb4fde admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:06.300758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017952fb-3a51-4332-95e9-7d358abb4fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:06.304546 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017952fb-3a51-4332-95e9-7d358abb4fde admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:06.310672 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:06.340913 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 825/1628] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:06 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:06.342782 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017952fb-3a51-4332-95e9-7d358abb4fde admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:06.375116 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017952fb-3a51-4332-95e9-7d358abb4fde admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:06.392553 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb027e47-8d18-4123-9a73-573c6ef68bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:06.395041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb027e47-8d18-4123-9a73-573c6ef68bb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:06.396088 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb027e47-8d18-4123-9a73-573c6ef68bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:06.396504 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb027e47-8d18-4123-9a73-573c6ef68bb9 admin admin] PATH_INFO: `/v3/projects/23c472aaeec44113b9e9d30e1fa20a90/users/740ea31263c945ad97656185a3686b7f/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:06.405725 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb027e47-8d18-4123-9a73-573c6ef68bb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=23c472aaeec44113b9e9d30e1fa20a90, user_id=740ea31263c945ad97656185a3686b7f, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:06.414521 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb027e47-8d18-4123-9a73-573c6ef68bb9 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:06.445783 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 804/1629] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 00:26:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:06.453140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e83b3-e011-4d56-a0db-31e47e62a4f8 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:06.465085 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 826/1630] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:06 2022] PUT /identity/v3/projects/23c472aaeec44113b9e9d30e1fa20a90/users/740ea31263c945ad97656185a3686b7f/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:06.469492 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def4b61-b09b-44f9-90ce-e6e0f3541205 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:06.470965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def4b61-b09b-44f9-90ce-e6e0f3541205 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:06.472394 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def4b61-b09b-44f9-90ce-e6e0f3541205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:06.547584 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-9def4b61-b09b-44f9-90ce-e6e0f3541205 None None] MFA Rules not processed for user `740ea31263c945ad97656185a3686b7f`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:06.551813 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-9def4b61-b09b-44f9-90ce-e6e0f3541205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:06.682361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3e83b3-e011-4d56-a0db-31e47e62a4f8 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:06.749104 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 827/1631] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:06 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:06.760439 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def4b61-b09b-44f9-90ce-e6e0f3541205 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:06.885277 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660a4c2-2d88-4f0e-bf83-908acb9558fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:06.885934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660a4c2-2d88-4f0e-bf83-908acb9558fb service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:06.886213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660a4c2-2d88-4f0e-bf83-908acb9558fb service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:06.886490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660a4c2-2d88-4f0e-bf83-908acb9558fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:06.909899 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def4b61-b09b-44f9-90ce-e6e0f3541205 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:06.921928 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6133dc-f43a-42b4-9a22-5d2376fda5e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:06.922620 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6133dc-f43a-42b4-9a22-5d2376fda5e2 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:06.925873 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6133dc-f43a-42b4-9a22-5d2376fda5e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:06.926191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6133dc-f43a-42b4-9a22-5d2376fda5e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:06.954653 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6133dc-f43a-42b4-9a22-5d2376fda5e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:06.956906 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6133dc-f43a-42b4-9a22-5d2376fda5e2 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:06.984510 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 828/1632] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:06 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:06.988650 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4b989-f34c-40c3-9622-899dab991f4d None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:06.989536 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4b989-f34c-40c3-9622-899dab991f4d None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:06.989786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab4b989-f34c-40c3-9622-899dab991f4d None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:06.994542 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 829/1633] 10.222.0.44 () {54 vars in 912 bytes} [Thu Jun 16 00:26:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:26:07.000177 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8456c-7274-436a-b3dc-56c140b8a913 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:07.000581 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8456c-7274-436a-b3dc-56c140b8a913 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:07.000872 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e8456c-7274-436a-b3dc-56c140b8a913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:07.055411 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660a4c2-2d88-4f0e-bf83-908acb9558fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:07.056912 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660a4c2-2d88-4f0e-bf83-908acb9558fb service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:07.062280 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-88e8456c-7274-436a-b3dc-56c140b8a913 None None] MFA Rules not processed for user `40432493f16b4df681daf5a1af87832a`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:07.065991 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-88e8456c-7274-436a-b3dc-56c140b8a913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:07.095061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 830/1634] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 00:26:06 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:07.106169 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 805/1635] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:07.435234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8456c-7274-436a-b3dc-56c140b8a913 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:07.449627 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e8456c-7274-436a-b3dc-56c140b8a913 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:07.465450 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95f0619-8ac9-45df-af86-1a5c61ddf069 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:07.470449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f0619-8ac9-45df-af86-1a5c61ddf069 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:07.470756 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f0619-8ac9-45df-af86-1a5c61ddf069 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:07.471044 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95f0619-8ac9-45df-af86-1a5c61ddf069 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:07.507717 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f0619-8ac9-45df-af86-1a5c61ddf069 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:07.509199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95f0619-8ac9-45df-af86-1a5c61ddf069 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:07.531578 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 831/1636] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:08.171064 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660a4c2-2d88-4f0e-bf83-908acb9558fb service cinder] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:08.193928 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660a4c2-2d88-4f0e-bf83-908acb9558fb service cinder] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:08.213003 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e0155-ccb0-4113-a73d-c488e9f67d04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:08.214149 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e0155-ccb0-4113-a73d-c488e9f67d04 service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:08.214653 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e0155-ccb0-4113-a73d-c488e9f67d04 service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:08.215157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e0155-ccb0-4113-a73d-c488e9f67d04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:08.254073 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:08.386670 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e0155-ccb0-4113-a73d-c488e9f67d04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:08.388515 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e0155-ccb0-4113-a73d-c488e9f67d04 service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:08.420773 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 806/1637] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:10.516565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd2a1d-0b31-4164-93c3-a4f2f92730c5 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:10.517062 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd2a1d-0b31-4164-93c3-a4f2f92730c5 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:10.517404 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cd2a1d-0b31-4164-93c3-a4f2f92730c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:10.542218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:10.582555 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-54cd2a1d-0b31-4164-93c3-a4f2f92730c5 None None] MFA Rules not processed for user `8a57c3f4e4d7479c9f301195cd9764cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:10.583933 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-54cd2a1d-0b31-4164-93c3-a4f2f92730c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:10.798898 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 832/1638] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:10.810643 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3607b5-8910-4202-bb90-cce6f5160591 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:10.811401 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3607b5-8910-4202-bb90-cce6f5160591 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:10.811882 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3607b5-8910-4202-bb90-cce6f5160591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:10.839521 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-fa3607b5-8910-4202-bb90-cce6f5160591 None None] MFA Rules not processed for user `8a57c3f4e4d7479c9f301195cd9764cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:10.840984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-fa3607b5-8910-4202-bb90-cce6f5160591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:10.868626 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 807/1639] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:10.923948 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd2a1d-0b31-4164-93c3-a4f2f92730c5 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:10.952234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cd2a1d-0b31-4164-93c3-a4f2f92730c5 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:10.981401 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d766c9-1e91-403d-aeb3-55cfdbb49349 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:10.982087 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d766c9-1e91-403d-aeb3-55cfdbb49349 service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:10.982373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d766c9-1e91-403d-aeb3-55cfdbb49349 service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:10.982657 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d766c9-1e91-403d-aeb3-55cfdbb49349 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:10.998469 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d766c9-1e91-403d-aeb3-55cfdbb49349 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:11.000119 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d766c9-1e91-403d-aeb3-55cfdbb49349 service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:11.014285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 833/1640] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:10 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:11.657010 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6ebea-debc-4aa7-ac09-038b3d8d2f28 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:11.657289 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6ebea-debc-4aa7-ac09-038b3d8d2f28 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:11.657584 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6ebea-debc-4aa7-ac09-038b3d8d2f28 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:11.659352 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 808/1641] 10.222.0.44 () {54 vars in 912 bytes} [Thu Jun 16 00:26:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:26:11.665436 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f5a0e-152b-4415-b0b2-c21965436c9e None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:11.665927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f5a0e-152b-4415-b0b2-c21965436c9e None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:11.666062 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876f5a0e-152b-4415-b0b2-c21965436c9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:11.711704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-876f5a0e-152b-4415-b0b2-c21965436c9e None None] MFA Rules not processed for user `222e3db424f0476386bc3432cc0f868e`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:11.713371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-876f5a0e-152b-4415-b0b2-c21965436c9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:11.799386 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 834/1642] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 00:26:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:11.810570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6ebea-debc-4aa7-ac09-038b3d8d2f28 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:11.831415 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6ebea-debc-4aa7-ac09-038b3d8d2f28 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:11.837539 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edc2f3a-c82e-4409-8496-7b96d53866a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:11.838555 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc2f3a-c82e-4409-8496-7b96d53866a4 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:11.839181 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc2f3a-c82e-4409-8496-7b96d53866a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:11.840040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edc2f3a-c82e-4409-8496-7b96d53866a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:11.851401 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc2f3a-c82e-4409-8496-7b96d53866a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:11.854661 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edc2f3a-c82e-4409-8496-7b96d53866a4 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:11.888287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 809/1643] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:12.531227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f7a3a-b45a-4bf7-b408-756ac34c012d None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:12.531902 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f7a3a-b45a-4bf7-b408-756ac34c012d None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:12.532367 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3f7a3a-b45a-4bf7-b408-756ac34c012d None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:12.536337 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 835/1644] 10.222.0.44 () {54 vars in 960 bytes} [Thu Jun 16 00:26:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:26:12.542118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936fb6b-dba8-4514-ba19-3be0158056f0 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:12.542671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936fb6b-dba8-4514-ba19-3be0158056f0 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:12.543137 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936fb6b-dba8-4514-ba19-3be0158056f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:12.602009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-0936fb6b-dba8-4514-ba19-3be0158056f0 None None] MFA Rules not processed for user `9164f14fe6894daba1a9f2d8f1f4929c`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:12.603551 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-0936fb6b-dba8-4514-ba19-3be0158056f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:12.622815 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b1a39-e9ba-455f-8a50-e16aefdb1f80 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:12.623121 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b1a39-e9ba-455f-8a50-e16aefdb1f80 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:12.623445 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b1a39-e9ba-455f-8a50-e16aefdb1f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:12.649810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-da8b1a39-e9ba-455f-8a50-e16aefdb1f80 None None] MFA Rules not processed for user `8a57c3f4e4d7479c9f301195cd9764cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:12.651298 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-da8b1a39-e9ba-455f-8a50-e16aefdb1f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:12.661685 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 836/1645] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:12.731421 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 810/1646] 10.222.0.44 () {58 vars in 1057 bytes} [Thu Jun 16 00:26:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:12.744648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b1a39-e9ba-455f-8a50-e16aefdb1f80 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:12.766792 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b1a39-e9ba-455f-8a50-e16aefdb1f80 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:12.775547 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898bece1-cfbd-4d5d-a054-816c6bb1c85b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9164f14fe6894daba1a9f2d8f1f4929c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:12.776481 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bece1-cfbd-4d5d-a054-816c6bb1c85b service placement] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:12.805328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bece1-cfbd-4d5d-a054-816c6bb1c85b service placement] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:12.808703 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898bece1-cfbd-4d5d-a054-816c6bb1c85b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:12.812071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-898bece1-cfbd-4d5d-a054-816c6bb1c85b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:12.844786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bece1-cfbd-4d5d-a054-816c6bb1c85b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:12.846832 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898bece1-cfbd-4d5d-a054-816c6bb1c85b service placement] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:12.859280 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 837/1647] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:18.581266 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49431e2-7e01-4766-b9e5-702dfe9f1e61 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:18.581784 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49431e2-7e01-4766-b9e5-702dfe9f1e61 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:18.581784 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49431e2-7e01-4766-b9e5-702dfe9f1e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:18.649575 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-f49431e2-7e01-4766-b9e5-702dfe9f1e61 None None] MFA Rules not processed for user `129de9f58bcf4766a7c15e932d5b92ff`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:18.650813 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-f49431e2-7e01-4766-b9e5-702dfe9f1e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:18.666987 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859a511-9a5a-47bb-bda6-dbca7fb43bab None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:18.667509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859a511-9a5a-47bb-bda6-dbca7fb43bab None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:18.667630 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5859a511-9a5a-47bb-bda6-dbca7fb43bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:18.707479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-5859a511-9a5a-47bb-bda6-dbca7fb43bab None None] MFA Rules not processed for user `39bbc5ff02d24f40b796bd2245a7431a`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:18.710371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-5859a511-9a5a-47bb-bda6-dbca7fb43bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:18.894608 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 811/1648] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:18.907184 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca0fd2-fd09-4eb2-8fb6-be784167d080 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:18.907816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca0fd2-fd09-4eb2-8fb6-be784167d080 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:18.908340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca0fd2-fd09-4eb2-8fb6-be784167d080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:18.911090 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 838/1649] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 00:26:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:18.985839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-a2ca0fd2-fd09-4eb2-8fb6-be784167d080 None None] MFA Rules not processed for user `129de9f58bcf4766a7c15e932d5b92ff`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:18.987730 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a2ca0fd2-fd09-4eb2-8fb6-be784167d080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:19.042648 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 812/1650] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:19.326997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859a511-9a5a-47bb-bda6-dbca7fb43bab None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:19.334614 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca0fd2-fd09-4eb2-8fb6-be784167d080 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:19.336485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a2ca0fd2-fd09-4eb2-8fb6-be784167d080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:19.340690 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:19.348178 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5859a511-9a5a-47bb-bda6-dbca7fb43bab None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:19.380088 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90190c-8ab7-43fe-8f04-d193d00a3c47 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:19.382229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90190c-8ab7-43fe-8f04-d193d00a3c47 service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:19.382741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90190c-8ab7-43fe-8f04-d193d00a3c47 service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:19.383492 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a90190c-8ab7-43fe-8f04-d193d00a3c47 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:19.391307 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:19.409803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90190c-8ab7-43fe-8f04-d193d00a3c47 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:19.414677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a90190c-8ab7-43fe-8f04-d193d00a3c47 service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:19.433297 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 839/1651] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:19 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:19.653096 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ca0fd2-fd09-4eb2-8fb6-be784167d080 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:19.663424 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dde3f4-ef9b-48dc-ba0b-928a96638fe7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918c4a8c6a64812b61fc235ab8e7bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:19.664983 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dde3f4-ef9b-48dc-ba0b-928a96638fe7 service swift] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:19.665640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dde3f4-ef9b-48dc-ba0b-928a96638fe7 service swift] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:19.666203 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dde3f4-ef9b-48dc-ba0b-928a96638fe7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:19.679194 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dde3f4-ef9b-48dc-ba0b-928a96638fe7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:19.681430 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dde3f4-ef9b-48dc-ba0b-928a96638fe7 service swift] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:19.695802 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 813/1652] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 00:26:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:26:19.923146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90190c-8ab7-43fe-8f04-d193d00a3c47 service nova] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:20.200390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a90190c-8ab7-43fe-8f04-d193d00a3c47 service nova] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:20.210270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be03cd-e861-4411-957f-95c3cee38023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:20.211528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be03cd-e861-4411-957f-95c3cee38023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:20.212010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be03cd-e861-4411-957f-95c3cee38023 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:20.212447 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be03cd-e861-4411-957f-95c3cee38023 admin admin] PATH_INFO: `/v3/users/0e1aa49762f340eea2a95e80bb0dbd24` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:20.215645 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be03cd-e861-4411-957f-95c3cee38023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e1aa49762f340eea2a95e80bb0dbd24)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:20.218350 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be03cd-e861-4411-957f-95c3cee38023 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:20.356840 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-01be03cd-e861-4411-957f-95c3cee38023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e1aa49762f340eea2a95e80bb0dbd24'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:20.376733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-01be03cd-e861-4411-957f-95c3cee38023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e1aa49762f340eea2a95e80bb0dbd24'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:20.378362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-01be03cd-e861-4411-957f-95c3cee38023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e1aa49762f340eea2a95e80bb0dbd24'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:20.379383 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-01be03cd-e861-4411-957f-95c3cee38023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e1aa49762f340eea2a95e80bb0dbd24'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:20.414464 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-01be03cd-e861-4411-957f-95c3cee38023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e1aa49762f340eea2a95e80bb0dbd24'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:20.457858 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12e354-0680-410e-822c-6916896ab8bb None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:20.459309 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12e354-0680-410e-822c-6916896ab8bb None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:20.459871 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12e354-0680-410e-822c-6916896ab8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:20.461487 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 840/1653] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:19 2022] DELETE /identity/v3/users/0e1aa49762f340eea2a95e80bb0dbd24 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:20.490208 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-2a12e354-0680-410e-822c-6916896ab8bb None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:20.493130 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-2a12e354-0680-410e-822c-6916896ab8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:20.685507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be03cd-e861-4411-957f-95c3cee38023 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:20.687532 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-01be03cd-e861-4411-957f-95c3cee38023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:20.759881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 814/1654] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:20.800209 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12e354-0680-410e-822c-6916896ab8bb None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:20.802246 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-2a12e354-0680-410e-822c-6916896ab8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:20.934611 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be03cd-e861-4411-957f-95c3cee38023 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:20.958879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af055d5a-aa4e-49c1-bdb3-4a60bc254f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:20.959841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af055d5a-aa4e-49c1-bdb3-4a60bc254f4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:20.960136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af055d5a-aa4e-49c1-bdb3-4a60bc254f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:20.960423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af055d5a-aa4e-49c1-bdb3-4a60bc254f4a admin admin] PATH_INFO: `/v3/users/a7fc6e9a0b644be98b10f953e8532305` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:20.967565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af055d5a-aa4e-49c1-bdb3-4a60bc254f4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7fc6e9a0b644be98b10f953e8532305)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:20.969597 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af055d5a-aa4e-49c1-bdb3-4a60bc254f4a admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:21.010689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a12e354-0680-410e-822c-6916896ab8bb None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:21.020631 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:21.031571 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ecb173-0e7a-4a45-bc74-efcdf6a2a6f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:21.032472 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecb173-0e7a-4a45-bc74-efcdf6a2a6f7 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:21.032761 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecb173-0e7a-4a45-bc74-efcdf6a2a6f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:21.033103 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ecb173-0e7a-4a45-bc74-efcdf6a2a6f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:21.068276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecb173-0e7a-4a45-bc74-efcdf6a2a6f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:21.072136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ecb173-0e7a-4a45-bc74-efcdf6a2a6f7 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:21.128448 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 815/1655] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:21.130383 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-af055d5a-aa4e-49c1-bdb3-4a60bc254f4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7fc6e9a0b644be98b10f953e8532305'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:21.149229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-af055d5a-aa4e-49c1-bdb3-4a60bc254f4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7fc6e9a0b644be98b10f953e8532305'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:21.150262 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-af055d5a-aa4e-49c1-bdb3-4a60bc254f4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7fc6e9a0b644be98b10f953e8532305'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:21.151207 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-af055d5a-aa4e-49c1-bdb3-4a60bc254f4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7fc6e9a0b644be98b10f953e8532305'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:21.181074 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-af055d5a-aa4e-49c1-bdb3-4a60bc254f4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7fc6e9a0b644be98b10f953e8532305'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:21.216331 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 841/1656] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:20 2022] DELETE /identity/v3/users/a7fc6e9a0b644be98b10f953e8532305 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:21.221176 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca47c0d-9b99-4103-b42e-fcf5a185ee5a None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:21.221476 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca47c0d-9b99-4103-b42e-fcf5a185ee5a None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:21.221811 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca47c0d-9b99-4103-b42e-fcf5a185ee5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:21.257349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-0ca47c0d-9b99-4103-b42e-fcf5a185ee5a None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:21.258800 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-0ca47c0d-9b99-4103-b42e-fcf5a185ee5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:21.406130 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:21.437388 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 816/1657] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:21.502817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68083449-ac97-4fe9-a3b5-07e0a4e1929c None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:21.503133 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68083449-ac97-4fe9-a3b5-07e0a4e1929c None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:21.503391 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68083449-ac97-4fe9-a3b5-07e0a4e1929c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:21.553622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca47c0d-9b99-4103-b42e-fcf5a185ee5a None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:21.555330 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-0ca47c0d-9b99-4103-b42e-fcf5a185ee5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:21.586138 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-68083449-ac97-4fe9-a3b5-07e0a4e1929c None None] MFA Rules not processed for user `a6c145cb49f54dd88307f416ff1bb92b`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:21.593918 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-68083449-ac97-4fe9-a3b5-07e0a4e1929c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:21.799906 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca47c0d-9b99-4103-b42e-fcf5a185ee5a None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:21.827037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e4828-daef-4c2c-bd40-119cc0b0f5bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:21.829730 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e4828-daef-4c2c-bd40-119cc0b0f5bf service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:21.833310 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e4828-daef-4c2c-bd40-119cc0b0f5bf service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:21.834388 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046e4828-daef-4c2c-bd40-119cc0b0f5bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:21.865024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e4828-daef-4c2c-bd40-119cc0b0f5bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:21.867353 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046e4828-daef-4c2c-bd40-119cc0b0f5bf service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:21.892097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 817/1658] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:21.893895 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e4828-daef-4c2c-bd40-119cc0b0f5bf service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:21.899227 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-046e4828-daef-4c2c-bd40-119cc0b0f5bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:21.926257 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 842/1659] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 425 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:21.933251 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046e4828-daef-4c2c-bd40-119cc0b0f5bf service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:21.950544 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52313268-65d5-4669-acd4-bb5160c42b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:21.951879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52313268-65d5-4669-acd4-bb5160c42b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:21.952187 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52313268-65d5-4669-acd4-bb5160c42b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:21.952649 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52313268-65d5-4669-acd4-bb5160c42b91 admin admin] PATH_INFO: `/v3/projects/de27b90e7b904729a7e43c799e0584cf` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:21.958084 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52313268-65d5-4669-acd4-bb5160c42b91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de27b90e7b904729a7e43c799e0584cf)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:21.960200 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52313268-65d5-4669-acd4-bb5160c42b91 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:22.001426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bde0a-f8cd-4f1f-b221-9499e2bee772 None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:22.002986 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bde0a-f8cd-4f1f-b221-9499e2bee772 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:22.003414 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8bde0a-f8cd-4f1f-b221-9499e2bee772 None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:22.005712 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 843/1660] 10.222.0.44 () {54 vars in 912 bytes} [Thu Jun 16 00:26:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:26:22.029940 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b49ffd-b65b-4943-81b2-a346de82658e None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:22.030949 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b49ffd-b65b-4943-81b2-a346de82658e None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:22.031388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b49ffd-b65b-4943-81b2-a346de82658e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:22.085030 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-52313268-65d5-4669-acd4-bb5160c42b91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de27b90e7b904729a7e43c799e0584cf', 'request_id': 'req-52313268-65d5-4669-acd4-bb5160c42b91'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:22.091870 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-f7b49ffd-b65b-4943-81b2-a346de82658e None None] MFA Rules not processed for user `222e3db424f0476386bc3432cc0f868e`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:22.093305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-f7b49ffd-b65b-4943-81b2-a346de82658e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:22.102249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-52313268-65d5-4669-acd4-bb5160c42b91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de27b90e7b904729a7e43c799e0584cf', 'request_id': 'req-52313268-65d5-4669-acd4-bb5160c42b91'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:22.117933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-52313268-65d5-4669-acd4-bb5160c42b91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de27b90e7b904729a7e43c799e0584cf', 'request_id': 'req-52313268-65d5-4669-acd4-bb5160c42b91'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:22.156025 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-52313268-65d5-4669-acd4-bb5160c42b91 admin admin] The token cache is being invalidate because project de27b90e7b904729a7e43c799e0584cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:22.156154 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-52313268-65d5-4669-acd4-bb5160c42b91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:22.159566 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-52313268-65d5-4669-acd4-bb5160c42b91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:22.167782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 818/1661] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:21 2022] DELETE /identity/v3/projects/de27b90e7b904729a7e43c799e0584cf => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:22.176903 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52313268-65d5-4669-acd4-bb5160c42b91 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:22.179220 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-52313268-65d5-4669-acd4-bb5160c42b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:22.346900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 844/1662] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 00:26:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:22.350432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f13d8a-229a-4ebe-817f-34dde9151599 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:22.350742 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f13d8a-229a-4ebe-817f-34dde9151599 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:22.351031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f13d8a-229a-4ebe-817f-34dde9151599 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:22.407856 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52313268-65d5-4669-acd4-bb5160c42b91 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:22.421605 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-48f13d8a-229a-4ebe-817f-34dde9151599 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:22.422866 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a11c0-d0aa-47e4-a3b6-a53cb72c77b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:22.424216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a11c0-d0aa-47e4-a3b6-a53cb72c77b8 service nova] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:22.424507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a11c0-d0aa-47e4-a3b6-a53cb72c77b8 service nova] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:22.424792 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a11c0-d0aa-47e4-a3b6-a53cb72c77b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:22.431332 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-3d0a11c0-d0aa-47e4-a3b6-a53cb72c77b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:22.434390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-48f13d8a-229a-4ebe-817f-34dde9151599 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:22.456905 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:22.530470 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:22.571141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a11c0-d0aa-47e4-a3b6-a53cb72c77b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:22.572816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a11c0-d0aa-47e4-a3b6-a53cb72c77b8 service nova] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:22.597249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 819/1663] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:22.598572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a11c0-d0aa-47e4-a3b6-a53cb72c77b8 service nova] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:22.600907 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-3d0a11c0-d0aa-47e4-a3b6-a53cb72c77b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:22.626085 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a11c0-d0aa-47e4-a3b6-a53cb72c77b8 service nova] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:22.648464 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbf6aa-71ac-4c5f-8113-16f4aba4c019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:22.649142 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbf6aa-71ac-4c5f-8113-16f4aba4c019 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:22.649429 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbf6aa-71ac-4c5f-8113-16f4aba4c019 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:22.649705 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbf6aa-71ac-4c5f-8113-16f4aba4c019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:22.668484 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbf6aa-71ac-4c5f-8113-16f4aba4c019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:22.669981 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbf6aa-71ac-4c5f-8113-16f4aba4c019 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:22.691316 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 820/1664] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:22.697045 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 845/1665] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:22.704568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1197d5c-a09a-488b-91b0-1f82187e433f None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:22.705552 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1197d5c-a09a-488b-91b0-1f82187e433f None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:22.705685 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1197d5c-a09a-488b-91b0-1f82187e433f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:22.751324 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-a1197d5c-a09a-488b-91b0-1f82187e433f None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:22.755042 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a1197d5c-a09a-488b-91b0-1f82187e433f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:22.789899 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f13d8a-229a-4ebe-817f-34dde9151599 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:22.791600 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 821/1666] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:22.822162 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f13d8a-229a-4ebe-817f-34dde9151599 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:22.852168 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21aa97-e2ba-4878-a748-29e5a8d6dace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:22.853553 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21aa97-e2ba-4878-a748-29e5a8d6dace admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:22.855673 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21aa97-e2ba-4878-a748-29e5a8d6dace admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:22.858142 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a21aa97-e2ba-4878-a748-29e5a8d6dace admin admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:22.861256 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21aa97-e2ba-4878-a748-29e5a8d6dace admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:22.861992 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21aa97-e2ba-4878-a748-29e5a8d6dace admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:22.869655 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a21aa97-e2ba-4878-a748-29e5a8d6dace admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:22.951469 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 846/1667] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:26:22.956421 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1197d5c-a09a-488b-91b0-1f82187e433f None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:22.970877 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1197d5c-a09a-488b-91b0-1f82187e433f None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:22.989241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289424b7-9091-4373-a5ed-3c1e0f5f6785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:22.989937 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289424b7-9091-4373-a5ed-3c1e0f5f6785 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:22.990225 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289424b7-9091-4373-a5ed-3c1e0f5f6785 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:22.992663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289424b7-9091-4373-a5ed-3c1e0f5f6785 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:22.993430 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289424b7-9091-4373-a5ed-3c1e0f5f6785 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:23.001086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289424b7-9091-4373-a5ed-3c1e0f5f6785 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:23.115139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 822/1668] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:22 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:23.116023 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21aa97-e2ba-4878-a748-29e5a8d6dace admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:23.163446 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a21aa97-e2ba-4878-a748-29e5a8d6dace admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:23.315270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fb84f-f659-4a3a-b93b-ec5ea2fa6a7d None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:23.315704 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fb84f-f659-4a3a-b93b-ec5ea2fa6a7d None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:23.316078 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61fb84f-f659-4a3a-b93b-ec5ea2fa6a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:23.393481 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-b61fb84f-f659-4a3a-b93b-ec5ea2fa6a7d None None] MFA Rules not processed for user `f0c5a5705f34440abce48190674a76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:23.396885 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-b61fb84f-f659-4a3a-b93b-ec5ea2fa6a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:23.423752 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fedd93-9567-4cfd-b350-7e9c1a8cb50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:23.424463 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fedd93-9567-4cfd-b350-7e9c1a8cb50b admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:23.424758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fedd93-9567-4cfd-b350-7e9c1a8cb50b admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:23.425045 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fedd93-9567-4cfd-b350-7e9c1a8cb50b admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:23.425778 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fedd93-9567-4cfd-b350-7e9c1a8cb50b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:23.450313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fedd93-9567-4cfd-b350-7e9c1a8cb50b admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:23.502732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 847/1669] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:23 2022] POST /identity/v3/users => generated 292 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:26:23.506600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fedd93-9567-4cfd-b350-7e9c1a8cb50b admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:23.565203 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fedd93-9567-4cfd-b350-7e9c1a8cb50b admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:23.578754 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab34c18-b680-4c1d-a9b0-f3db1410c80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:23.580563 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab34c18-b680-4c1d-a9b0-f3db1410c80f admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:23.580859 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab34c18-b680-4c1d-a9b0-f3db1410c80f admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:23.581561 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab34c18-b680-4c1d-a9b0-f3db1410c80f admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:23.582010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab34c18-b680-4c1d-a9b0-f3db1410c80f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:23.585476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab34c18-b680-4c1d-a9b0-f3db1410c80f admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:23.628788 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 823/1670] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:23.647444 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 848/1671] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:23.647690 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fb84f-f659-4a3a-b93b-ec5ea2fa6a7d None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:23.692085 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61fb84f-f659-4a3a-b93b-ec5ea2fa6a7d None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:23.699837 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b66d95-e2e3-4697-8794-8cb6cb299989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:23.700735 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b66d95-e2e3-4697-8794-8cb6cb299989 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:23.701330 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b66d95-e2e3-4697-8794-8cb6cb299989 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:23.701787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b66d95-e2e3-4697-8794-8cb6cb299989 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:23.702887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b66d95-e2e3-4697-8794-8cb6cb299989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:23.707919 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b66d95-e2e3-4697-8794-8cb6cb299989 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:23.735456 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 824/1672] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:23.739047 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab34c18-b680-4c1d-a9b0-f3db1410c80f admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:23.754416 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab34c18-b680-4c1d-a9b0-f3db1410c80f admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:23.766894 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b86de-9e24-4086-be29-0cd2f6f74cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:23.768473 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b86de-9e24-4086-be29-0cd2f6f74cab admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:23.768769 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b86de-9e24-4086-be29-0cd2f6f74cab admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:23.769060 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235b86de-9e24-4086-be29-0cd2f6f74cab admin admin] PATH_INFO: `/v3/projects/e6d7259e98d240728cafd2757c98efcc/users/1277a96fba804b02a07af82beeaaedac/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:23.810670 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b86de-9e24-4086-be29-0cd2f6f74cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6d7259e98d240728cafd2757c98efcc, user_id=1277a96fba804b02a07af82beeaaedac, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:23.814963 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235b86de-9e24-4086-be29-0cd2f6f74cab admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:23.846570 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 849/1673] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:23 2022] PUT /identity/v3/projects/e6d7259e98d240728cafd2757c98efcc/users/1277a96fba804b02a07af82beeaaedac/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:26:23.856717 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1e8e-b309-48d1-a5d8-6b7a2661cc8c None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:23.857612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1e8e-b309-48d1-a5d8-6b7a2661cc8c None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:23.858096 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff1e8e-b309-48d1-a5d8-6b7a2661cc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:23.981882 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-b4ff1e8e-b309-48d1-a5d8-6b7a2661cc8c None None] MFA Rules not processed for user `1277a96fba804b02a07af82beeaaedac`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:23.984884 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-b4ff1e8e-b309-48d1-a5d8-6b7a2661cc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:23.996129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b86de-9e24-4086-be29-0cd2f6f74cab admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:24.128910 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:24.214291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 825/1674] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:24.215236 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff1e8e-b309-48d1-a5d8-6b7a2661cc8c None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:24.318174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235b86de-9e24-4086-be29-0cd2f6f74cab admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:24.338908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3adf4a-b790-4c4f-8c39-3b14bbd87281 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:24.339595 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3adf4a-b790-4c4f-8c39-3b14bbd87281 service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:24.339916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3adf4a-b790-4c4f-8c39-3b14bbd87281 service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:24.340284 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3adf4a-b790-4c4f-8c39-3b14bbd87281 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:24.369031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:24.469744 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff1e8e-b309-48d1-a5d8-6b7a2661cc8c None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:24.483091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7f123-6a39-4648-a59c-354c779d4d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:24.484090 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7f123-6a39-4648-a59c-354c779d4d1d admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:24.484458 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7f123-6a39-4648-a59c-354c779d4d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:24.484839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d7f123-6a39-4648-a59c-354c779d4d1d admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:24.486086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7f123-6a39-4648-a59c-354c779d4d1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:24.491051 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d7f123-6a39-4648-a59c-354c779d4d1d admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:24.613482 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3adf4a-b790-4c4f-8c39-3b14bbd87281 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:24.619325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3adf4a-b790-4c4f-8c39-3b14bbd87281 service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:24.639369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 826/1675] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:24 2022] POST /identity/v3/projects => generated 381 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:24.641659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7f123-6a39-4648-a59c-354c779d4d1d admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:24.645089 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 850/1676] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:25.048113 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f2c69-c0d0-4d66-834e-63beda2520c9 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:25.050203 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f2c69-c0d0-4d66-834e-63beda2520c9 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:25.050426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369f2c69-c0d0-4d66-834e-63beda2520c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:25.124856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-369f2c69-c0d0-4d66-834e-63beda2520c9 None None] MFA Rules not processed for user `222e3db424f0476386bc3432cc0f868e`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:25.131293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-369f2c69-c0d0-4d66-834e-63beda2520c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:25.137830 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d7f123-6a39-4648-a59c-354c779d4d1d admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:25.161181 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9dd96-6e7e-428e-8322-b3561a5a7ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:25.161893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9dd96-6e7e-428e-8322-b3561a5a7ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:25.167652 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9dd96-6e7e-428e-8322-b3561a5a7ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:25.168747 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9dd96-6e7e-428e-8322-b3561a5a7ed2 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:25.176223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9dd96-6e7e-428e-8322-b3561a5a7ed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:25.188630 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9dd96-6e7e-428e-8322-b3561a5a7ed2 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:25.283942 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 827/1677] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:24 2022] POST /identity/v3/users => generated 297 bytes in 643 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:25.285039 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9dd96-6e7e-428e-8322-b3561a5a7ed2 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:25.339916 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9dd96-6e7e-428e-8322-b3561a5a7ed2 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:25.356532 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f6f74-4e30-4c2d-95f0-cb74fc644729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:25.377079 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 851/1678] 10.222.0.45 () {58 vars in 1015 bytes} [Thu Jun 16 00:26:25 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:25.378743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f6f74-4e30-4c2d-95f0-cb74fc644729 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:25.380473 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f6f74-4e30-4c2d-95f0-cb74fc644729 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:25.387966 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212f6f74-4e30-4c2d-95f0-cb74fc644729 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:25.387966 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f6f74-4e30-4c2d-95f0-cb74fc644729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:25.422122 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212f6f74-4e30-4c2d-95f0-cb74fc644729 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:25.453243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 828/1679] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:25.455153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f2c69-c0d0-4d66-834e-63beda2520c9 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:25.466650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f6f74-4e30-4c2d-95f0-cb74fc644729 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:25.503940 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369f2c69-c0d0-4d66-834e-63beda2520c9 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:25.528264 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212f6f74-4e30-4c2d-95f0-cb74fc644729 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:25.529115 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf730a-d8be-403f-9c21-b8fea43798e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:25.537297 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf730a-d8be-403f-9c21-b8fea43798e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:25.537927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf730a-d8be-403f-9c21-b8fea43798e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:25.541853 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cf730a-d8be-403f-9c21-b8fea43798e7 admin admin] PATH_INFO: `/v3/projects/235ff990c75b4f1ea3d93ee6831242e2/users/327c62079f03487188ec6b7ab7ed05d4/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:25.551573 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600e3c0-b40d-4af8-805b-3e1025dc9522 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:25.553976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600e3c0-b40d-4af8-805b-3e1025dc9522 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:25.557614 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600e3c0-b40d-4af8-805b-3e1025dc9522 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:25.559986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600e3c0-b40d-4af8-805b-3e1025dc9522 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:25.592707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf730a-d8be-403f-9c21-b8fea43798e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=235ff990c75b4f1ea3d93ee6831242e2, user_id=327c62079f03487188ec6b7ab7ed05d4, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:25.594715 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600e3c0-b40d-4af8-805b-3e1025dc9522 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:25.597099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cf730a-d8be-403f-9c21-b8fea43798e7 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:25.598660 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600e3c0-b40d-4af8-805b-3e1025dc9522 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:25.629839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 829/1680] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:25.648458 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 852/1681] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:25 2022] PUT /identity/v3/projects/235ff990c75b4f1ea3d93ee6831242e2/users/327c62079f03487188ec6b7ab7ed05d4/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:25.650026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600e3c0-b40d-4af8-805b-3e1025dc9522 service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:25.668396 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600e3c0-b40d-4af8-805b-3e1025dc9522 service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:25.791571 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:25.949311 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce60d76f-984b-4d89-9c50-fd601a644aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:25.950708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60d76f-984b-4d89-9c50-fd601a644aab admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:25.953198 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60d76f-984b-4d89-9c50-fd601a644aab admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:25.954445 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce60d76f-984b-4d89-9c50-fd601a644aab admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:25.956007 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60d76f-984b-4d89-9c50-fd601a644aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:25.961425 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce60d76f-984b-4d89-9c50-fd601a644aab admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:26.018162 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf730a-d8be-403f-9c21-b8fea43798e7 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:26.018674 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 830/1682] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:25 2022] GET /identity/v3/roles => generated 1420 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:26.039762 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cf730a-d8be-403f-9c21-b8fea43798e7 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:26.046443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda5761-70dc-4e47-a368-51e1bde84b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:26.047852 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda5761-70dc-4e47-a368-51e1bde84b57 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:26.048558 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda5761-70dc-4e47-a368-51e1bde84b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:26.049130 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bda5761-70dc-4e47-a368-51e1bde84b57 admin admin] PATH_INFO: `/v3/projects/235ff990c75b4f1ea3d93ee6831242e2/users/327c62079f03487188ec6b7ab7ed05d4/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:26.052952 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda5761-70dc-4e47-a368-51e1bde84b57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=235ff990c75b4f1ea3d93ee6831242e2, user_id=327c62079f03487188ec6b7ab7ed05d4, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:26.057722 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bda5761-70dc-4e47-a368-51e1bde84b57 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:26.085125 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 853/1683] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:26 2022] PUT /identity/v3/projects/235ff990c75b4f1ea3d93ee6831242e2/users/327c62079f03487188ec6b7ab7ed05d4/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:26:26.089079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef54350-bf37-43d2-86a2-ba78ca6e4e63 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:26.089584 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef54350-bf37-43d2-86a2-ba78ca6e4e63 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:26.090536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef54350-bf37-43d2-86a2-ba78ca6e4e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:26.143700 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-0ef54350-bf37-43d2-86a2-ba78ca6e4e63 None None] MFA Rules not processed for user `327c62079f03487188ec6b7ab7ed05d4`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:26.148223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-0ef54350-bf37-43d2-86a2-ba78ca6e4e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:26.434277 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 831/1684] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:26 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:26.446733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda5761-70dc-4e47-a368-51e1bde84b57 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:26.448673 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-5bda5761-70dc-4e47-a368-51e1bde84b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:26.688215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bda5761-70dc-4e47-a368-51e1bde84b57 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:26.688534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef54350-bf37-43d2-86a2-ba78ca6e4e63 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:26.690372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-0ef54350-bf37-43d2-86a2-ba78ca6e4e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:26.707333 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da884f53-dd25-40e1-aed5-3d2d2d4627b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:26.708116 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da884f53-dd25-40e1-aed5-3d2d2d4627b9 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:26.708405 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da884f53-dd25-40e1-aed5-3d2d2d4627b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:26.709119 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da884f53-dd25-40e1-aed5-3d2d2d4627b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:26.736990 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da884f53-dd25-40e1-aed5-3d2d2d4627b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:26.738534 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da884f53-dd25-40e1-aed5-3d2d2d4627b9 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:26.780107 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 854/1685] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:26 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:26.986413 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef54350-bf37-43d2-86a2-ba78ca6e4e63 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:27.006439 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cbdff-bf12-4d37-aa0c-7663882ea676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:27.007343 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cbdff-bf12-4d37-aa0c-7663882ea676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:27.007670 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cbdff-bf12-4d37-aa0c-7663882ea676 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:27.012421 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cbdff-bf12-4d37-aa0c-7663882ea676 admin admin] PATH_INFO: `/v3/projects/0c33c87aaefe432993340c02b0afb579` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:27.015470 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4cbdff-bf12-4d37-aa0c-7663882ea676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c33c87aaefe432993340c02b0afb579)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:27.025392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4cbdff-bf12-4d37-aa0c-7663882ea676 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:27.073646 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da884f53-dd25-40e1-aed5-3d2d2d4627b9 service cinder] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:27.092826 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da884f53-dd25-40e1-aed5-3d2d2d4627b9 service cinder] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:27.108384 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd3fb4-475a-41d8-a5f4-46a1b2b567d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:27.108825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd3fb4-475a-41d8-a5f4-46a1b2b567d1 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:27.109114 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd3fb4-475a-41d8-a5f4-46a1b2b567d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:27.109396 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd3fb4-475a-41d8-a5f4-46a1b2b567d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:27.192389 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:27.192594 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-1d4cbdff-bf12-4d37-aa0c-7663882ea676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c33c87aaefe432993340c02b0afb579', 'request_id': 'req-1d4cbdff-bf12-4d37-aa0c-7663882ea676'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:27.195499 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:27.231457 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-1d4cbdff-bf12-4d37-aa0c-7663882ea676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c33c87aaefe432993340c02b0afb579', 'request_id': 'req-1d4cbdff-bf12-4d37-aa0c-7663882ea676'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:27.252542 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-1d4cbdff-bf12-4d37-aa0c-7663882ea676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c33c87aaefe432993340c02b0afb579', 'request_id': 'req-1d4cbdff-bf12-4d37-aa0c-7663882ea676'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:27.310430 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-1d4cbdff-bf12-4d37-aa0c-7663882ea676 admin admin] The token cache is being invalidate because project 0c33c87aaefe432993340c02b0afb579 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:27.310729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-1d4cbdff-bf12-4d37-aa0c-7663882ea676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:27.327398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-1d4cbdff-bf12-4d37-aa0c-7663882ea676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:27.348836 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 832/1686] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:26 2022] DELETE /identity/v3/projects/0c33c87aaefe432993340c02b0afb579 => generated 0 bytes in 661 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:26:27.353629 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1932e6d-a800-40cb-b7ea-8aaa23b37e5f None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:27.353948 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1932e6d-a800-40cb-b7ea-8aaa23b37e5f None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:27.354198 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1932e6d-a800-40cb-b7ea-8aaa23b37e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:27.404143 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd3fb4-475a-41d8-a5f4-46a1b2b567d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:27.409361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-c1932e6d-a800-40cb-b7ea-8aaa23b37e5f None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:27.410195 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd3fb4-475a-41d8-a5f4-46a1b2b567d1 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:27.410636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-c1932e6d-a800-40cb-b7ea-8aaa23b37e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:27.448644 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 855/1687] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:27.632880 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 833/1688] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:27.643566 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd649d75-ccfb-4fe7-9769-0c7c16383574 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:27.644179 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd649d75-ccfb-4fe7-9769-0c7c16383574 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:27.644614 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd649d75-ccfb-4fe7-9769-0c7c16383574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:27.688217 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-cd649d75-ccfb-4fe7-9769-0c7c16383574 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:27.689863 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-cd649d75-ccfb-4fe7-9769-0c7c16383574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:27.728086 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 856/1689] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:27.731366 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1932e6d-a800-40cb-b7ea-8aaa23b37e5f None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:27.754369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1932e6d-a800-40cb-b7ea-8aaa23b37e5f None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:27.778424 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8a753-8b32-4142-99ac-87c7827e0f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:27.779122 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8a753-8b32-4142-99ac-87c7827e0f3b admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:27.779419 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8a753-8b32-4142-99ac-87c7827e0f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:27.779731 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8a753-8b32-4142-99ac-87c7827e0f3b admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:27.780476 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8a753-8b32-4142-99ac-87c7827e0f3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:27.780793 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8a753-8b32-4142-99ac-87c7827e0f3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:27.790744 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8a753-8b32-4142-99ac-87c7827e0f3b admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:27.824970 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 834/1690] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:26:27.826223 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd649d75-ccfb-4fe7-9769-0c7c16383574 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:27.849288 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd649d75-ccfb-4fe7-9769-0c7c16383574 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:27.859321 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f78bb-3280-4b22-84a4-1d94d7a39735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:27.860197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f78bb-3280-4b22-84a4-1d94d7a39735 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:27.860609 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f78bb-3280-4b22-84a4-1d94d7a39735 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:27.861643 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66f78bb-3280-4b22-84a4-1d94d7a39735 admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:27.862474 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f78bb-3280-4b22-84a4-1d94d7a39735 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:27.864581 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66f78bb-3280-4b22-84a4-1d94d7a39735 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:27.945140 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 857/1691] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:27 2022] POST /identity/v3/projects => generated 363 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:27.949380 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8a753-8b32-4142-99ac-87c7827e0f3b admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:27.969091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8a753-8b32-4142-99ac-87c7827e0f3b admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:28.262255 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f7486-4e05-4ee6-be08-0495c60bcd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:28.263187 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f7486-4e05-4ee6-be08-0495c60bcd03 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:28.263476 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f7486-4e05-4ee6-be08-0495c60bcd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:28.265491 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f7486-4e05-4ee6-be08-0495c60bcd03 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:28.266973 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f7486-4e05-4ee6-be08-0495c60bcd03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:28.278408 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f7486-4e05-4ee6-be08-0495c60bcd03 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:28.384286 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 835/1692] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:27 2022] POST /identity/v3/users => generated 282 bytes in 435 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:28.388772 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f78bb-3280-4b22-84a4-1d94d7a39735 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:28.407947 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66f78bb-3280-4b22-84a4-1d94d7a39735 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:28.450207 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f7486-4e05-4ee6-be08-0495c60bcd03 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:28.452506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-c81f7486-4e05-4ee6-be08-0495c60bcd03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:28.455390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad5c39-82c5-4cc3-8c43-733d59a1b39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:28.462755 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad5c39-82c5-4cc3-8c43-733d59a1b39c admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:28.462975 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad5c39-82c5-4cc3-8c43-733d59a1b39c admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:28.464408 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aad5c39-82c5-4cc3-8c43-733d59a1b39c admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:28.465335 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad5c39-82c5-4cc3-8c43-733d59a1b39c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:28.467089 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aad5c39-82c5-4cc3-8c43-733d59a1b39c admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:28.480586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f7486-4e05-4ee6-be08-0495c60bcd03 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:28.496837 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653eb1ae-ceac-4212-8fc3-8f7205eb4da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:28.497978 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653eb1ae-ceac-4212-8fc3-8f7205eb4da9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:28.498265 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653eb1ae-ceac-4212-8fc3-8f7205eb4da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:28.498545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653eb1ae-ceac-4212-8fc3-8f7205eb4da9 admin admin] PATH_INFO: `/v3/users/1277a96fba804b02a07af82beeaaedac` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:28.499990 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 858/1693] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:28.505504 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653eb1ae-ceac-4212-8fc3-8f7205eb4da9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1277a96fba804b02a07af82beeaaedac)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:28.506579 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: WARNING py.warnings [None req-653eb1ae-ceac-4212-8fc3-8f7205eb4da9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:26:28.506579 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: warnings.warn(msg) Jun 16 00:26:28.506579 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: Jun 16 00:26:28.515380 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653eb1ae-ceac-4212-8fc3-8f7205eb4da9 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:28.516312 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad5c39-82c5-4cc3-8c43-733d59a1b39c admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:28.547417 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aad5c39-82c5-4cc3-8c43-733d59a1b39c admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:28.566287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba2032-91ef-4385-86d9-20c0fa657cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:28.567104 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba2032-91ef-4385-86d9-20c0fa657cef admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:28.567642 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba2032-91ef-4385-86d9-20c0fa657cef admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:28.568529 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fba2032-91ef-4385-86d9-20c0fa657cef admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:28.570987 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba2032-91ef-4385-86d9-20c0fa657cef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:28.573654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fba2032-91ef-4385-86d9-20c0fa657cef admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:28.624710 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 859/1694] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:28.628706 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba2032-91ef-4385-86d9-20c0fa657cef admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:28.702787 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fba2032-91ef-4385-86d9-20c0fa657cef admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:28.720125 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540c8785-27f4-4803-a7e3-2dc8b1c59711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:28.725098 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c8785-27f4-4803-a7e3-2dc8b1c59711 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:28.731180 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c8785-27f4-4803-a7e3-2dc8b1c59711 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:28.731627 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540c8785-27f4-4803-a7e3-2dc8b1c59711 admin admin] PATH_INFO: `/v3/projects/ac47f23676824871ba0cdefa7f6c9cfd/users/d5c369a70e3945caa83c57a3ece72c6d/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:28.789245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c8785-27f4-4803-a7e3-2dc8b1c59711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac47f23676824871ba0cdefa7f6c9cfd, user_id=d5c369a70e3945caa83c57a3ece72c6d, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:28.806267 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540c8785-27f4-4803-a7e3-2dc8b1c59711 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:28.834710 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-653eb1ae-ceac-4212-8fc3-8f7205eb4da9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1277a96fba804b02a07af82beeaaedac'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:28.842921 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 860/1695] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:28 2022] PUT /identity/v3/projects/ac47f23676824871ba0cdefa7f6c9cfd/users/d5c369a70e3945caa83c57a3ece72c6d/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:28.850657 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:28.863382 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbe95f-44d2-4b47-be44-35f0435b7bf4 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:28.866411 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbe95f-44d2-4b47-be44-35f0435b7bf4 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:28.867314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-653eb1ae-ceac-4212-8fc3-8f7205eb4da9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1277a96fba804b02a07af82beeaaedac'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:28.868197 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-653eb1ae-ceac-4212-8fc3-8f7205eb4da9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1277a96fba804b02a07af82beeaaedac'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:28.873279 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfbe95f-44d2-4b47-be44-35f0435b7bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:28.920727 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-653eb1ae-ceac-4212-8fc3-8f7205eb4da9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1277a96fba804b02a07af82beeaaedac'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:28.921727 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-653eb1ae-ceac-4212-8fc3-8f7205eb4da9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1277a96fba804b02a07af82beeaaedac'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:28.950320 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-6bfbe95f-44d2-4b47-be44-35f0435b7bf4 None None] MFA Rules not processed for user `d5c369a70e3945caa83c57a3ece72c6d`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:28.951670 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-6bfbe95f-44d2-4b47-be44-35f0435b7bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:28.968242 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 836/1696] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:28 2022] DELETE /identity/v3/users/1277a96fba804b02a07af82beeaaedac => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:28.970926 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac928a-43ba-4501-9ebc-79d067a90aca None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:28.971376 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac928a-43ba-4501-9ebc-79d067a90aca None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:28.971862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac928a-43ba-4501-9ebc-79d067a90aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:29.025325 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-b5ac928a-43ba-4501-9ebc-79d067a90aca None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:29.031349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-b5ac928a-43ba-4501-9ebc-79d067a90aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:29.154767 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 861/1697] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:28 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:29.158891 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbe95f-44d2-4b47-be44-35f0435b7bf4 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:29.161184 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-6bfbe95f-44d2-4b47-be44-35f0435b7bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:29.208148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 837/1698] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:29.250407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:29.296993 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfbe95f-44d2-4b47-be44-35f0435b7bf4 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:29.306778 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589fa1b-6efb-4ab0-9cce-17fc150b1ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:29.307787 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589fa1b-6efb-4ab0-9cce-17fc150b1ac2 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:29.308212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589fa1b-6efb-4ab0-9cce-17fc150b1ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:29.308657 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589fa1b-6efb-4ab0-9cce-17fc150b1ac2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:29.309866 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589fa1b-6efb-4ab0-9cce-17fc150b1ac2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:29.312074 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c589fa1b-6efb-4ab0-9cce-17fc150b1ac2 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:29.353382 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 862/1699] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:29 2022] POST /identity/v3/projects => generated 365 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:29.357906 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac928a-43ba-4501-9ebc-79d067a90aca None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:29.373928 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac928a-43ba-4501-9ebc-79d067a90aca None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:29.500193 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a535bd3-44d9-440c-bebc-26789cab8b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:29.501479 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a535bd3-44d9-440c-bebc-26789cab8b2b admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:29.502626 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a535bd3-44d9-440c-bebc-26789cab8b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:29.502939 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a535bd3-44d9-440c-bebc-26789cab8b2b admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:29.503661 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a535bd3-44d9-440c-bebc-26789cab8b2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:29.505830 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a535bd3-44d9-440c-bebc-26789cab8b2b admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:29.554517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 838/1700] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:29 2022] POST /identity/v3/users => generated 289 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:26:29.558433 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589fa1b-6efb-4ab0-9cce-17fc150b1ac2 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:29.570880 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589fa1b-6efb-4ab0-9cce-17fc150b1ac2 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:29.586730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fb27f-a702-4d1d-a2df-ed633ea478ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:29.587698 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fb27f-a702-4d1d-a2df-ed633ea478ab admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:29.588139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fb27f-a702-4d1d-a2df-ed633ea478ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:29.588636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090fb27f-a702-4d1d-a2df-ed633ea478ab admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:29.589592 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090fb27f-a702-4d1d-a2df-ed633ea478ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:29.593253 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090fb27f-a702-4d1d-a2df-ed633ea478ab admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:29.634350 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 863/1701] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:26:29.638793 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a535bd3-44d9-440c-bebc-26789cab8b2b admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:29.656146 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a535bd3-44d9-440c-bebc-26789cab8b2b admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:29.665019 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7d098-9443-4dd9-987f-16f5225e3e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:29.665975 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7d098-9443-4dd9-987f-16f5225e3e94 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:29.666203 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7d098-9443-4dd9-987f-16f5225e3e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:29.666489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc7d098-9443-4dd9-987f-16f5225e3e94 admin admin] PATH_INFO: `/v3/projects/7fdc687a9e3a40da93740140682d538d/users/15ddd3947a3e4d149865cb11c1c1cd2f/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:29.682381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fb27f-a702-4d1d-a2df-ed633ea478ab admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:29.684425 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-090fb27f-a702-4d1d-a2df-ed633ea478ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:29.745799 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7d098-9443-4dd9-987f-16f5225e3e94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fdc687a9e3a40da93740140682d538d, user_id=15ddd3947a3e4d149865cb11c1c1cd2f, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:29.759886 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc7d098-9443-4dd9-987f-16f5225e3e94 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:29.805039 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 839/1702] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:29 2022] PUT /identity/v3/projects/7fdc687a9e3a40da93740140682d538d/users/15ddd3947a3e4d149865cb11c1c1cd2f/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:29.809321 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7d098-9443-4dd9-987f-16f5225e3e94 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:29.948661 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090fb27f-a702-4d1d-a2df-ed633ea478ab admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:29.982580 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:30.150943 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc7d098-9443-4dd9-987f-16f5225e3e94 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:30.167976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f2467-6b92-4acd-b705-90e98be5534d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:30.168702 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f2467-6b92-4acd-b705-90e98be5534d admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:30.169158 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f2467-6b92-4acd-b705-90e98be5534d admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:30.169718 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f2467-6b92-4acd-b705-90e98be5534d admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:30.177148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f2467-6b92-4acd-b705-90e98be5534d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:30.182264 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f2467-6b92-4acd-b705-90e98be5534d admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:30.204402 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 840/1703] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:29 2022] GET /identity/v3/roles => generated 1420 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:30.205398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f2467-6b92-4acd-b705-90e98be5534d admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:30.242395 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f2467-6b92-4acd-b705-90e98be5534d admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:30.259754 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab892a5-99fa-4ffa-9d81-fe19a27beeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:30.260898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab892a5-99fa-4ffa-9d81-fe19a27beeeb admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:30.261475 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab892a5-99fa-4ffa-9d81-fe19a27beeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:30.261769 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab892a5-99fa-4ffa-9d81-fe19a27beeeb admin admin] PATH_INFO: `/v3/projects/7fdc687a9e3a40da93740140682d538d/users/15ddd3947a3e4d149865cb11c1c1cd2f/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:30.277473 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab892a5-99fa-4ffa-9d81-fe19a27beeeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fdc687a9e3a40da93740140682d538d, user_id=15ddd3947a3e4d149865cb11c1c1cd2f, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:30.290010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08dbe5-cd1f-4f78-a568-1ebff8359563 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:30.295932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab892a5-99fa-4ffa-9d81-fe19a27beeeb admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:30.297828 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08dbe5-cd1f-4f78-a568-1ebff8359563 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:30.301600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08dbe5-cd1f-4f78-a568-1ebff8359563 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:30.307116 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08dbe5-cd1f-4f78-a568-1ebff8359563 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:30.333328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 841/1704] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:30 2022] PUT /identity/v3/projects/7fdc687a9e3a40da93740140682d538d/users/15ddd3947a3e4d149865cb11c1c1cd2f/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:30.335053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eaaa2b-01ab-407d-aa4f-dfe578dac9a1 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:30.335347 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eaaa2b-01ab-407d-aa4f-dfe578dac9a1 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:30.335647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eaaa2b-01ab-407d-aa4f-dfe578dac9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:30.371228 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08dbe5-cd1f-4f78-a568-1ebff8359563 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:30.376123 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be08dbe5-cd1f-4f78-a568-1ebff8359563 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:30.411662 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-88eaaa2b-01ab-407d-aa4f-dfe578dac9a1 None None] MFA Rules not processed for user `15ddd3947a3e4d149865cb11c1c1cd2f`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:30.412928 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-88eaaa2b-01ab-407d-aa4f-dfe578dac9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:30.413600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 864/1705] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:30.416908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08dbe5-cd1f-4f78-a568-1ebff8359563 service neutron] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:30.420815 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-be08dbe5-cd1f-4f78-a568-1ebff8359563 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:30.445394 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08dbe5-cd1f-4f78-a568-1ebff8359563 service neutron] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:30.563098 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec0247-0ee9-441f-8604-f5081e5e651d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:30.564900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec0247-0ee9-441f-8604-f5081e5e651d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:30.565186 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec0247-0ee9-441f-8604-f5081e5e651d admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:30.565466 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec0247-0ee9-441f-8604-f5081e5e651d admin admin] PATH_INFO: `/v3/users/c9f9551112824c4d937502ed6ae59620` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:30.567446 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec0247-0ee9-441f-8604-f5081e5e651d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9f9551112824c4d937502ed6ae59620)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:30.569512 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bec0247-0ee9-441f-8604-f5081e5e651d admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:30.584267 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:30.707785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 842/1706] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:30 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:30.709744 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cbb0e-4b15-4d03-970d-e56291badf98 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:30.710408 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cbb0e-4b15-4d03-970d-e56291badf98 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:30.711009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8cbb0e-4b15-4d03-970d-e56291badf98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:30.754941 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2bec0247-0ee9-441f-8604-f5081e5e651d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9f9551112824c4d937502ed6ae59620'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:30.774364 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2bec0247-0ee9-441f-8604-f5081e5e651d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9f9551112824c4d937502ed6ae59620'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:30.777262 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2bec0247-0ee9-441f-8604-f5081e5e651d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9f9551112824c4d937502ed6ae59620'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:30.778964 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2bec0247-0ee9-441f-8604-f5081e5e651d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9f9551112824c4d937502ed6ae59620'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:30.817188 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2bec0247-0ee9-441f-8604-f5081e5e651d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9f9551112824c4d937502ed6ae59620'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:30.819436 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-cd8cbb0e-4b15-4d03-970d-e56291badf98 None None] MFA Rules not processed for user `a6c145cb49f54dd88307f416ff1bb92b`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:30.823234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-cd8cbb0e-4b15-4d03-970d-e56291badf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:30.859544 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 865/1707] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:30 2022] DELETE /identity/v3/users/c9f9551112824c4d937502ed6ae59620 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:30.862796 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec0247-0ee9-441f-8604-f5081e5e651d admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:30.867206 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-2bec0247-0ee9-441f-8604-f5081e5e651d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:31.019166 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 843/1708] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:31.020607 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1ca15-8084-401c-82cc-d195e536551e None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:31.020906 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1ca15-8084-401c-82cc-d195e536551e None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:31.021188 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1ca15-8084-401c-82cc-d195e536551e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:31.044748 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bec0247-0ee9-441f-8604-f5081e5e651d admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:31.058491 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c457d2c-33c2-4f51-95d5-71bd47df2db8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:31.059559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c457d2c-33c2-4f51-95d5-71bd47df2db8 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:31.060083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c457d2c-33c2-4f51-95d5-71bd47df2db8 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:31.060553 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c457d2c-33c2-4f51-95d5-71bd47df2db8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:31.064898 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-1c457d2c-33c2-4f51-95d5-71bd47df2db8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:31.068841 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-cbc1ca15-8084-401c-82cc-d195e536551e None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:31.070017 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-cbc1ca15-8084-401c-82cc-d195e536551e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:31.184768 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:31.229874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 844/1709] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:31.238336 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c457d2c-33c2-4f51-95d5-71bd47df2db8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:31.240051 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c457d2c-33c2-4f51-95d5-71bd47df2db8 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:31.285213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1ca15-8084-401c-82cc-d195e536551e None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:31.286818 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-cbc1ca15-8084-401c-82cc-d195e536551e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:31.295163 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 866/1710] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:30 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:31.430343 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1ca15-8084-401c-82cc-d195e536551e None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:31.441903 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6317ac8c-707e-428d-9a64-080eb9422f11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:31.442626 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317ac8c-707e-428d-9a64-080eb9422f11 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:31.442887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317ac8c-707e-428d-9a64-080eb9422f11 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:31.443224 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6317ac8c-707e-428d-9a64-080eb9422f11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:31.477825 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317ac8c-707e-428d-9a64-080eb9422f11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:31.479051 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6317ac8c-707e-428d-9a64-080eb9422f11 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:31.531180 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 845/1711] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:32.609361 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c457d2c-33c2-4f51-95d5-71bd47df2db8 service cinder] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:32.611621 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-1c457d2c-33c2-4f51-95d5-71bd47df2db8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:32.642729 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c457d2c-33c2-4f51-95d5-71bd47df2db8 service cinder] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:32.659114 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8db35-f155-48e7-b23f-c96aef17ef66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:32.661353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8db35-f155-48e7-b23f-c96aef17ef66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:32.661923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8db35-f155-48e7-b23f-c96aef17ef66 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:32.662212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8db35-f155-48e7-b23f-c96aef17ef66 admin admin] PATH_INFO: `/v3/users/d5c369a70e3945caa83c57a3ece72c6d` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:32.668137 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8db35-f155-48e7-b23f-c96aef17ef66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5c369a70e3945caa83c57a3ece72c6d)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:32.674214 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8db35-f155-48e7-b23f-c96aef17ef66 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:32.848387 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:32.887957 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-ccb8db35-f155-48e7-b23f-c96aef17ef66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5c369a70e3945caa83c57a3ece72c6d'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:32.904170 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-ccb8db35-f155-48e7-b23f-c96aef17ef66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5c369a70e3945caa83c57a3ece72c6d'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:32.905096 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-ccb8db35-f155-48e7-b23f-c96aef17ef66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5c369a70e3945caa83c57a3ece72c6d'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:32.905869 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-ccb8db35-f155-48e7-b23f-c96aef17ef66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5c369a70e3945caa83c57a3ece72c6d'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:32.976071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-ccb8db35-f155-48e7-b23f-c96aef17ef66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5c369a70e3945caa83c57a3ece72c6d'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:33.018821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 867/1712] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:32 2022] DELETE /identity/v3/users/d5c369a70e3945caa83c57a3ece72c6d => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:33.020617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5da9b-2549-43bf-a13e-7a0701ccad61 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:33.021132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5da9b-2549-43bf-a13e-7a0701ccad61 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:33.021132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c5da9b-2549-43bf-a13e-7a0701ccad61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:33.051605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-c6c5da9b-2549-43bf-a13e-7a0701ccad61 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:33.052889 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-c6c5da9b-2549-43bf-a13e-7a0701ccad61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:33.355116 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 846/1713] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:33.452327 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8db35-f155-48e7-b23f-c96aef17ef66 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:33.454921 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-ccb8db35-f155-48e7-b23f-c96aef17ef66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:33.653504 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8db35-f155-48e7-b23f-c96aef17ef66 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:33.664483 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b5d40f-4c68-4053-8ded-62ac73f873f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:33.665237 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5d40f-4c68-4053-8ded-62ac73f873f3 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:33.665578 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5d40f-4c68-4053-8ded-62ac73f873f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:33.665803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b5d40f-4c68-4053-8ded-62ac73f873f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:33.677019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5d40f-4c68-4053-8ded-62ac73f873f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:33.678480 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b5d40f-4c68-4053-8ded-62ac73f873f3 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:33.689444 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 868/1714] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:33.812682 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f840b-a98a-41a0-a25d-2b45cf21e215 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:33.812980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f840b-a98a-41a0-a25d-2b45cf21e215 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:33.813251 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83f840b-a98a-41a0-a25d-2b45cf21e215 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:33.815200 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 847/1715] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 16 00:26:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:26:34.078754 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264d0a0-8b80-4b86-8169-7ddf045d46fb None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:34.079116 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264d0a0-8b80-4b86-8169-7ddf045d46fb None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:34.080230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b264d0a0-8b80-4b86-8169-7ddf045d46fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:34.118520 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f840b-a98a-41a0-a25d-2b45cf21e215 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:34.120784 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d83f840b-a98a-41a0-a25d-2b45cf21e215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:34.133817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-b264d0a0-8b80-4b86-8169-7ddf045d46fb None None] MFA Rules not processed for user `40432493f16b4df681daf5a1af87832a`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:34.135052 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-b264d0a0-8b80-4b86-8169-7ddf045d46fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:34.168552 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83f840b-a98a-41a0-a25d-2b45cf21e215 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:34.184670 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e6e176-69f8-419e-8945-f755e3f426c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:34.185566 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6e176-69f8-419e-8945-f755e3f426c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:34.185850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6e176-69f8-419e-8945-f755e3f426c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:34.186701 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e6e176-69f8-419e-8945-f755e3f426c3 admin admin] PATH_INFO: `/v3/projects/328074cc79a04a7fadb45daeadc122d9` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:34.195644 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6e176-69f8-419e-8945-f755e3f426c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=328074cc79a04a7fadb45daeadc122d9)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:34.212065 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e6e176-69f8-419e-8945-f755e3f426c3 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:34.363894 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-13e6e176-69f8-419e-8945-f755e3f426c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '328074cc79a04a7fadb45daeadc122d9', 'request_id': 'req-13e6e176-69f8-419e-8945-f755e3f426c3'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:34.375294 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-13e6e176-69f8-419e-8945-f755e3f426c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '328074cc79a04a7fadb45daeadc122d9', 'request_id': 'req-13e6e176-69f8-419e-8945-f755e3f426c3'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:34.387637 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-13e6e176-69f8-419e-8945-f755e3f426c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '328074cc79a04a7fadb45daeadc122d9', 'request_id': 'req-13e6e176-69f8-419e-8945-f755e3f426c3'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:34.413933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-13e6e176-69f8-419e-8945-f755e3f426c3 admin admin] The token cache is being invalidate because project 328074cc79a04a7fadb45daeadc122d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:34.414302 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-13e6e176-69f8-419e-8945-f755e3f426c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:34.415788 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-13e6e176-69f8-419e-8945-f755e3f426c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:34.418363 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 869/1716] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 16 00:26:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:34.420331 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 848/1717] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:34 2022] DELETE /identity/v3/projects/328074cc79a04a7fadb45daeadc122d9 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:26:34.432395 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233c886-62d5-4047-abfd-50c9343e0852 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:34.433056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233c886-62d5-4047-abfd-50c9343e0852 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:34.433056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233c886-62d5-4047-abfd-50c9343e0852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:34.484887 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-1233c886-62d5-4047-abfd-50c9343e0852 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:34.486680 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-1233c886-62d5-4047-abfd-50c9343e0852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:34.584326 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:34.625692 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3615c-d7a8-4b40-a4bc-75129e83ebce None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:34.626039 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3615c-d7a8-4b40-a4bc-75129e83ebce None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:34.626451 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e3615c-d7a8-4b40-a4bc-75129e83ebce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:34.628346 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 870/1718] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:34.672100 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-e7e3615c-d7a8-4b40-a4bc-75129e83ebce None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:34.673260 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e7e3615c-d7a8-4b40-a4bc-75129e83ebce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:34.703829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233c886-62d5-4047-abfd-50c9343e0852 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:34.705057 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 849/1719] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:34.714325 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4ea19-d550-48f9-bea4-3f005ca75d4f None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:34.714695 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4ea19-d550-48f9-bea4-3f005ca75d4f None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:34.714875 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea4ea19-d550-48f9-bea4-3f005ca75d4f None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:34.716817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 850/1720] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 16 00:26:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:26:34.721825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233c886-62d5-4047-abfd-50c9343e0852 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:34.743544 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9ae83b-f499-4fd4-8ded-738f2b225d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:34.744265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ae83b-f499-4fd4-8ded-738f2b225d47 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:34.744538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ae83b-f499-4fd4-8ded-738f2b225d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:34.744821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9ae83b-f499-4fd4-8ded-738f2b225d47 admin admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:34.745556 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ae83b-f499-4fd4-8ded-738f2b225d47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:34.745864 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ae83b-f499-4fd4-8ded-738f2b225d47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:34.747601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9ae83b-f499-4fd4-8ded-738f2b225d47 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:34.787319 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4ea19-d550-48f9-bea4-3f005ca75d4f None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:34.787783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 871/1721] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:26:34.815249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea4ea19-d550-48f9-bea4-3f005ca75d4f None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:34.830342 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9ed84-59aa-4455-bfe8-c7b5f351a784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:34.831029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9ed84-59aa-4455-bfe8-c7b5f351a784 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:34.831324 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9ed84-59aa-4455-bfe8-c7b5f351a784 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:34.831650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d9ed84-59aa-4455-bfe8-c7b5f351a784 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:34.832309 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9ed84-59aa-4455-bfe8-c7b5f351a784 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:34.834878 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d9ed84-59aa-4455-bfe8-c7b5f351a784 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:34.848240 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652368bb-21c8-4a33-b272-72ec18379460 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:34.848581 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652368bb-21c8-4a33-b272-72ec18379460 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:34.848798 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652368bb-21c8-4a33-b272-72ec18379460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:34.852218 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:34.898733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-652368bb-21c8-4a33-b272-72ec18379460 None None] MFA Rules not processed for user `40432493f16b4df681daf5a1af87832a`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:34.900057 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-652368bb-21c8-4a33-b272-72ec18379460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:34.915754 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 851/1722] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:34 2022] POST /identity/v3/projects => generated 357 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:34.916578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9ed84-59aa-4455-bfe8-c7b5f351a784 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:35.147979 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d9ed84-59aa-4455-bfe8-c7b5f351a784 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:35.156755 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 872/1723] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 16 00:26:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:35.165542 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ccaac-152c-413a-842e-392227137742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:35.166444 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ccaac-152c-413a-842e-392227137742 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:35.166893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ccaac-152c-413a-842e-392227137742 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:35.167323 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7ccaac-152c-413a-842e-392227137742 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:35.168242 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ccaac-152c-413a-842e-392227137742 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:35.170360 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7ccaac-152c-413a-842e-392227137742 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:35.238432 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 852/1724] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:34 2022] POST /identity/v3/users => generated 279 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:35.242578 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652368bb-21c8-4a33-b272-72ec18379460 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:35.254228 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652368bb-21c8-4a33-b272-72ec18379460 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:35.272302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c26fc9-c262-4f1b-ad2c-406acb149885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:35.273261 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c26fc9-c262-4f1b-ad2c-406acb149885 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:35.273834 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c26fc9-c262-4f1b-ad2c-406acb149885 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:35.274245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c26fc9-c262-4f1b-ad2c-406acb149885 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:35.275117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c26fc9-c262-4f1b-ad2c-406acb149885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:35.276891 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c26fc9-c262-4f1b-ad2c-406acb149885 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:35.302521 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 873/1725] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:35.304091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ccaac-152c-413a-842e-392227137742 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:35.321606 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7ccaac-152c-413a-842e-392227137742 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:35.361136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64963ae-177f-43dc-a760-da793a04cccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:35.364216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64963ae-177f-43dc-a760-da793a04cccf admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:35.364573 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64963ae-177f-43dc-a760-da793a04cccf admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:35.364860 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64963ae-177f-43dc-a760-da793a04cccf admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:35.365799 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64963ae-177f-43dc-a760-da793a04cccf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:35.376606 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64963ae-177f-43dc-a760-da793a04cccf admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:35.445231 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c26fc9-c262-4f1b-ad2c-406acb149885 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:35.463700 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 853/1726] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:35 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:35.480317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c26fc9-c262-4f1b-ad2c-406acb149885 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:35.509601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053b938-6181-40cc-a85a-4d9b88796e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:35.510068 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053b938-6181-40cc-a85a-4d9b88796e56 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:35.510322 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053b938-6181-40cc-a85a-4d9b88796e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:35.510620 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b053b938-6181-40cc-a85a-4d9b88796e56 admin admin] PATH_INFO: `/v3/projects/be2c6085edee42378aec2135f9868e4a/users/be49b676d10c46b2a8fd36123e5fef92/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:35.572661 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053b938-6181-40cc-a85a-4d9b88796e56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2c6085edee42378aec2135f9868e4a, user_id=be49b676d10c46b2a8fd36123e5fef92, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:35.575396 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b053b938-6181-40cc-a85a-4d9b88796e56 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:35.608587 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 874/1727] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:35 2022] PUT /identity/v3/projects/be2c6085edee42378aec2135f9868e4a/users/be49b676d10c46b2a8fd36123e5fef92/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:35.618008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cf591-cffa-45c4-b904-4a04e7a313c9 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:35.618748 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cf591-cffa-45c4-b904-4a04e7a313c9 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:35.619285 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cf591-cffa-45c4-b904-4a04e7a313c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:35.739273 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-0e7cf591-cffa-45c4-b904-4a04e7a313c9 None None] MFA Rules not processed for user `be49b676d10c46b2a8fd36123e5fef92`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:35.755359 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-0e7cf591-cffa-45c4-b904-4a04e7a313c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:35.937347 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 854/1728] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:35 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:35.941684 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053b938-6181-40cc-a85a-4d9b88796e56 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:36.038536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cf591-cffa-45c4-b904-4a04e7a313c9 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:36.040281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-0e7cf591-cffa-45c4-b904-4a04e7a313c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:36.175271 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b053b938-6181-40cc-a85a-4d9b88796e56 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:36.226916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d54ef8-5c78-412d-8aba-34f8b9573114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:36.229419 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d54ef8-5c78-412d-8aba-34f8b9573114 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:36.229666 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d54ef8-5c78-412d-8aba-34f8b9573114 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:36.233864 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d54ef8-5c78-412d-8aba-34f8b9573114 admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:36.234789 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d54ef8-5c78-412d-8aba-34f8b9573114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:36.246576 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d54ef8-5c78-412d-8aba-34f8b9573114 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:36.248151 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:36.315373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cf591-cffa-45c4-b904-4a04e7a313c9 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:36.327487 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 875/1729] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:35 2022] POST /identity/v3/projects => generated 355 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:36.331555 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d54ef8-5c78-412d-8aba-34f8b9573114 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:36.333242 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-d7d54ef8-5c78-412d-8aba-34f8b9573114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:36.334699 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c393084-689c-4853-9d2c-703d60b192ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:36.335796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c393084-689c-4853-9d2c-703d60b192ab service nova] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:36.336090 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c393084-689c-4853-9d2c-703d60b192ab service nova] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:36.336459 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c393084-689c-4853-9d2c-703d60b192ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:36.344014 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-2c393084-689c-4853-9d2c-703d60b192ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:36.350004 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:36.362882 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c393084-689c-4853-9d2c-703d60b192ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:36.373022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c393084-689c-4853-9d2c-703d60b192ab service nova] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:36.406066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 855/1730] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:36.410008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c393084-689c-4853-9d2c-703d60b192ab service nova] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:36.412148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-2c393084-689c-4853-9d2c-703d60b192ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:36.443244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c393084-689c-4853-9d2c-703d60b192ab service nova] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:36.450538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d54ef8-5c78-412d-8aba-34f8b9573114 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:36.470388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7b967-4bbb-4972-a2b9-b080e4614275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:36.475041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7b967-4bbb-4972-a2b9-b080e4614275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:36.476314 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7b967-4bbb-4972-a2b9-b080e4614275 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:36.476748 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d7b967-4bbb-4972-a2b9-b080e4614275 admin admin] PATH_INFO: `/v3/projects/ac47f23676824871ba0cdefa7f6c9cfd` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:36.482190 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7b967-4bbb-4972-a2b9-b080e4614275 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac47f23676824871ba0cdefa7f6c9cfd)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:36.486548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: WARNING py.warnings [None req-23d7b967-4bbb-4972-a2b9-b080e4614275 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jun 16 00:26:36.486548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: warnings.warn(msg) Jun 16 00:26:36.486548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: Jun 16 00:26:36.488211 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d7b967-4bbb-4972-a2b9-b080e4614275 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:36.612909 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558bc6b-31ca-47c2-9113-4541f78c34b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:36.613673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558bc6b-31ca-47c2-9113-4541f78c34b2 service nova] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:36.614030 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558bc6b-31ca-47c2-9113-4541f78c34b2 service nova] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:36.614985 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9558bc6b-31ca-47c2-9113-4541f78c34b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:36.629127 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558bc6b-31ca-47c2-9113-4541f78c34b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:36.632989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9558bc6b-31ca-47c2-9113-4541f78c34b2 service nova] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:36.650205 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-23d7b967-4bbb-4972-a2b9-b080e4614275 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac47f23676824871ba0cdefa7f6c9cfd', 'request_id': 'req-23d7b967-4bbb-4972-a2b9-b080e4614275'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:36.657858 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-23d7b967-4bbb-4972-a2b9-b080e4614275 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac47f23676824871ba0cdefa7f6c9cfd', 'request_id': 'req-23d7b967-4bbb-4972-a2b9-b080e4614275'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:36.659040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 856/1731] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:36.660055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558bc6b-31ca-47c2-9113-4541f78c34b2 service nova] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:36.672391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9558bc6b-31ca-47c2-9113-4541f78c34b2 service nova] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:36.675328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-23d7b967-4bbb-4972-a2b9-b080e4614275 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac47f23676824871ba0cdefa7f6c9cfd', 'request_id': 'req-23d7b967-4bbb-4972-a2b9-b080e4614275'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:36.697363 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-23d7b967-4bbb-4972-a2b9-b080e4614275 admin admin] The token cache is being invalidate because project ac47f23676824871ba0cdefa7f6c9cfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:36.697963 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-23d7b967-4bbb-4972-a2b9-b080e4614275 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:36.698720 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-23d7b967-4bbb-4972-a2b9-b080e4614275 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:36.701474 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 876/1732] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:36 2022] DELETE /identity/v3/projects/ac47f23676824871ba0cdefa7f6c9cfd => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:36.702359 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7b967-4bbb-4972-a2b9-b080e4614275 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:36.704937 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-23d7b967-4bbb-4972-a2b9-b080e4614275 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:36.809248 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011e434-f1cc-486d-baf0-fac475227d20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:36.810476 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011e434-f1cc-486d-baf0-fac475227d20 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:36.810747 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011e434-f1cc-486d-baf0-fac475227d20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:36.811102 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1011e434-f1cc-486d-baf0-fac475227d20 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:36.812008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011e434-f1cc-486d-baf0-fac475227d20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:36.816348 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1011e434-f1cc-486d-baf0-fac475227d20 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:36.840664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d7b967-4bbb-4972-a2b9-b080e4614275 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:36.847912 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6339cc-a420-4428-999d-4a6551bb5a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:36.848929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6339cc-a420-4428-999d-4a6551bb5a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:36.849167 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6339cc-a420-4428-999d-4a6551bb5a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:36.849547 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6339cc-a420-4428-999d-4a6551bb5a78 admin admin] PATH_INFO: `/v3/projects/e6d7259e98d240728cafd2757c98efcc` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:36.855895 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 857/1733] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:36 2022] POST /identity/v3/users => generated 284 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:36.856039 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6339cc-a420-4428-999d-4a6551bb5a78 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6d7259e98d240728cafd2757c98efcc)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:36.856118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011e434-f1cc-486d-baf0-fac475227d20 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:36.856118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-1011e434-f1cc-486d-baf0-fac475227d20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:36.856259 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6339cc-a420-4428-999d-4a6551bb5a78 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:36.868622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1011e434-f1cc-486d-baf0-fac475227d20 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:36.873800 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f3889-65e0-43c4-9522-4f42f8668a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:36.874632 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f3889-65e0-43c4-9522-4f42f8668a62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:36.874924 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f3889-65e0-43c4-9522-4f42f8668a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:36.875236 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3f3889-65e0-43c4-9522-4f42f8668a62 admin admin] PATH_INFO: `/v3/users/15ddd3947a3e4d149865cb11c1c1cd2f` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:36.877089 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f3889-65e0-43c4-9522-4f42f8668a62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15ddd3947a3e4d149865cb11c1c1cd2f)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:36.879032 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3f3889-65e0-43c4-9522-4f42f8668a62 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:36.911958 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:36.916902 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0c6339cc-a420-4428-999d-4a6551bb5a78 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6d7259e98d240728cafd2757c98efcc', 'request_id': 'req-0c6339cc-a420-4428-999d-4a6551bb5a78'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:36.925886 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0c6339cc-a420-4428-999d-4a6551bb5a78 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6d7259e98d240728cafd2757c98efcc', 'request_id': 'req-0c6339cc-a420-4428-999d-4a6551bb5a78'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:36.932133 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8b3f3889-65e0-43c4-9522-4f42f8668a62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15ddd3947a3e4d149865cb11c1c1cd2f'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:36.934413 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0c6339cc-a420-4428-999d-4a6551bb5a78 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6d7259e98d240728cafd2757c98efcc', 'request_id': 'req-0c6339cc-a420-4428-999d-4a6551bb5a78'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:36.934890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:36.941782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8b3f3889-65e0-43c4-9522-4f42f8668a62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15ddd3947a3e4d149865cb11c1c1cd2f'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:36.942483 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8b3f3889-65e0-43c4-9522-4f42f8668a62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15ddd3947a3e4d149865cb11c1c1cd2f'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:36.954113 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0c6339cc-a420-4428-999d-4a6551bb5a78 admin admin] The token cache is being invalidate because project e6d7259e98d240728cafd2757c98efcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:36.954615 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0c6339cc-a420-4428-999d-4a6551bb5a78 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:36.955421 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0c6339cc-a420-4428-999d-4a6551bb5a78 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:36.957965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8b3f3889-65e0-43c4-9522-4f42f8668a62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15ddd3947a3e4d149865cb11c1c1cd2f'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:36.961395 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8b3f3889-65e0-43c4-9522-4f42f8668a62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15ddd3947a3e4d149865cb11c1c1cd2f'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:36.961529 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 877/1734] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:36 2022] DELETE /identity/v3/projects/e6d7259e98d240728cafd2757c98efcc => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:36.961529 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8b0f4-6520-4860-bcf9-be29e6a6c290 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:36.961529 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8b0f4-6520-4860-bcf9-be29e6a6c290 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:36.961529 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8b0f4-6520-4860-bcf9-be29e6a6c290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:36.976789 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 858/1735] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:36 2022] DELETE /identity/v3/users/15ddd3947a3e4d149865cb11c1c1cd2f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:36.977758 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f3889-65e0-43c4-9522-4f42f8668a62 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:36.979159 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-8b3f3889-65e0-43c4-9522-4f42f8668a62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:36.979850 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-ace8b0f4-6520-4860-bcf9-be29e6a6c290 None None] MFA Rules not processed for user `f0c5a5705f34440abce48190674a76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:36.981051 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-ace8b0f4-6520-4860-bcf9-be29e6a6c290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:37.082153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 878/1736] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:37.083178 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8b0f4-6520-4860-bcf9-be29e6a6c290 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:37.088343 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-ace8b0f4-6520-4860-bcf9-be29e6a6c290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:37.091091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3f3889-65e0-43c4-9522-4f42f8668a62 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:37.099196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbd434-0c98-444d-a588-07960cdd5dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:37.100883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbd434-0c98-444d-a588-07960cdd5dcb admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:37.101238 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbd434-0c98-444d-a588-07960cdd5dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:37.101685 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedbd434-0c98-444d-a588-07960cdd5dcb admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:37.102577 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedbd434-0c98-444d-a588-07960cdd5dcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:37.104422 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8b0f4-6520-4860-bcf9-be29e6a6c290 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:37.104541 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedbd434-0c98-444d-a588-07960cdd5dcb admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:37.110190 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7dd3b5-1af9-4f3e-bfdc-7cdb30277635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:37.111086 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dd3b5-1af9-4f3e-bfdc-7cdb30277635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:37.111373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dd3b5-1af9-4f3e-bfdc-7cdb30277635 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:37.111823 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7dd3b5-1af9-4f3e-bfdc-7cdb30277635 admin admin] PATH_INFO: `/v3/users/327c62079f03487188ec6b7ab7ed05d4` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:37.113083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7dd3b5-1af9-4f3e-bfdc-7cdb30277635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=327c62079f03487188ec6b7ab7ed05d4)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:37.115022 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7dd3b5-1af9-4f3e-bfdc-7cdb30277635 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:37.122243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 859/1737] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:36 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:37.127110 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbd434-0c98-444d-a588-07960cdd5dcb admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:37.147325 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedbd434-0c98-444d-a588-07960cdd5dcb admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:37.154941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41804107-0863-4fb3-bf4a-771d08ef6b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:37.156036 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41804107-0863-4fb3-bf4a-771d08ef6b91 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:37.156324 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41804107-0863-4fb3-bf4a-771d08ef6b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:37.156605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41804107-0863-4fb3-bf4a-771d08ef6b91 admin admin] PATH_INFO: `/v3/projects/53276fa1749d469b8c76cb5b6d4d521f/users/9b3ec374a241412884985735bd6187fb/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:37.176129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0c7dd3b5-1af9-4f3e-bfdc-7cdb30277635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '327c62079f03487188ec6b7ab7ed05d4'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:37.186554 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0c7dd3b5-1af9-4f3e-bfdc-7cdb30277635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '327c62079f03487188ec6b7ab7ed05d4'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:37.187476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0c7dd3b5-1af9-4f3e-bfdc-7cdb30277635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '327c62079f03487188ec6b7ab7ed05d4'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:37.189036 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41804107-0863-4fb3-bf4a-771d08ef6b91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53276fa1749d469b8c76cb5b6d4d521f, user_id=9b3ec374a241412884985735bd6187fb, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:37.189674 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0c7dd3b5-1af9-4f3e-bfdc-7cdb30277635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '327c62079f03487188ec6b7ab7ed05d4'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:37.194401 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41804107-0863-4fb3-bf4a-771d08ef6b91 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:37.208699 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0c7dd3b5-1af9-4f3e-bfdc-7cdb30277635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '327c62079f03487188ec6b7ab7ed05d4'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:37.211761 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 860/1738] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:37 2022] PUT /identity/v3/projects/53276fa1749d469b8c76cb5b6d4d521f/users/9b3ec374a241412884985735bd6187fb/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:37.215546 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41804107-0863-4fb3-bf4a-771d08ef6b91 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:37.217278 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-41804107-0863-4fb3-bf4a-771d08ef6b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:37.227664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 879/1739] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:37 2022] DELETE /identity/v3/users/327c62079f03487188ec6b7ab7ed05d4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:37.308058 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41804107-0863-4fb3-bf4a-771d08ef6b91 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:37.395025 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:37.426669 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8d32c-03a4-429a-bc7b-54d1d46c5c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:37.427518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8d32c-03a4-429a-bc7b-54d1d46c5c2a admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:37.427851 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8d32c-03a4-429a-bc7b-54d1d46c5c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:37.428136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8d32c-03a4-429a-bc7b-54d1d46c5c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:37.428986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8d32c-03a4-429a-bc7b-54d1d46c5c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:37.430495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8d32c-03a4-429a-bc7b-54d1d46c5c2a admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:37.469649 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 861/1740] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:37 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:37.470551 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7dd3b5-1af9-4f3e-bfdc-7cdb30277635 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:37.487202 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7dd3b5-1af9-4f3e-bfdc-7cdb30277635 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:37.510589 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6370e5-34f9-4cce-b897-23c15379a4ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:37.511703 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6370e5-34f9-4cce-b897-23c15379a4ee admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:37.511997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6370e5-34f9-4cce-b897-23c15379a4ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:37.512289 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6370e5-34f9-4cce-b897-23c15379a4ee admin admin] PATH_INFO: `/v3/projects/53276fa1749d469b8c76cb5b6d4d521f/users/9b3ec374a241412884985735bd6187fb/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:37.517218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6370e5-34f9-4cce-b897-23c15379a4ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=53276fa1749d469b8c76cb5b6d4d521f, user_id=9b3ec374a241412884985735bd6187fb, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:37.524639 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6370e5-34f9-4cce-b897-23c15379a4ee admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:37.552394 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 880/1741] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:37 2022] PUT /identity/v3/projects/53276fa1749d469b8c76cb5b6d4d521f/users/9b3ec374a241412884985735bd6187fb/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:26:37.569562 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d32923-84ec-4692-b45d-4c4f7cb5a595 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:37.569859 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d32923-84ec-4692-b45d-4c4f7cb5a595 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:37.570143 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d32923-84ec-4692-b45d-4c4f7cb5a595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:37.646542 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-a1d32923-84ec-4692-b45d-4c4f7cb5a595 None None] MFA Rules not processed for user `9b3ec374a241412884985735bd6187fb`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:37.648997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a1d32923-84ec-4692-b45d-4c4f7cb5a595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:37.818153 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 862/1742] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:37 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:37.840392 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6370e5-34f9-4cce-b897-23c15379a4ee admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:37.850598 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-3f6370e5-34f9-4cce-b897-23c15379a4ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:37.906111 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d32923-84ec-4692-b45d-4c4f7cb5a595 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:37.909091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a1d32923-84ec-4692-b45d-4c4f7cb5a595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:37.962126 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:37.999037 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6370e5-34f9-4cce-b897-23c15379a4ee admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:38.009807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f071c8-f820-4b8d-9817-244cbd4ac2f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:38.012291 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f071c8-f820-4b8d-9817-244cbd4ac2f7 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:38.012624 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f071c8-f820-4b8d-9817-244cbd4ac2f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:38.012891 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f071c8-f820-4b8d-9817-244cbd4ac2f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:38.033526 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f071c8-f820-4b8d-9817-244cbd4ac2f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:38.037071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f071c8-f820-4b8d-9817-244cbd4ac2f7 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:38.062656 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 881/1743] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:37 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:38.069016 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d32923-84ec-4692-b45d-4c4f7cb5a595 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:38.074582 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee913be-db87-496c-8abf-729390fd3827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:38.075720 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee913be-db87-496c-8abf-729390fd3827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:38.076007 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee913be-db87-496c-8abf-729390fd3827 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:38.076283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee913be-db87-496c-8abf-729390fd3827 admin admin] PATH_INFO: `/v3/projects/7fdc687a9e3a40da93740140682d538d` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:38.077868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee913be-db87-496c-8abf-729390fd3827 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fdc687a9e3a40da93740140682d538d)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:38.079970 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee913be-db87-496c-8abf-729390fd3827 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:38.199687 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-cee913be-db87-496c-8abf-729390fd3827 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fdc687a9e3a40da93740140682d538d', 'request_id': 'req-cee913be-db87-496c-8abf-729390fd3827'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:38.233678 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-cee913be-db87-496c-8abf-729390fd3827 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fdc687a9e3a40da93740140682d538d', 'request_id': 'req-cee913be-db87-496c-8abf-729390fd3827'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:38.263797 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f071c8-f820-4b8d-9817-244cbd4ac2f7 service cinder] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:38.264993 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-cee913be-db87-496c-8abf-729390fd3827 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fdc687a9e3a40da93740140682d538d', 'request_id': 'req-cee913be-db87-496c-8abf-729390fd3827'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:38.265737 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-f8f071c8-f820-4b8d-9817-244cbd4ac2f7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:38.291193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f071c8-f820-4b8d-9817-244cbd4ac2f7 service cinder] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:38.292989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:38.312208 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-cee913be-db87-496c-8abf-729390fd3827 admin admin] The token cache is being invalidate because project 7fdc687a9e3a40da93740140682d538d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:38.316740 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-cee913be-db87-496c-8abf-729390fd3827 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:38.319779 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-cee913be-db87-496c-8abf-729390fd3827 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:38.321921 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 863/1744] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:37 2022] DELETE /identity/v3/projects/7fdc687a9e3a40da93740140682d538d => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:38.325072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee913be-db87-496c-8abf-729390fd3827 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:38.330985 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-cee913be-db87-496c-8abf-729390fd3827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:38.394449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce20940c-5692-43e0-9cbf-b50dc34ba5a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:38.395439 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20940c-5692-43e0-9cbf-b50dc34ba5a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:38.395829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20940c-5692-43e0-9cbf-b50dc34ba5a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:38.396712 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce20940c-5692-43e0-9cbf-b50dc34ba5a3 admin admin] PATH_INFO: `/v3/projects/235ff990c75b4f1ea3d93ee6831242e2` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:38.397962 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20940c-5692-43e0-9cbf-b50dc34ba5a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=235ff990c75b4f1ea3d93ee6831242e2)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:38.399970 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce20940c-5692-43e0-9cbf-b50dc34ba5a3 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:38.418175 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee913be-db87-496c-8abf-729390fd3827 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:38.423184 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9abac3-af24-435e-a5e1-55306b13d77c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:38.424013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9abac3-af24-435e-a5e1-55306b13d77c service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:38.424308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9abac3-af24-435e-a5e1-55306b13d77c service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:38.424588 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9abac3-af24-435e-a5e1-55306b13d77c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:38.432369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-ca9abac3-af24-435e-a5e1-55306b13d77c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:38.481721 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-ce20940c-5692-43e0-9cbf-b50dc34ba5a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '235ff990c75b4f1ea3d93ee6831242e2', 'request_id': 'req-ce20940c-5692-43e0-9cbf-b50dc34ba5a3'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:38.488876 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-ce20940c-5692-43e0-9cbf-b50dc34ba5a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '235ff990c75b4f1ea3d93ee6831242e2', 'request_id': 'req-ce20940c-5692-43e0-9cbf-b50dc34ba5a3'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:38.496652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-ce20940c-5692-43e0-9cbf-b50dc34ba5a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '235ff990c75b4f1ea3d93ee6831242e2', 'request_id': 'req-ce20940c-5692-43e0-9cbf-b50dc34ba5a3'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:38.512834 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9abac3-af24-435e-a5e1-55306b13d77c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:38.514982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9abac3-af24-435e-a5e1-55306b13d77c service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:38.515189 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-ce20940c-5692-43e0-9cbf-b50dc34ba5a3 admin admin] The token cache is being invalidate because project 235ff990c75b4f1ea3d93ee6831242e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:38.515479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-ce20940c-5692-43e0-9cbf-b50dc34ba5a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:38.516274 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-ce20940c-5692-43e0-9cbf-b50dc34ba5a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:38.521820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 882/1745] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:38 2022] DELETE /identity/v3/projects/235ff990c75b4f1ea3d93ee6831242e2 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:26:38.524828 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf03bb8-65e6-4888-bff4-05ed57ac0023 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:38.524828 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf03bb8-65e6-4888-bff4-05ed57ac0023 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:38.524828 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf03bb8-65e6-4888-bff4-05ed57ac0023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:38.527104 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 864/1746] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:38 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:38.528552 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7e168-a97b-42cb-bdb7-91023d398b0c None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:38.528849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7e168-a97b-42cb-bdb7-91023d398b0c None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:38.529172 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7e168-a97b-42cb-bdb7-91023d398b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:38.550978 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-4db7e168-a97b-42cb-bdb7-91023d398b0c None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:38.552381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-4db7e168-a97b-42cb-bdb7-91023d398b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:38.584639 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-acf03bb8-65e6-4888-bff4-05ed57ac0023 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:38.586212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-acf03bb8-65e6-4888-bff4-05ed57ac0023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:38.651701 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 865/1747] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:38.656375 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d81a8-2eb4-4427-9088-bfbd389df316 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:38.656679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d81a8-2eb4-4427-9088-bfbd389df316 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:38.657566 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d81a8-2eb4-4427-9088-bfbd389df316 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:38.682844 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-791d81a8-2eb4-4427-9088-bfbd389df316 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:38.684629 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-791d81a8-2eb4-4427-9088-bfbd389df316 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:38.706240 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 866/1748] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:38.710024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d81a8-2eb4-4427-9088-bfbd389df316 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:38.723757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d81a8-2eb4-4427-9088-bfbd389df316 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:38.729878 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7471b-72a5-4d65-a369-42e6dad68d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:38.731050 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7471b-72a5-4d65-a369-42e6dad68d78 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:38.731575 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7471b-72a5-4d65-a369-42e6dad68d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:38.732185 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7471b-72a5-4d65-a369-42e6dad68d78 admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:38.733183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7471b-72a5-4d65-a369-42e6dad68d78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:38.733752 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7471b-72a5-4d65-a369-42e6dad68d78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:38.736596 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c7471b-72a5-4d65-a369-42e6dad68d78 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:38.765868 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 883/1749] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:38.774708 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e91e1-c00a-4ca8-8323-57285034caae None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:38.774708 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e91e1-c00a-4ca8-8323-57285034caae None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:38.775157 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5e91e1-c00a-4ca8-8323-57285034caae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:38.785319 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 867/1750] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:26:38.786224 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7471b-72a5-4d65-a369-42e6dad68d78 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:38.814206 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-1a5e91e1-c00a-4ca8-8323-57285034caae None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:38.820187 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7471b-72a5-4d65-a369-42e6dad68d78 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:38.829702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-1a5e91e1-c00a-4ca8-8323-57285034caae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:38.834682 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1781d8-e998-41ee-bca4-5564f5c80fec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:38.835323 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1781d8-e998-41ee-bca4-5564f5c80fec admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:38.835637 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1781d8-e998-41ee-bca4-5564f5c80fec admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:38.835913 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1781d8-e998-41ee-bca4-5564f5c80fec admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:38.836622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1781d8-e998-41ee-bca4-5564f5c80fec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:38.850878 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1781d8-e998-41ee-bca4-5564f5c80fec admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:38.857528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 884/1751] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:38.859377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e91e1-c00a-4ca8-8323-57285034caae None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:38.873876 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:38.880947 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5e91e1-c00a-4ca8-8323-57285034caae None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:38.896947 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5a927-be68-4329-b05e-1a089f02d26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:38.898133 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5a927-be68-4329-b05e-1a089f02d26a admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:38.898744 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5a927-be68-4329-b05e-1a089f02d26a admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:38.899461 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db5a927-be68-4329-b05e-1a089f02d26a admin admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:38.900457 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5a927-be68-4329-b05e-1a089f02d26a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:38.901112 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5a927-be68-4329-b05e-1a089f02d26a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:38.903581 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db5a927-be68-4329-b05e-1a089f02d26a admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:38.916793 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 868/1752] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:38 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:38.921619 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1781d8-e998-41ee-bca4-5564f5c80fec admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:38.928989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 885/1753] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:26:38.930442 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5a927-be68-4329-b05e-1a089f02d26a admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:38.943827 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db5a927-be68-4329-b05e-1a089f02d26a admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:38.949879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:39.065448 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1781d8-e998-41ee-bca4-5564f5c80fec admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:39.073101 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3efcb-822b-40e1-9567-0ccd04709bbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:39.073982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3efcb-822b-40e1-9567-0ccd04709bbb admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:39.074229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3efcb-822b-40e1-9567-0ccd04709bbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:39.084744 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0ae87-b523-45da-876f-2d0775a90bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:39.085590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0ae87-b523-45da-876f-2d0775a90bfe admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:39.085940 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0ae87-b523-45da-876f-2d0775a90bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:39.086304 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b0ae87-b523-45da-876f-2d0775a90bfe admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:39.087103 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0ae87-b523-45da-876f-2d0775a90bfe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:39.089199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b0ae87-b523-45da-876f-2d0775a90bfe admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:39.091264 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3efcb-822b-40e1-9567-0ccd04709bbb admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:39.092393 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd3efcb-822b-40e1-9567-0ccd04709bbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:39.097919 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd3efcb-822b-40e1-9567-0ccd04709bbb admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:39.144852 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 869/1754] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:38 2022] POST /identity/v3/users => generated 287 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:39.148518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3efcb-822b-40e1-9567-0ccd04709bbb admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:39.169465 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 886/1755] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:38 2022] POST /identity/v3/projects => generated 369 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:39.171303 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0ae87-b523-45da-876f-2d0775a90bfe admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:39.185906 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3efcb-822b-40e1-9567-0ccd04709bbb admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:39.290517 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b0ae87-b523-45da-876f-2d0775a90bfe admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:39.298176 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83d81f-e840-494a-9231-175ba02e6370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:39.298969 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83d81f-e840-494a-9231-175ba02e6370 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:39.299302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83d81f-e840-494a-9231-175ba02e6370 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:39.299586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83d81f-e840-494a-9231-175ba02e6370 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:39.300911 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83d81f-e840-494a-9231-175ba02e6370 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:39.303759 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc83d81f-e840-494a-9231-175ba02e6370 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:39.314991 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cf27b-203b-4509-93ab-d83d0f3a6162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:39.315968 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cf27b-203b-4509-93ab-d83d0f3a6162 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:39.316384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cf27b-203b-4509-93ab-d83d0f3a6162 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:39.316781 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129cf27b-203b-4509-93ab-d83d0f3a6162 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:39.317609 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129cf27b-203b-4509-93ab-d83d0f3a6162 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:39.319286 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129cf27b-203b-4509-93ab-d83d0f3a6162 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:39.332886 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 887/1756] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:39 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:39.335026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 870/1757] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:39.336625 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83d81f-e840-494a-9231-175ba02e6370 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:39.336748 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cf27b-203b-4509-93ab-d83d0f3a6162 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:39.349358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129cf27b-203b-4509-93ab-d83d0f3a6162 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:39.355056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83d81f-e840-494a-9231-175ba02e6370 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:39.360560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a22b5d-416f-4ee7-9830-19cdef0ee8e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:39.360899 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f9adb-0c0f-4153-91fa-fe8958f0e8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:39.361448 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a22b5d-416f-4ee7-9830-19cdef0ee8e3 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:39.361826 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a22b5d-416f-4ee7-9830-19cdef0ee8e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:39.362138 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f9adb-0c0f-4153-91fa-fe8958f0e8c6 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:39.362380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a22b5d-416f-4ee7-9830-19cdef0ee8e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:39.362738 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f9adb-0c0f-4153-91fa-fe8958f0e8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:39.363163 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592f9adb-0c0f-4153-91fa-fe8958f0e8c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:39.363388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a22b5d-416f-4ee7-9830-19cdef0ee8e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:39.364096 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f9adb-0c0f-4153-91fa-fe8958f0e8c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:39.365300 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a22b5d-416f-4ee7-9830-19cdef0ee8e3 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:39.366294 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592f9adb-0c0f-4153-91fa-fe8958f0e8c6 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:39.379731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 888/1758] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:39.380785 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a22b5d-416f-4ee7-9830-19cdef0ee8e3 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:39.388453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 871/1759] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:39.389446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f9adb-0c0f-4153-91fa-fe8958f0e8c6 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:39.393482 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a22b5d-416f-4ee7-9830-19cdef0ee8e3 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:39.404739 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592f9adb-0c0f-4153-91fa-fe8958f0e8c6 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:39.409757 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2260d7-cbeb-498d-bf50-1580d0c1f942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:39.410843 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2260d7-cbeb-498d-bf50-1580d0c1f942 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:39.411195 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2260d7-cbeb-498d-bf50-1580d0c1f942 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:39.411551 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2260d7-cbeb-498d-bf50-1580d0c1f942 admin admin] PATH_INFO: `/v3/projects/f2c9fcd7f4ac4946b4fe139118255ade/users/7760bdff0f0b4cae975138efc8677529/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:39.419124 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c71a21-3347-4da2-86b1-4363e6cb3c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:39.419852 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c71a21-3347-4da2-86b1-4363e6cb3c55 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:39.420137 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c71a21-3347-4da2-86b1-4363e6cb3c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:39.420432 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c71a21-3347-4da2-86b1-4363e6cb3c55 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:39.421168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c71a21-3347-4da2-86b1-4363e6cb3c55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:39.423382 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c71a21-3347-4da2-86b1-4363e6cb3c55 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:39.440046 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2260d7-cbeb-498d-bf50-1580d0c1f942 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2c9fcd7f4ac4946b4fe139118255ade, user_id=7760bdff0f0b4cae975138efc8677529, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:39.445617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 872/1760] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:39.446940 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2260d7-cbeb-498d-bf50-1580d0c1f942 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:39.455427 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c71a21-3347-4da2-86b1-4363e6cb3c55 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:39.476308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c71a21-3347-4da2-86b1-4363e6cb3c55 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:39.476952 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 889/1761] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:39 2022] PUT /identity/v3/projects/f2c9fcd7f4ac4946b4fe139118255ade/users/7760bdff0f0b4cae975138efc8677529/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:39.481801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0091cd-a7d8-4f8c-a504-4b0d55b12473 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:39.482092 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0091cd-a7d8-4f8c-a504-4b0d55b12473 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:39.482359 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0091cd-a7d8-4f8c-a504-4b0d55b12473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:39.502426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-9c0091cd-a7d8-4f8c-a504-4b0d55b12473 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:39.503701 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-9c0091cd-a7d8-4f8c-a504-4b0d55b12473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:39.543879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:39.559229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255acef9-cc07-4cbf-af08-329ac516b3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:39.560179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255acef9-cc07-4cbf-af08-329ac516b3b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:39.560468 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255acef9-cc07-4cbf-af08-329ac516b3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:39.560750 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255acef9-cc07-4cbf-af08-329ac516b3b8 admin admin] PATH_INFO: `/v3/projects/8509416b274a4f23a05e460ad0d09d53/users/bfe014c9e90d4ed9a24ba7e80fdad940/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:39.579405 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255acef9-cc07-4cbf-af08-329ac516b3b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8509416b274a4f23a05e460ad0d09d53, user_id=bfe014c9e90d4ed9a24ba7e80fdad940, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:39.582505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255acef9-cc07-4cbf-af08-329ac516b3b8 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:39.593019 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:39.595653 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 890/1762] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:39.605292 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0091cd-a7d8-4f8c-a504-4b0d55b12473 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:39.607643 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 873/1763] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:39 2022] PUT /identity/v3/projects/8509416b274a4f23a05e460ad0d09d53/users/bfe014c9e90d4ed9a24ba7e80fdad940/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:39.607812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-9c0091cd-a7d8-4f8c-a504-4b0d55b12473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:39.617810 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d5178-6766-49dc-9949-af20e7391add None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:39.618272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d5178-6766-49dc-9949-af20e7391add None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:39.618674 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766d5178-6766-49dc-9949-af20e7391add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:39.648548 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-766d5178-6766-49dc-9949-af20e7391add None None] MFA Rules not processed for user `bfe014c9e90d4ed9a24ba7e80fdad940`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:39.649782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-766d5178-6766-49dc-9949-af20e7391add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:39.673668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0091cd-a7d8-4f8c-a504-4b0d55b12473 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:39.724034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 874/1764] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:39.725798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d5178-6766-49dc-9949-af20e7391add None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:39.730789 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83189f19-a96f-4405-acfc-bf7c78181701 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:39.731457 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83189f19-a96f-4405-acfc-bf7c78181701 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:39.731782 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83189f19-a96f-4405-acfc-bf7c78181701 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:39.732068 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83189f19-a96f-4405-acfc-bf7c78181701 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:39.793006 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766d5178-6766-49dc-9949-af20e7391add None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:39.798081 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5915ce-d2a4-4c1b-a048-964dc4165e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:39.798757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5915ce-d2a4-4c1b-a048-964dc4165e80 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:39.799046 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5915ce-d2a4-4c1b-a048-964dc4165e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:39.799329 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5915ce-d2a4-4c1b-a048-964dc4165e80 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:39.800054 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5915ce-d2a4-4c1b-a048-964dc4165e80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:39.801979 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5915ce-d2a4-4c1b-a048-964dc4165e80 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:39.812885 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83189f19-a96f-4405-acfc-bf7c78181701 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:39.814906 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83189f19-a96f-4405-acfc-bf7c78181701 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:39.831588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 891/1765] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:26:39.841117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 875/1766] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:39 2022] POST /identity/v3/projects => generated 369 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:26:39.845541 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83189f19-a96f-4405-acfc-bf7c78181701 service neutron] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:39.858789 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83189f19-a96f-4405-acfc-bf7c78181701 service neutron] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:39.903986 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:39.931691 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd2c13-c059-4764-a5bc-7132abd08120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:39.932382 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd2c13-c059-4764-a5bc-7132abd08120 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:39.932671 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd2c13-c059-4764-a5bc-7132abd08120 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:39.932956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfd2c13-c059-4764-a5bc-7132abd08120 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:39.933651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd2c13-c059-4764-a5bc-7132abd08120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:39.935769 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfd2c13-c059-4764-a5bc-7132abd08120 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:39.958251 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 892/1767] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:39 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:26:39.962375 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5915ce-d2a4-4c1b-a048-964dc4165e80 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:39.974927 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5915ce-d2a4-4c1b-a048-964dc4165e80 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:39.980467 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945bef2-775c-4162-8cea-1eb77054e041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:39.981255 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945bef2-775c-4162-8cea-1eb77054e041 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:39.981644 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945bef2-775c-4162-8cea-1eb77054e041 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:39.982027 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e945bef2-775c-4162-8cea-1eb77054e041 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:39.982892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945bef2-775c-4162-8cea-1eb77054e041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:39.984617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e945bef2-775c-4162-8cea-1eb77054e041 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:40.001824 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 876/1768] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:40.002434 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd2c13-c059-4764-a5bc-7132abd08120 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:40.016805 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfd2c13-c059-4764-a5bc-7132abd08120 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:40.028944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e30d1-c6e9-4d28-9f17-23c15c0f3b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:40.029954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e30d1-c6e9-4d28-9f17-23c15c0f3b9f admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:40.030149 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e30d1-c6e9-4d28-9f17-23c15c0f3b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:40.030532 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76e30d1-c6e9-4d28-9f17-23c15c0f3b9f admin admin] PATH_INFO: `/v3/projects/e727806b5245490384d97077496efc3c/users/999e9faa93634b68a4ee135fde7ed2ca/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:40.067058 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e30d1-c6e9-4d28-9f17-23c15c0f3b9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e727806b5245490384d97077496efc3c, user_id=999e9faa93634b68a4ee135fde7ed2ca, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:40.070173 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76e30d1-c6e9-4d28-9f17-23c15c0f3b9f admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:40.087414 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 893/1769] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:40 2022] PUT /identity/v3/projects/e727806b5245490384d97077496efc3c/users/999e9faa93634b68a4ee135fde7ed2ca/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:26:40.093092 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945bef2-775c-4162-8cea-1eb77054e041 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:40.112006 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e945bef2-775c-4162-8cea-1eb77054e041 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:40.179505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8f062-1f74-4d79-93a2-b24aab474036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:40.180219 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8f062-1f74-4d79-93a2-b24aab474036 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:40.180509 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8f062-1f74-4d79-93a2-b24aab474036 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:40.180789 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8f062-1f74-4d79-93a2-b24aab474036 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:40.181524 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8f062-1f74-4d79-93a2-b24aab474036 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:40.183116 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8f062-1f74-4d79-93a2-b24aab474036 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:40.185243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:40.198925 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 877/1770] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:40.200234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e30d1-c6e9-4d28-9f17-23c15c0f3b9f admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:40.217804 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76e30d1-c6e9-4d28-9f17-23c15c0f3b9f admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:40.223165 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3e02e-61e8-469b-9dee-2e61200dd8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:40.224111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3e02e-61e8-469b-9dee-2e61200dd8c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:40.225033 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3e02e-61e8-469b-9dee-2e61200dd8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:40.225530 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3e02e-61e8-469b-9dee-2e61200dd8c4 admin admin] PATH_INFO: `/v3/projects/e727806b5245490384d97077496efc3c/users/999e9faa93634b68a4ee135fde7ed2ca/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:40.228645 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3e02e-61e8-469b-9dee-2e61200dd8c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e727806b5245490384d97077496efc3c, user_id=999e9faa93634b68a4ee135fde7ed2ca, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:40.231705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3e02e-61e8-469b-9dee-2e61200dd8c4 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:40.243300 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 894/1771] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:40 2022] PUT /identity/v3/projects/e727806b5245490384d97077496efc3c/users/999e9faa93634b68a4ee135fde7ed2ca/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:40.254006 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75ecc9-bacb-457a-84fd-1b438d32b118 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:40.254304 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75ecc9-bacb-457a-84fd-1b438d32b118 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:40.254590 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc75ecc9-bacb-457a-84fd-1b438d32b118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:40.283021 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-cc75ecc9-bacb-457a-84fd-1b438d32b118 None None] MFA Rules not processed for user `999e9faa93634b68a4ee135fde7ed2ca`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:40.284198 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-cc75ecc9-bacb-457a-84fd-1b438d32b118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:40.359317 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 878/1772] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:40 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:40.370578 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3e02e-61e8-469b-9dee-2e61200dd8c4 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:40.372479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-46b3e02e-61e8-469b-9dee-2e61200dd8c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:40.434819 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3e02e-61e8-469b-9dee-2e61200dd8c4 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:40.439276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b62413-0548-409a-8bf7-4b52fa0289a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:40.440131 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b62413-0548-409a-8bf7-4b52fa0289a0 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:40.440421 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b62413-0548-409a-8bf7-4b52fa0289a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:40.440849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b62413-0548-409a-8bf7-4b52fa0289a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:40.453857 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b62413-0548-409a-8bf7-4b52fa0289a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:40.456574 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b62413-0548-409a-8bf7-4b52fa0289a0 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:40.480271 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 895/1773] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:40 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:40.546903 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd8200-85c2-4fc9-affb-2db9b73fc3cc None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:40.547174 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd8200-85c2-4fc9-affb-2db9b73fc3cc None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:40.548025 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cd8200-85c2-4fc9-affb-2db9b73fc3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:40.581720 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-95cd8200-85c2-4fc9-affb-2db9b73fc3cc None None] MFA Rules not processed for user `7760bdff0f0b4cae975138efc8677529`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:40.583107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-95cd8200-85c2-4fc9-affb-2db9b73fc3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:40.731861 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 879/1774] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:40.740899 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b62413-0548-409a-8bf7-4b52fa0289a0 service cinder] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:40.833224 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b62413-0548-409a-8bf7-4b52fa0289a0 service cinder] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:40.838110 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e48693-4d43-4922-9195-4e5724cf646b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:40.838903 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e48693-4d43-4922-9195-4e5724cf646b admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:40.839193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e48693-4d43-4922-9195-4e5724cf646b admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:40.839469 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e48693-4d43-4922-9195-4e5724cf646b admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:40.840197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e48693-4d43-4922-9195-4e5724cf646b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:40.842148 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e48693-4d43-4922-9195-4e5724cf646b admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:40.875183 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 896/1775] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:40 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:40.876937 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd8200-85c2-4fc9-affb-2db9b73fc3cc None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:40.892101 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cd8200-85c2-4fc9-affb-2db9b73fc3cc None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:40.958291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68add732-177b-443a-8e04-9c3e0119f955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:40.959055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68add732-177b-443a-8e04-9c3e0119f955 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:40.963454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68add732-177b-443a-8e04-9c3e0119f955 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:40.963454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68add732-177b-443a-8e04-9c3e0119f955 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:40.963454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68add732-177b-443a-8e04-9c3e0119f955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:40.963454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68add732-177b-443a-8e04-9c3e0119f955 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:40.989475 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 880/1776] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:40 2022] POST /identity/v3/users => generated 292 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:40.993462 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e48693-4d43-4922-9195-4e5724cf646b admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:41.008344 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e48693-4d43-4922-9195-4e5724cf646b admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:41.013792 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69dc54b-f6f3-41cc-91e3-198453a2e7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:41.014546 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dc54b-f6f3-41cc-91e3-198453a2e7b4 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:41.014985 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dc54b-f6f3-41cc-91e3-198453a2e7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:41.015288 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dc54b-f6f3-41cc-91e3-198453a2e7b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:41.016262 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69dc54b-f6f3-41cc-91e3-198453a2e7b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:41.018097 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69dc54b-f6f3-41cc-91e3-198453a2e7b4 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:41.029468 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 897/1777] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:26:41.034222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68add732-177b-443a-8e04-9c3e0119f955 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:41.039393 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:41.046187 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68add732-177b-443a-8e04-9c3e0119f955 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:41.051597 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b527f-c7e7-4975-816b-731a5c9f70b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:41.052525 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b527f-c7e7-4975-816b-731a5c9f70b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:41.052814 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b527f-c7e7-4975-816b-731a5c9f70b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:41.053094 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40b527f-c7e7-4975-816b-731a5c9f70b3 admin admin] PATH_INFO: `/v3/projects/020cb42e2d554316866aae789bac9f81/users/a120976a25644875a71c96dbd9433668/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:41.075705 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b527f-c7e7-4975-816b-731a5c9f70b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=020cb42e2d554316866aae789bac9f81, user_id=a120976a25644875a71c96dbd9433668, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:41.075705 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40b527f-c7e7-4975-816b-731a5c9f70b3 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:41.095662 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 881/1778] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:41 2022] PUT /identity/v3/projects/020cb42e2d554316866aae789bac9f81/users/a120976a25644875a71c96dbd9433668/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:26:41.098044 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69dc54b-f6f3-41cc-91e3-198453a2e7b4 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:41.111052 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69dc54b-f6f3-41cc-91e3-198453a2e7b4 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:41.114965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:41.224378 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9394f-a379-477a-baca-d9876c4dcca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:41.225195 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9394f-a379-477a-baca-d9876c4dcca8 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:41.225589 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9394f-a379-477a-baca-d9876c4dcca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:41.225970 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9394f-a379-477a-baca-d9876c4dcca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:41.227094 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9394f-a379-477a-baca-d9876c4dcca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:41.229636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c9394f-a379-477a-baca-d9876c4dcca8 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:41.250487 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 898/1779] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:41.253209 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b527f-c7e7-4975-816b-731a5c9f70b3 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:41.267063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40b527f-c7e7-4975-816b-731a5c9f70b3 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:41.273687 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6197751-00e1-46e0-ac64-0a5b4988b11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:41.274595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6197751-00e1-46e0-ac64-0a5b4988b11d admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:41.275389 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6197751-00e1-46e0-ac64-0a5b4988b11d admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:41.275734 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6197751-00e1-46e0-ac64-0a5b4988b11d admin admin] PATH_INFO: `/v3/projects/020cb42e2d554316866aae789bac9f81/users/a120976a25644875a71c96dbd9433668/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:41.281933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6197751-00e1-46e0-ac64-0a5b4988b11d admin admin] RBAC: Authorizing `identity:create_grant(project_id=020cb42e2d554316866aae789bac9f81, user_id=a120976a25644875a71c96dbd9433668, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:41.285866 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6197751-00e1-46e0-ac64-0a5b4988b11d admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:41.303784 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 882/1780] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:41 2022] PUT /identity/v3/projects/020cb42e2d554316866aae789bac9f81/users/a120976a25644875a71c96dbd9433668/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:42.212063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9394f-a379-477a-baca-d9876c4dcca8 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:42.222083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c9394f-a379-477a-baca-d9876c4dcca8 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:42.306855 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c8bbf3-9699-4d53-af5c-fa83ae24c624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:42.307923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8bbf3-9699-4d53-af5c-fa83ae24c624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:42.308307 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8bbf3-9699-4d53-af5c-fa83ae24c624 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:42.309118 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c8bbf3-9699-4d53-af5c-fa83ae24c624 admin admin] PATH_INFO: `/v3/users/bfe014c9e90d4ed9a24ba7e80fdad940` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:42.309987 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8bbf3-9699-4d53-af5c-fa83ae24c624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfe014c9e90d4ed9a24ba7e80fdad940)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:42.312217 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c8bbf3-9699-4d53-af5c-fa83ae24c624 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:42.360780 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-81c8bbf3-9699-4d53-af5c-fa83ae24c624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfe014c9e90d4ed9a24ba7e80fdad940'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:42.369825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-81c8bbf3-9699-4d53-af5c-fa83ae24c624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfe014c9e90d4ed9a24ba7e80fdad940'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:42.370440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-81c8bbf3-9699-4d53-af5c-fa83ae24c624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfe014c9e90d4ed9a24ba7e80fdad940'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:42.371077 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-81c8bbf3-9699-4d53-af5c-fa83ae24c624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfe014c9e90d4ed9a24ba7e80fdad940'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:42.387052 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-81c8bbf3-9699-4d53-af5c-fa83ae24c624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfe014c9e90d4ed9a24ba7e80fdad940'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:42.412999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 899/1781] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:42 2022] DELETE /identity/v3/users/bfe014c9e90d4ed9a24ba7e80fdad940 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:42.417563 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bc86f-6d08-4232-be2a-a4caf362625b None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:42.418049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bc86f-6d08-4232-be2a-a4caf362625b None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:42.418253 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bc86f-6d08-4232-be2a-a4caf362625b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:42.438768 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-d73bc86f-6d08-4232-be2a-a4caf362625b None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:42.440114 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d73bc86f-6d08-4232-be2a-a4caf362625b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:42.492873 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930fc92-1fe9-41ba-831c-376a173b537c None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:42.493171 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930fc92-1fe9-41ba-831c-376a173b537c None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:42.493457 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930fc92-1fe9-41ba-831c-376a173b537c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:42.508277 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 883/1782] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:42.518225 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bc86f-6d08-4232-be2a-a4caf362625b None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:42.519791 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d73bc86f-6d08-4232-be2a-a4caf362625b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:42.524249 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-9930fc92-1fe9-41ba-831c-376a173b537c None None] MFA Rules not processed for user `a120976a25644875a71c96dbd9433668`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:42.525450 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-9930fc92-1fe9-41ba-831c-376a173b537c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:42.537426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:42.586174 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bc86f-6d08-4232-be2a-a4caf362625b None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:42.590785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45599c9-563b-4191-958f-ea9615c5f39a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:42.591789 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45599c9-563b-4191-958f-ea9615c5f39a service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:42.592476 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45599c9-563b-4191-958f-ea9615c5f39a service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:42.592900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45599c9-563b-4191-958f-ea9615c5f39a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:42.608142 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45599c9-563b-4191-958f-ea9615c5f39a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:42.611020 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45599c9-563b-4191-958f-ea9615c5f39a service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:42.627045 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 900/1783] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:42 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:42.628196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 884/1784] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:26:42.639882 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930fc92-1fe9-41ba-831c-376a173b537c None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:42.642142 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-9930fc92-1fe9-41ba-831c-376a173b537c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:42.724266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930fc92-1fe9-41ba-831c-376a173b537c None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:42.728230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9986c1d-d90d-4364-96c9-0b58ff2d211a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:42.728895 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9986c1d-d90d-4364-96c9-0b58ff2d211a service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:42.729184 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9986c1d-d90d-4364-96c9-0b58ff2d211a service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:42.729466 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9986c1d-d90d-4364-96c9-0b58ff2d211a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:42.731705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-c9986c1d-d90d-4364-96c9-0b58ff2d211a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:42.807986 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9986c1d-d90d-4364-96c9-0b58ff2d211a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:42.807986 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9986c1d-d90d-4364-96c9-0b58ff2d211a service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:42.829729 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 901/1785] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:42.949304 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45599c9-563b-4191-958f-ea9615c5f39a service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:42.950805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e45599c9-563b-4191-958f-ea9615c5f39a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:42.966144 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45599c9-563b-4191-958f-ea9615c5f39a service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:42.984148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3085c-615b-4c1b-b4c4-5a635c8b7afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:42.986165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3085c-615b-4c1b-b4c4-5a635c8b7afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:42.986455 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3085c-615b-4c1b-b4c4-5a635c8b7afb admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:42.986761 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b3085c-615b-4c1b-b4c4-5a635c8b7afb admin admin] PATH_INFO: `/v3/projects/8509416b274a4f23a05e460ad0d09d53` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:42.988526 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3085c-615b-4c1b-b4c4-5a635c8b7afb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8509416b274a4f23a05e460ad0d09d53)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:42.991783 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b3085c-615b-4c1b-b4c4-5a635c8b7afb admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:43.054335 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-c6b3085c-615b-4c1b-b4c4-5a635c8b7afb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8509416b274a4f23a05e460ad0d09d53', 'request_id': 'req-c6b3085c-615b-4c1b-b4c4-5a635c8b7afb'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:43.060700 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-c6b3085c-615b-4c1b-b4c4-5a635c8b7afb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8509416b274a4f23a05e460ad0d09d53', 'request_id': 'req-c6b3085c-615b-4c1b-b4c4-5a635c8b7afb'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:43.068004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-c6b3085c-615b-4c1b-b4c4-5a635c8b7afb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8509416b274a4f23a05e460ad0d09d53', 'request_id': 'req-c6b3085c-615b-4c1b-b4c4-5a635c8b7afb'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:43.070308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:43.089609 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-c6b3085c-615b-4c1b-b4c4-5a635c8b7afb admin admin] The token cache is being invalidate because project 8509416b274a4f23a05e460ad0d09d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:43.090902 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-c6b3085c-615b-4c1b-b4c4-5a635c8b7afb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:43.091593 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-c6b3085c-615b-4c1b-b4c4-5a635c8b7afb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:43.093833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 885/1786] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:42 2022] DELETE /identity/v3/projects/8509416b274a4f23a05e460ad0d09d53 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:43.098415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9986c1d-d90d-4364-96c9-0b58ff2d211a service cinder] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:43.120014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9986c1d-d90d-4364-96c9-0b58ff2d211a service cinder] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:43.205597 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14eb5cc-95c4-418b-9183-3d4a87ae8ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:43.206646 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eb5cc-95c4-418b-9183-3d4a87ae8ee9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:43.206930 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eb5cc-95c4-418b-9183-3d4a87ae8ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:43.207206 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eb5cc-95c4-418b-9183-3d4a87ae8ee9 admin admin] PATH_INFO: `/v3/users/999e9faa93634b68a4ee135fde7ed2ca` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:43.208591 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14eb5cc-95c4-418b-9183-3d4a87ae8ee9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=999e9faa93634b68a4ee135fde7ed2ca)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:43.216696 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14eb5cc-95c4-418b-9183-3d4a87ae8ee9 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:43.221300 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:43.317993 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c14eb5cc-95c4-418b-9183-3d4a87ae8ee9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '999e9faa93634b68a4ee135fde7ed2ca'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:43.330348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c14eb5cc-95c4-418b-9183-3d4a87ae8ee9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '999e9faa93634b68a4ee135fde7ed2ca'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:43.332430 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c14eb5cc-95c4-418b-9183-3d4a87ae8ee9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '999e9faa93634b68a4ee135fde7ed2ca'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:43.333926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c14eb5cc-95c4-418b-9183-3d4a87ae8ee9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '999e9faa93634b68a4ee135fde7ed2ca'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:43.351551 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c14eb5cc-95c4-418b-9183-3d4a87ae8ee9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '999e9faa93634b68a4ee135fde7ed2ca'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:43.364962 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 902/1787] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:43 2022] DELETE /identity/v3/users/999e9faa93634b68a4ee135fde7ed2ca => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:43.653896 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3085c-615b-4c1b-b4c4-5a635c8b7afb admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:43.655432 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-c6b3085c-615b-4c1b-b4c4-5a635c8b7afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:43.669411 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b3085c-615b-4c1b-b4c4-5a635c8b7afb admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:43.728250 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4c0e00-abf4-4a86-ad1c-1b54d475eecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:43.729146 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c0e00-abf4-4a86-ad1c-1b54d475eecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:43.729579 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c0e00-abf4-4a86-ad1c-1b54d475eecc admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:43.729923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4c0e00-abf4-4a86-ad1c-1b54d475eecc admin admin] PATH_INFO: `/v3/projects/e727806b5245490384d97077496efc3c` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:43.731107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c0e00-abf4-4a86-ad1c-1b54d475eecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e727806b5245490384d97077496efc3c)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:43.733129 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4c0e00-abf4-4a86-ad1c-1b54d475eecc admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:43.779623 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8a4c0e00-abf4-4a86-ad1c-1b54d475eecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e727806b5245490384d97077496efc3c', 'request_id': 'req-8a4c0e00-abf4-4a86-ad1c-1b54d475eecc'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:43.785266 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8a4c0e00-abf4-4a86-ad1c-1b54d475eecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e727806b5245490384d97077496efc3c', 'request_id': 'req-8a4c0e00-abf4-4a86-ad1c-1b54d475eecc'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:43.791353 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8a4c0e00-abf4-4a86-ad1c-1b54d475eecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e727806b5245490384d97077496efc3c', 'request_id': 'req-8a4c0e00-abf4-4a86-ad1c-1b54d475eecc'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:43.810691 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8a4c0e00-abf4-4a86-ad1c-1b54d475eecc admin admin] The token cache is being invalidate because project e727806b5245490384d97077496efc3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:43.810859 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8a4c0e00-abf4-4a86-ad1c-1b54d475eecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:43.811789 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8a4c0e00-abf4-4a86-ad1c-1b54d475eecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:43.813877 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 886/1788] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:43 2022] DELETE /identity/v3/projects/e727806b5245490384d97077496efc3c => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:43.820178 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ca50f-047e-4d5f-afe3-c1faba5c6ecc None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:43.820472 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ca50f-047e-4d5f-afe3-c1faba5c6ecc None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:43.820752 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27ca50f-047e-4d5f-afe3-c1faba5c6ecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:43.840965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-b27ca50f-047e-4d5f-afe3-c1faba5c6ecc None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:43.842164 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-b27ca50f-047e-4d5f-afe3-c1faba5c6ecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:43.900304 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 903/1789] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:43.907867 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa1abb-20dc-4198-88b6-d092f2aaf9c4 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:43.908294 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa1abb-20dc-4198-88b6-d092f2aaf9c4 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:43.908586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afa1abb-20dc-4198-88b6-d092f2aaf9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:43.926504 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-1afa1abb-20dc-4198-88b6-d092f2aaf9c4 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:43.927673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-1afa1abb-20dc-4198-88b6-d092f2aaf9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:43.935495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 887/1790] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:43.940025 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ca50f-047e-4d5f-afe3-c1faba5c6ecc None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:43.949584 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27ca50f-047e-4d5f-afe3-c1faba5c6ecc None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:43.954208 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364350d8-9288-48bb-bf49-6b90ee067f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:43.954887 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364350d8-9288-48bb-bf49-6b90ee067f7f admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:43.955174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364350d8-9288-48bb-bf49-6b90ee067f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:43.955453 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364350d8-9288-48bb-bf49-6b90ee067f7f admin admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:43.956213 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364350d8-9288-48bb-bf49-6b90ee067f7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:43.956527 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364350d8-9288-48bb-bf49-6b90ee067f7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:43.958134 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364350d8-9288-48bb-bf49-6b90ee067f7f admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:43.969911 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 904/1791] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:26:43.973992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa1abb-20dc-4198-88b6-d092f2aaf9c4 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:43.983171 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afa1abb-20dc-4198-88b6-d092f2aaf9c4 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:43.988396 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eca60a-70ab-4058-94c0-835adde65cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:43.989047 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eca60a-70ab-4058-94c0-835adde65cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:43.989335 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eca60a-70ab-4058-94c0-835adde65cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:43.989620 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eca60a-70ab-4058-94c0-835adde65cb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:43.990350 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eca60a-70ab-4058-94c0-835adde65cb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:43.992317 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eca60a-70ab-4058-94c0-835adde65cb8 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:44.017024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 888/1792] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:43 2022] POST /identity/v3/projects => generated 389 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:44.020856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364350d8-9288-48bb-bf49-6b90ee067f7f admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:44.030649 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364350d8-9288-48bb-bf49-6b90ee067f7f admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:44.085538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ebdb8-48fe-4248-adc2-8a81a9c6b67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:44.086204 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ebdb8-48fe-4248-adc2-8a81a9c6b67f admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:44.086492 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ebdb8-48fe-4248-adc2-8a81a9c6b67f admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:44.086769 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ebdb8-48fe-4248-adc2-8a81a9c6b67f admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:44.087468 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ebdb8-48fe-4248-adc2-8a81a9c6b67f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:44.089407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ebdb8-48fe-4248-adc2-8a81a9c6b67f admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:44.103887 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:44.110983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 905/1793] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:44 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:26:44.114900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eca60a-70ab-4058-94c0-835adde65cb8 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:44.125151 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eca60a-70ab-4058-94c0-835adde65cb8 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:44.130027 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed03a5-3f9f-4ae3-9699-ebe094fd28ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:44.130802 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed03a5-3f9f-4ae3-9699-ebe094fd28ca admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:44.131091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed03a5-3f9f-4ae3-9699-ebe094fd28ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:44.131374 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed03a5-3f9f-4ae3-9699-ebe094fd28ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:44.133811 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed03a5-3f9f-4ae3-9699-ebe094fd28ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:44.135458 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ed03a5-3f9f-4ae3-9699-ebe094fd28ca admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:44.148370 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 889/1794] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:26:44.156207 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ebdb8-48fe-4248-adc2-8a81a9c6b67f admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:44.166988 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ebdb8-48fe-4248-adc2-8a81a9c6b67f admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:44.171756 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d437cd2e-73b2-4a78-b668-07d826c97762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:44.172462 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437cd2e-73b2-4a78-b668-07d826c97762 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:44.172751 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437cd2e-73b2-4a78-b668-07d826c97762 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:44.173033 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d437cd2e-73b2-4a78-b668-07d826c97762 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:44.173761 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437cd2e-73b2-4a78-b668-07d826c97762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:44.175446 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d437cd2e-73b2-4a78-b668-07d826c97762 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:44.185858 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 906/1795] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:26:44.190284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed03a5-3f9f-4ae3-9699-ebe094fd28ca admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:44.200623 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed03a5-3f9f-4ae3-9699-ebe094fd28ca admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:44.206093 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecbe58-98e5-4d7c-b806-3ad9701a53d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:44.207006 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecbe58-98e5-4d7c-b806-3ad9701a53d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:44.207292 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecbe58-98e5-4d7c-b806-3ad9701a53d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:44.207575 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ecbe58-98e5-4d7c-b806-3ad9701a53d6 admin admin] PATH_INFO: `/v3/projects/9a6665c56b254e1b9f604cef3c98b061/users/118b45015b00418db2ec5ecbbc8bf022/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:44.222611 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecbe58-98e5-4d7c-b806-3ad9701a53d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6665c56b254e1b9f604cef3c98b061, user_id=118b45015b00418db2ec5ecbbc8bf022, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:44.225340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ecbe58-98e5-4d7c-b806-3ad9701a53d6 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:44.239429 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 890/1796] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:44 2022] PUT /identity/v3/projects/9a6665c56b254e1b9f604cef3c98b061/users/118b45015b00418db2ec5ecbbc8bf022/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:44.250064 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa4b96-0273-4c4e-aa01-4601b1eae295 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:44.250603 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa4b96-0273-4c4e-aa01-4601b1eae295 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:44.250690 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaa4b96-0273-4c4e-aa01-4601b1eae295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:44.305564 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-acaa4b96-0273-4c4e-aa01-4601b1eae295 None None] MFA Rules not processed for user `118b45015b00418db2ec5ecbbc8bf022`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:44.306800 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-acaa4b96-0273-4c4e-aa01-4601b1eae295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:44.406329 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecbe58-98e5-4d7c-b806-3ad9701a53d6 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:44.409415 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d2ecbe58-98e5-4d7c-b806-3ad9701a53d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:44.416198 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 907/1797] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:44.417150 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa4b96-0273-4c4e-aa01-4601b1eae295 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:44.443128 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:44.525445 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ecbe58-98e5-4d7c-b806-3ad9701a53d6 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:44.539230 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f44ac-a2b3-4e5e-a254-c5eaa88125c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:44.540971 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f44ac-a2b3-4e5e-a254-c5eaa88125c3 service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:44.541271 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f44ac-a2b3-4e5e-a254-c5eaa88125c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:44.542090 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815f44ac-a2b3-4e5e-a254-c5eaa88125c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:44.544249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-815f44ac-a2b3-4e5e-a254-c5eaa88125c3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:44.548162 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaa4b96-0273-4c4e-aa01-4601b1eae295 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:44.556324 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c45ca-29b7-4040-962a-e86f1fb778db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:44.557093 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c45ca-29b7-4040-962a-e86f1fb778db admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:44.557456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c45ca-29b7-4040-962a-e86f1fb778db admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:44.557811 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c45ca-29b7-4040-962a-e86f1fb778db admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:44.558667 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c45ca-29b7-4040-962a-e86f1fb778db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:44.561023 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c45ca-29b7-4040-962a-e86f1fb778db admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:44.599763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 908/1798] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:44 2022] POST /identity/v3/projects => generated 387 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:44.607885 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c45ca-29b7-4040-962a-e86f1fb778db admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:44.665124 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f44ac-a2b3-4e5e-a254-c5eaa88125c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:44.667869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815f44ac-a2b3-4e5e-a254-c5eaa88125c3 service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:44.714411 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 891/1799] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:44 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:44.783544 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c45ca-29b7-4040-962a-e86f1fb778db admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:44.805886 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08788ad8-25a5-4aa1-8df1-73a5be20ffbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:44.805886 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08788ad8-25a5-4aa1-8df1-73a5be20ffbb admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:44.805886 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08788ad8-25a5-4aa1-8df1-73a5be20ffbb admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:44.805886 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08788ad8-25a5-4aa1-8df1-73a5be20ffbb admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:44.806164 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08788ad8-25a5-4aa1-8df1-73a5be20ffbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:44.811251 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08788ad8-25a5-4aa1-8df1-73a5be20ffbb admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:44.827109 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:44.851984 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 909/1800] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:44 2022] POST /identity/v3/users => generated 300 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:44.854725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f44ac-a2b3-4e5e-a254-c5eaa88125c3 service cinder] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:44.873955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815f44ac-a2b3-4e5e-a254-c5eaa88125c3 service cinder] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:44.885284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f01a8-d484-44cb-b0f8-c1446935f744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:44.886139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f01a8-d484-44cb-b0f8-c1446935f744 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:44.886434 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f01a8-d484-44cb-b0f8-c1446935f744 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:44.887082 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779f01a8-d484-44cb-b0f8-c1446935f744 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:44.890592 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f01a8-d484-44cb-b0f8-c1446935f744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:44.894043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779f01a8-d484-44cb-b0f8-c1446935f744 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:44.927073 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 892/1801] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:44.929198 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08788ad8-25a5-4aa1-8df1-73a5be20ffbb admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:44.942712 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08788ad8-25a5-4aa1-8df1-73a5be20ffbb admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:44.956323 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b317a2-e375-464e-8ba1-2c46908979ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:44.957298 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b317a2-e375-464e-8ba1-2c46908979ca admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:44.957526 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b317a2-e375-464e-8ba1-2c46908979ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:44.957804 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b317a2-e375-464e-8ba1-2c46908979ca admin admin] PATH_INFO: `/v3/projects/1e68bf350e334538a1c73fa8f58f84a0/users/0860d9bc3ccb4fae95c37e0785a1e5cc/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:44.991661 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b317a2-e375-464e-8ba1-2c46908979ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e68bf350e334538a1c73fa8f58f84a0, user_id=0860d9bc3ccb4fae95c37e0785a1e5cc, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:44.994053 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b317a2-e375-464e-8ba1-2c46908979ca admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:45.040291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f01a8-d484-44cb-b0f8-c1446935f744 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:45.041037 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 910/1802] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:44 2022] PUT /identity/v3/projects/1e68bf350e334538a1c73fa8f58f84a0/users/0860d9bc3ccb4fae95c37e0785a1e5cc/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:45.052991 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779f01a8-d484-44cb-b0f8-c1446935f744 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:45.145316 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ef582-473a-47ae-a278-fa7def5798d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:45.146786 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ef582-473a-47ae-a278-fa7def5798d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:45.148355 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ef582-473a-47ae-a278-fa7def5798d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:45.148743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ef582-473a-47ae-a278-fa7def5798d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:45.149694 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ef582-473a-47ae-a278-fa7def5798d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:45.151541 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ef582-473a-47ae-a278-fa7def5798d1 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:45.164225 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 893/1803] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:45 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:26:45.168474 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b317a2-e375-464e-8ba1-2c46908979ca admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:45.181056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b317a2-e375-464e-8ba1-2c46908979ca admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:45.188070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa0975-d4f3-4ce9-acea-38a587e947c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:45.189484 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa0975-d4f3-4ce9-acea-38a587e947c5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:45.189976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa0975-d4f3-4ce9-acea-38a587e947c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:45.190266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa0975-d4f3-4ce9-acea-38a587e947c5 admin admin] PATH_INFO: `/v3/projects/1e68bf350e334538a1c73fa8f58f84a0/users/0860d9bc3ccb4fae95c37e0785a1e5cc/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:45.192531 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa0975-d4f3-4ce9-acea-38a587e947c5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e68bf350e334538a1c73fa8f58f84a0, user_id=0860d9bc3ccb4fae95c37e0785a1e5cc, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:45.195367 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa0975-d4f3-4ce9-acea-38a587e947c5 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:45.208731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 911/1804] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:45 2022] PUT /identity/v3/projects/1e68bf350e334538a1c73fa8f58f84a0/users/0860d9bc3ccb4fae95c37e0785a1e5cc/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:26:45.229243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dd440-ebd5-428c-a0c3-dcfbcdfa289d None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:45.229542 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dd440-ebd5-428c-a0c3-dcfbcdfa289d None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:45.229833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02dd440-ebd5-428c-a0c3-dcfbcdfa289d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:45.266479 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-a02dd440-ebd5-428c-a0c3-dcfbcdfa289d None None] MFA Rules not processed for user `0860d9bc3ccb4fae95c37e0785a1e5cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:45.267772 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a02dd440-ebd5-428c-a0c3-dcfbcdfa289d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:45.316359 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:45.348359 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 894/1805] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:45 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:45.359041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa0975-d4f3-4ce9-acea-38a587e947c5 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:45.420230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa0975-d4f3-4ce9-acea-38a587e947c5 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:45.424512 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4b5e7-459b-4166-a8ce-bf54342e432f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:45.425173 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4b5e7-459b-4166-a8ce-bf54342e432f service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:45.425466 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4b5e7-459b-4166-a8ce-bf54342e432f service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:45.425745 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4b5e7-459b-4166-a8ce-bf54342e432f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:45.434812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4b5e7-459b-4166-a8ce-bf54342e432f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:45.436297 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4b5e7-459b-4166-a8ce-bf54342e432f service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:45.446081 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 912/1806] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:45 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:26:45.571953 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02dd440-ebd5-428c-a0c3-dcfbcdfa289d None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:45.635054 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02dd440-ebd5-428c-a0c3-dcfbcdfa289d None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:45.639846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625ccca-e7c0-43ac-b84a-f14fde5b9a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:45.641241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625ccca-e7c0-43ac-b84a-f14fde5b9a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:45.641643 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625ccca-e7c0-43ac-b84a-f14fde5b9a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:45.641928 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3625ccca-e7c0-43ac-b84a-f14fde5b9a78 admin admin] PATH_INFO: `/v3/users/118b45015b00418db2ec5ecbbc8bf022` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:45.643129 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625ccca-e7c0-43ac-b84a-f14fde5b9a78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=118b45015b00418db2ec5ecbbc8bf022)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:45.645090 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3625ccca-e7c0-43ac-b84a-f14fde5b9a78 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:45.689953 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-3625ccca-e7c0-43ac-b84a-f14fde5b9a78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '118b45015b00418db2ec5ecbbc8bf022'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:45.698465 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-3625ccca-e7c0-43ac-b84a-f14fde5b9a78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '118b45015b00418db2ec5ecbbc8bf022'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:45.699110 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-3625ccca-e7c0-43ac-b84a-f14fde5b9a78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '118b45015b00418db2ec5ecbbc8bf022'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:45.712511 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-3625ccca-e7c0-43ac-b84a-f14fde5b9a78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '118b45015b00418db2ec5ecbbc8bf022'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:45.713193 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-3625ccca-e7c0-43ac-b84a-f14fde5b9a78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '118b45015b00418db2ec5ecbbc8bf022'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:45.727197 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 895/1807] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:45 2022] DELETE /identity/v3/users/118b45015b00418db2ec5ecbbc8bf022 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:45.733908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086b071-c1fb-4229-aaee-0fbad3bd4611 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:45.734398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086b071-c1fb-4229-aaee-0fbad3bd4611 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:45.734860 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f086b071-c1fb-4229-aaee-0fbad3bd4611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:45.759915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-f086b071-c1fb-4229-aaee-0fbad3bd4611 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:45.761369 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-f086b071-c1fb-4229-aaee-0fbad3bd4611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:45.833607 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 913/1808] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:45.843431 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625ccca-e7c0-43ac-b84a-f14fde5b9a78 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:45.845505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-3625ccca-e7c0-43ac-b84a-f14fde5b9a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:45.903629 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3625ccca-e7c0-43ac-b84a-f14fde5b9a78 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:45.907824 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1954b-ddbf-4490-9926-e49fd2156fc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:45.908476 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1954b-ddbf-4490-9926-e49fd2156fc4 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:45.908759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1954b-ddbf-4490-9926-e49fd2156fc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:45.909038 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb1954b-ddbf-4490-9926-e49fd2156fc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:45.918373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1954b-ddbf-4490-9926-e49fd2156fc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:45.919932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb1954b-ddbf-4490-9926-e49fd2156fc4 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:45.925758 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:45.931945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 896/1809] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:46.219173 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086b071-c1fb-4229-aaee-0fbad3bd4611 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:46.221827 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-f086b071-c1fb-4229-aaee-0fbad3bd4611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:46.236776 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f086b071-c1fb-4229-aaee-0fbad3bd4611 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:46.241791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80838e1-f2f6-4617-abe2-79c4edef11cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:46.242667 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80838e1-f2f6-4617-abe2-79c4edef11cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:46.242954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80838e1-f2f6-4617-abe2-79c4edef11cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:46.243233 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80838e1-f2f6-4617-abe2-79c4edef11cc admin admin] PATH_INFO: `/v3/projects/9a6665c56b254e1b9f604cef3c98b061` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:46.244472 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80838e1-f2f6-4617-abe2-79c4edef11cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a6665c56b254e1b9f604cef3c98b061)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:46.246762 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80838e1-f2f6-4617-abe2-79c4edef11cc admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:46.295516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-d80838e1-f2f6-4617-abe2-79c4edef11cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a6665c56b254e1b9f604cef3c98b061', 'request_id': 'req-d80838e1-f2f6-4617-abe2-79c4edef11cc'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:46.297663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:INSERT=4,keystone:SELECT=91,keystone:DELETE=5 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:46.302672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-d80838e1-f2f6-4617-abe2-79c4edef11cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a6665c56b254e1b9f604cef3c98b061', 'request_id': 'req-d80838e1-f2f6-4617-abe2-79c4edef11cc'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:46.314379 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-d80838e1-f2f6-4617-abe2-79c4edef11cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a6665c56b254e1b9f604cef3c98b061', 'request_id': 'req-d80838e1-f2f6-4617-abe2-79c4edef11cc'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:46.327393 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-d80838e1-f2f6-4617-abe2-79c4edef11cc admin admin] The token cache is being invalidate because project 9a6665c56b254e1b9f604cef3c98b061 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:46.327720 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-d80838e1-f2f6-4617-abe2-79c4edef11cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:46.328997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-d80838e1-f2f6-4617-abe2-79c4edef11cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:46.330756 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 914/1810] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:46 2022] DELETE /identity/v3/projects/9a6665c56b254e1b9f604cef3c98b061 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:46.334975 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1954b-ddbf-4490-9926-e49fd2156fc4 service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:46.348351 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb1954b-ddbf-4490-9926-e49fd2156fc4 service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:46.409177 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e155a5-862e-4d16-ad72-995c37e87ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:46.410067 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e155a5-862e-4d16-ad72-995c37e87ff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:46.410348 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e155a5-862e-4d16-ad72-995c37e87ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:46.410623 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e155a5-862e-4d16-ad72-995c37e87ff4 admin admin] PATH_INFO: `/v3/users/0860d9bc3ccb4fae95c37e0785a1e5cc` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:46.412197 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e155a5-862e-4d16-ad72-995c37e87ff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0860d9bc3ccb4fae95c37e0785a1e5cc)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:46.414568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e155a5-862e-4d16-ad72-995c37e87ff4 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:46.479855 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-06e155a5-862e-4d16-ad72-995c37e87ff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0860d9bc3ccb4fae95c37e0785a1e5cc'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:46.489935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-06e155a5-862e-4d16-ad72-995c37e87ff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0860d9bc3ccb4fae95c37e0785a1e5cc'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:46.490992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-06e155a5-862e-4d16-ad72-995c37e87ff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0860d9bc3ccb4fae95c37e0785a1e5cc'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:46.506710 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-06e155a5-862e-4d16-ad72-995c37e87ff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0860d9bc3ccb4fae95c37e0785a1e5cc'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:46.507597 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-06e155a5-862e-4d16-ad72-995c37e87ff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0860d9bc3ccb4fae95c37e0785a1e5cc'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:46.526654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 897/1811] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:26:46 2022] DELETE /identity/v3/users/0860d9bc3ccb4fae95c37e0785a1e5cc => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:46.816709 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80838e1-f2f6-4617-abe2-79c4edef11cc admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:46.818838 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-d80838e1-f2f6-4617-abe2-79c4edef11cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:46.848564 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80838e1-f2f6-4617-abe2-79c4edef11cc admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:46.909044 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2343c42-528f-43e3-be06-2a0d55b0f178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:46.909918 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2343c42-528f-43e3-be06-2a0d55b0f178 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:46.910200 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2343c42-528f-43e3-be06-2a0d55b0f178 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:46.910473 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2343c42-528f-43e3-be06-2a0d55b0f178 admin admin] PATH_INFO: `/v3/projects/1e68bf350e334538a1c73fa8f58f84a0` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:46.911682 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2343c42-528f-43e3-be06-2a0d55b0f178 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e68bf350e334538a1c73fa8f58f84a0)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:46.913594 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2343c42-528f-43e3-be06-2a0d55b0f178 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:47.094797 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-f2343c42-528f-43e3-be06-2a0d55b0f178 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e68bf350e334538a1c73fa8f58f84a0', 'request_id': 'req-f2343c42-528f-43e3-be06-2a0d55b0f178'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:47.101016 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-f2343c42-528f-43e3-be06-2a0d55b0f178 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e68bf350e334538a1c73fa8f58f84a0', 'request_id': 'req-f2343c42-528f-43e3-be06-2a0d55b0f178'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:47.107664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-f2343c42-528f-43e3-be06-2a0d55b0f178 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e68bf350e334538a1c73fa8f58f84a0', 'request_id': 'req-f2343c42-528f-43e3-be06-2a0d55b0f178'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:47.121869 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-f2343c42-528f-43e3-be06-2a0d55b0f178 admin admin] The token cache is being invalidate because project 1e68bf350e334538a1c73fa8f58f84a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:26:47.122333 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-f2343c42-528f-43e3-be06-2a0d55b0f178 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:47.123178 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-f2343c42-528f-43e3-be06-2a0d55b0f178 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:26:47.124866 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 915/1812] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:26:46 2022] DELETE /identity/v3/projects/1e68bf350e334538a1c73fa8f58f84a0 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:47.129693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a87dc4-b085-40fc-9b41-f3660c29c8c1 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:47.130254 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a87dc4-b085-40fc-9b41-f3660c29c8c1 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:47.130693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a87dc4-b085-40fc-9b41-f3660c29c8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:47.161692 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-74a87dc4-b085-40fc-9b41-f3660c29c8c1 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:47.163042 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-74a87dc4-b085-40fc-9b41-f3660c29c8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:47.229110 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 898/1813] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:47.237172 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c799eb-f653-4dd1-abe8-94a918177ca9 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:47.237464 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c799eb-f653-4dd1-abe8-94a918177ca9 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:47.237742 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c799eb-f653-4dd1-abe8-94a918177ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:47.275387 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-c9c799eb-f653-4dd1-abe8-94a918177ca9 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:47.277936 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-c9c799eb-f653-4dd1-abe8-94a918177ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:47.289961 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 916/1814] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:47.294115 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a87dc4-b085-40fc-9b41-f3660c29c8c1 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:47.305955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a87dc4-b085-40fc-9b41-f3660c29c8c1 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:47.310584 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f20e91-264f-41f7-aa60-0c11ca2f6230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:47.311240 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f20e91-264f-41f7-aa60-0c11ca2f6230 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:47.311525 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f20e91-264f-41f7-aa60-0c11ca2f6230 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:47.311842 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f20e91-264f-41f7-aa60-0c11ca2f6230 admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:47.312658 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f20e91-264f-41f7-aa60-0c11ca2f6230 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:26:47.312969 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f20e91-264f-41f7-aa60-0c11ca2f6230 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:47.314587 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f20e91-264f-41f7-aa60-0c11ca2f6230 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:47.326443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 899/1815] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:26:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:26:47.331372 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c799eb-f653-4dd1-abe8-94a918177ca9 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:47.340754 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c799eb-f653-4dd1-abe8-94a918177ca9 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:47.345981 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13904412-0b34-4829-86f5-5de77ebeba8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:47.346631 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13904412-0b34-4829-86f5-5de77ebeba8d admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:47.346919 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13904412-0b34-4829-86f5-5de77ebeba8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:47.347201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13904412-0b34-4829-86f5-5de77ebeba8d admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:47.347940 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13904412-0b34-4829-86f5-5de77ebeba8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:47.349894 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13904412-0b34-4829-86f5-5de77ebeba8d admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:47.375015 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 917/1816] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:47 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:26:47.379449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f20e91-264f-41f7-aa60-0c11ca2f6230 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:47.389663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f20e91-264f-41f7-aa60-0c11ca2f6230 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:47.393708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:47.447936 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d3806-7ad2-4ce8-a8b4-3a17fa54347e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:47.448730 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d3806-7ad2-4ce8-a8b4-3a17fa54347e admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:47.449122 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d3806-7ad2-4ce8-a8b4-3a17fa54347e admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:47.449496 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d3806-7ad2-4ce8-a8b4-3a17fa54347e admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:47.450268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d3806-7ad2-4ce8-a8b4-3a17fa54347e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:47.452453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32d3806-7ad2-4ce8-a8b4-3a17fa54347e admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:47.473482 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 900/1817] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:47 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:47.477668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13904412-0b34-4829-86f5-5de77ebeba8d admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:47.487788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13904412-0b34-4829-86f5-5de77ebeba8d admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:47.492178 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8b94d-8a7b-44b1-ba10-7a0825238154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:47.492828 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8b94d-8a7b-44b1-ba10-7a0825238154 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:47.493108 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8b94d-8a7b-44b1-ba10-7a0825238154 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:47.493379 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd8b94d-8a7b-44b1-ba10-7a0825238154 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:47.494100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8b94d-8a7b-44b1-ba10-7a0825238154 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:47.495709 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd8b94d-8a7b-44b1-ba10-7a0825238154 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:47.505812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 918/1818] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:47.509406 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d3806-7ad2-4ce8-a8b4-3a17fa54347e admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:47.519758 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d3806-7ad2-4ce8-a8b4-3a17fa54347e admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:47.524257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db25b09-9311-48f0-bc73-27b4d6148c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:47.524899 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db25b09-9311-48f0-bc73-27b4d6148c07 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:47.525183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db25b09-9311-48f0-bc73-27b4d6148c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:47.525460 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db25b09-9311-48f0-bc73-27b4d6148c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:47.526174 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db25b09-9311-48f0-bc73-27b4d6148c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:47.527787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db25b09-9311-48f0-bc73-27b4d6148c07 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:47.537375 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 901/1819] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:47.541309 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8b94d-8a7b-44b1-ba10-7a0825238154 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:47.550827 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd8b94d-8a7b-44b1-ba10-7a0825238154 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:47.555310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f587750-268e-4055-a941-599f5b297bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:47.556201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f587750-268e-4055-a941-599f5b297bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:47.556479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f587750-268e-4055-a941-599f5b297bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:47.556754 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f587750-268e-4055-a941-599f5b297bbe admin admin] PATH_INFO: `/v3/projects/8b63ee7b958a4bb2bdd48b34f8284181/users/fed981514ac540c98d58560422ca8660/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:47.572196 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f587750-268e-4055-a941-599f5b297bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b63ee7b958a4bb2bdd48b34f8284181, user_id=fed981514ac540c98d58560422ca8660, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:47.574907 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f587750-268e-4055-a941-599f5b297bbe admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:47.588788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 919/1820] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:47 2022] PUT /identity/v3/projects/8b63ee7b958a4bb2bdd48b34f8284181/users/fed981514ac540c98d58560422ca8660/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:26:47.599145 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860cf8c-6ceb-4a98-97d8-cfa1214878c9 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:47.599443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860cf8c-6ceb-4a98-97d8-cfa1214878c9 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:47.599748 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2860cf8c-6ceb-4a98-97d8-cfa1214878c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:47.628866 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-2860cf8c-6ceb-4a98-97d8-cfa1214878c9 None None] MFA Rules not processed for user `fed981514ac540c98d58560422ca8660`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:47.630072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-2860cf8c-6ceb-4a98-97d8-cfa1214878c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:47.699009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 902/1821] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:47.704512 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f587750-268e-4055-a941-599f5b297bbe admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:47.714001 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:47.772235 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f587750-268e-4055-a941-599f5b297bbe admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:47.776794 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddfded-73b2-4cbc-a344-b1d014af61a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:47.777447 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddfded-73b2-4cbc-a344-b1d014af61a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:47.777731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddfded-73b2-4cbc-a344-b1d014af61a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:47.778136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ddfded-73b2-4cbc-a344-b1d014af61a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:47.778826 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ddfded-73b2-4cbc-a344-b1d014af61a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:47.780740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ddfded-73b2-4cbc-a344-b1d014af61a4 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:47.808327 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 920/1822] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:26:47 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:47.812531 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2860cf8c-6ceb-4a98-97d8-cfa1214878c9 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:47.823155 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2860cf8c-6ceb-4a98-97d8-cfa1214878c9 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:47.878189 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d5d63-a0ff-442d-a154-68d7ec508512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:47.878863 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d5d63-a0ff-442d-a154-68d7ec508512 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:47.879153 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d5d63-a0ff-442d-a154-68d7ec508512 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:47.879436 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d5d63-a0ff-442d-a154-68d7ec508512 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:47.880177 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d5d63-a0ff-442d-a154-68d7ec508512 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:47.882113 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d5d63-a0ff-442d-a154-68d7ec508512 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:47.902293 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 903/1823] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:26:47 2022] POST /identity/v3/users => generated 298 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:26:47.907045 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddfded-73b2-4cbc-a344-b1d014af61a4 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:47.917544 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ddfded-73b2-4cbc-a344-b1d014af61a4 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:47.922191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc8049-326d-454d-8830-f7deeaa9fedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:47.923897 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc8049-326d-454d-8830-f7deeaa9fedc admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:47.923897 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc8049-326d-454d-8830-f7deeaa9fedc admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:47.923897 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacc8049-326d-454d-8830-f7deeaa9fedc admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:47.924188 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc8049-326d-454d-8830-f7deeaa9fedc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:47.925720 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacc8049-326d-454d-8830-f7deeaa9fedc admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:47.935589 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 921/1824] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:26:47.939738 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d5d63-a0ff-442d-a154-68d7ec508512 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:47.946241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:47.950463 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d5d63-a0ff-442d-a154-68d7ec508512 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:47.955631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51841cab-5f1b-43d2-b4d6-7ee08bc0efcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:47.956562 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51841cab-5f1b-43d2-b4d6-7ee08bc0efcb admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:47.956842 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51841cab-5f1b-43d2-b4d6-7ee08bc0efcb admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:47.957117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51841cab-5f1b-43d2-b4d6-7ee08bc0efcb admin admin] PATH_INFO: `/v3/projects/e6a564c5c00c43689168301fb8e7a9c2/users/3227e24a10c74ea9bb447b2ba3620a51/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:47.973911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51841cab-5f1b-43d2-b4d6-7ee08bc0efcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6a564c5c00c43689168301fb8e7a9c2, user_id=3227e24a10c74ea9bb447b2ba3620a51, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:47.976659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51841cab-5f1b-43d2-b4d6-7ee08bc0efcb admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:47.989689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 904/1825] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:47 2022] PUT /identity/v3/projects/e6a564c5c00c43689168301fb8e7a9c2/users/3227e24a10c74ea9bb447b2ba3620a51/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:47.993637 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc8049-326d-454d-8830-f7deeaa9fedc admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:48.003638 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacc8049-326d-454d-8830-f7deeaa9fedc admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:48.061144 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1563a-6ef9-4bf1-b726-7a9a0d26ed1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:48.061812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1563a-6ef9-4bf1-b726-7a9a0d26ed1d admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:48.062093 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1563a-6ef9-4bf1-b726-7a9a0d26ed1d admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:48.062369 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1563a-6ef9-4bf1-b726-7a9a0d26ed1d admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:48.063702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1563a-6ef9-4bf1-b726-7a9a0d26ed1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:48.065400 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1563a-6ef9-4bf1-b726-7a9a0d26ed1d admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:48.075116 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 922/1826] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:26:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:26:48.079251 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51841cab-5f1b-43d2-b4d6-7ee08bc0efcb admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:48.089328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51841cab-5f1b-43d2-b4d6-7ee08bc0efcb admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:48.093794 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff818eb-aa5c-4e2f-8c19-8d160f06f10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:48.094666 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff818eb-aa5c-4e2f-8c19-8d160f06f10b admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:48.094947 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff818eb-aa5c-4e2f-8c19-8d160f06f10b admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:48.095219 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff818eb-aa5c-4e2f-8c19-8d160f06f10b admin admin] PATH_INFO: `/v3/projects/e6a564c5c00c43689168301fb8e7a9c2/users/3227e24a10c74ea9bb447b2ba3620a51/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:48.097174 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff818eb-aa5c-4e2f-8c19-8d160f06f10b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6a564c5c00c43689168301fb8e7a9c2, user_id=3227e24a10c74ea9bb447b2ba3620a51, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:48.099901 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff818eb-aa5c-4e2f-8c19-8d160f06f10b admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:48.110284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 905/1827] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:26:48 2022] PUT /identity/v3/projects/e6a564c5c00c43689168301fb8e7a9c2/users/3227e24a10c74ea9bb447b2ba3620a51/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:26:48.121178 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388c6b5-733f-47cb-83dc-755ed6f58ec0 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:48.121470 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388c6b5-733f-47cb-83dc-755ed6f58ec0 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:48.121799 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9388c6b5-733f-47cb-83dc-755ed6f58ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:48.148001 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-9388c6b5-733f-47cb-83dc-755ed6f58ec0 None None] MFA Rules not processed for user `3227e24a10c74ea9bb447b2ba3620a51`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:48.149898 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-9388c6b5-733f-47cb-83dc-755ed6f58ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:48.219396 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 923/1828] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:26:48 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:26:48.230082 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff818eb-aa5c-4e2f-8c19-8d160f06f10b admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:48.231955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-5ff818eb-aa5c-4e2f-8c19-8d160f06f10b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:48.290349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff818eb-aa5c-4e2f-8c19-8d160f06f10b admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:48.294457 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3409b4d9-f1a3-4c34-8d5a-94f78568ff67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:48.294956 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409b4d9-f1a3-4c34-8d5a-94f78568ff67 service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:48.295243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409b4d9-f1a3-4c34-8d5a-94f78568ff67 service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:48.295523 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3409b4d9-f1a3-4c34-8d5a-94f78568ff67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:48.372948 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409b4d9-f1a3-4c34-8d5a-94f78568ff67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:48.374426 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3409b4d9-f1a3-4c34-8d5a-94f78568ff67 service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:48.385286 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 906/1829] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:55.978603 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9f86c-ddf5-4a0a-ab83-3cd60388bf2a None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:55.979823 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9f86c-ddf5-4a0a-ab83-3cd60388bf2a None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:55.980449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a9f86c-ddf5-4a0a-ab83-3cd60388bf2a None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:55.982077 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 924/1830] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 16 00:26:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:26:56.012174 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f5827-42d8-4836-85e8-684febfbd52a None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:56.012892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f5827-42d8-4836-85e8-684febfbd52a None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:56.012998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50f5827-42d8-4836-85e8-684febfbd52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:56.031376 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-a50f5827-42d8-4836-85e8-684febfbd52a None None] MFA Rules not processed for user `40432493f16b4df681daf5a1af87832a`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:26:56.032631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a50f5827-42d8-4836-85e8-684febfbd52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:56.188743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 907/1831] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 16 00:26:56 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:26:56.201024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9f86c-ddf5-4a0a-ab83-3cd60388bf2a None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:56.204280 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-96a9f86c-ddf5-4a0a-ab83-3cd60388bf2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:56.219806 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:56.233283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a9f86c-ddf5-4a0a-ab83-3cd60388bf2a None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:56.242393 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0115d37-5906-46f8-9c75-b1003b3b1554 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:56.244905 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0115d37-5906-46f8-9c75-b1003b3b1554 service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:56.245557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0115d37-5906-46f8-9c75-b1003b3b1554 service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:56.246267 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0115d37-5906-46f8-9c75-b1003b3b1554 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:56.264092 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0115d37-5906-46f8-9c75-b1003b3b1554 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:56.267178 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0115d37-5906-46f8-9c75-b1003b3b1554 service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:56.303650 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 925/1832] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:26:59.290448 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f5827-42d8-4836-85e8-684febfbd52a None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:26:59.292974 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a50f5827-42d8-4836-85e8-684febfbd52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:26:59.306482 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50f5827-42d8-4836-85e8-684febfbd52a None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:26:59.317966 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68329555-5b2f-41a7-8bbf-7461d9aeb759 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:26:59.317966 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68329555-5b2f-41a7-8bbf-7461d9aeb759 service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:26:59.317966 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68329555-5b2f-41a7-8bbf-7461d9aeb759 service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:26:59.321344 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68329555-5b2f-41a7-8bbf-7461d9aeb759 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:26:59.335961 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68329555-5b2f-41a7-8bbf-7461d9aeb759 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:26:59.338259 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68329555-5b2f-41a7-8bbf-7461d9aeb759 service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:26:59.346906 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:26:59.374487 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 908/1833] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:26:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:27:04.096048 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0115d37-5906-46f8-9c75-b1003b3b1554 service nova] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:04.100652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-d0115d37-5906-46f8-9c75-b1003b3b1554 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:04.176853 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0115d37-5906-46f8-9c75-b1003b3b1554 service nova] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:04.181478 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2982818-4215-4ce9-99a5-e67ae6a13d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:04.182419 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2982818-4215-4ce9-99a5-e67ae6a13d4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:04.182735 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2982818-4215-4ce9-99a5-e67ae6a13d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:04.182987 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2982818-4215-4ce9-99a5-e67ae6a13d4b admin admin] PATH_INFO: `/v3/users/be49b676d10c46b2a8fd36123e5fef92` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:04.184353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2982818-4215-4ce9-99a5-e67ae6a13d4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=be49b676d10c46b2a8fd36123e5fef92)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:04.186830 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2982818-4215-4ce9-99a5-e67ae6a13d4b admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:04.237924 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-a2982818-4215-4ce9-99a5-e67ae6a13d4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be49b676d10c46b2a8fd36123e5fef92'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:04.246579 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-a2982818-4215-4ce9-99a5-e67ae6a13d4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be49b676d10c46b2a8fd36123e5fef92'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:04.247478 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-a2982818-4215-4ce9-99a5-e67ae6a13d4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be49b676d10c46b2a8fd36123e5fef92'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:04.248141 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-a2982818-4215-4ce9-99a5-e67ae6a13d4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be49b676d10c46b2a8fd36123e5fef92'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:04.261519 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-a2982818-4215-4ce9-99a5-e67ae6a13d4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be49b676d10c46b2a8fd36123e5fef92'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:04.275452 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 926/1834] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:04 2022] DELETE /identity/v3/users/be49b676d10c46b2a8fd36123e5fef92 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:04.280641 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fc0cf-16be-4b89-a1d4-06113e9df898 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:04.281163 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fc0cf-16be-4b89-a1d4-06113e9df898 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:04.281290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80fc0cf-16be-4b89-a1d4-06113e9df898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:04.298919 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-e80fc0cf-16be-4b89-a1d4-06113e9df898 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:04.300188 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e80fc0cf-16be-4b89-a1d4-06113e9df898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:04.362998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 909/1835] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:04.372524 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2982818-4215-4ce9-99a5-e67ae6a13d4b admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:04.373923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-a2982818-4215-4ce9-99a5-e67ae6a13d4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:04.430600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2982818-4215-4ce9-99a5-e67ae6a13d4b admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:04.434287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877d75e-668a-46ae-a2ee-8c3f8d16a2ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:04.434969 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877d75e-668a-46ae-a2ee-8c3f8d16a2ac service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:04.435286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877d75e-668a-46ae-a2ee-8c3f8d16a2ac service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:04.435571 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877d75e-668a-46ae-a2ee-8c3f8d16a2ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:04.444723 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877d75e-668a-46ae-a2ee-8c3f8d16a2ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:04.446087 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a877d75e-668a-46ae-a2ee-8c3f8d16a2ac service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:04.455842 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 927/1836] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:04.742843 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fc0cf-16be-4b89-a1d4-06113e9df898 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:04.744389 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e80fc0cf-16be-4b89-a1d4-06113e9df898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:04.760958 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80fc0cf-16be-4b89-a1d4-06113e9df898 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:04.767389 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e84626-3f42-42d0-91a7-3224efb33249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:04.768298 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e84626-3f42-42d0-91a7-3224efb33249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:04.769292 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e84626-3f42-42d0-91a7-3224efb33249 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:04.769680 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e84626-3f42-42d0-91a7-3224efb33249 admin admin] PATH_INFO: `/v3/projects/be2c6085edee42378aec2135f9868e4a` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:04.770915 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e84626-3f42-42d0-91a7-3224efb33249 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2c6085edee42378aec2135f9868e4a)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:04.773119 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e84626-3f42-42d0-91a7-3224efb33249 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:04.823870 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a9e84626-3f42-42d0-91a7-3224efb33249 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2c6085edee42378aec2135f9868e4a', 'request_id': 'req-a9e84626-3f42-42d0-91a7-3224efb33249'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:04.829350 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a9e84626-3f42-42d0-91a7-3224efb33249 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2c6085edee42378aec2135f9868e4a', 'request_id': 'req-a9e84626-3f42-42d0-91a7-3224efb33249'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:04.835290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a9e84626-3f42-42d0-91a7-3224efb33249 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2c6085edee42378aec2135f9868e4a', 'request_id': 'req-a9e84626-3f42-42d0-91a7-3224efb33249'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:04.847405 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a9e84626-3f42-42d0-91a7-3224efb33249 admin admin] The token cache is being invalidate because project be2c6085edee42378aec2135f9868e4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:04.847717 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a9e84626-3f42-42d0-91a7-3224efb33249 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:04.848340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a9e84626-3f42-42d0-91a7-3224efb33249 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:04.849877 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 910/1837] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:04 2022] DELETE /identity/v3/projects/be2c6085edee42378aec2135f9868e4a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:04.853900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877d75e-668a-46ae-a2ee-8c3f8d16a2ac service neutron] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:04.864068 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877d75e-668a-46ae-a2ee-8c3f8d16a2ac service neutron] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:04.872364 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:04.922738 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399442c5-acf1-4625-91a6-abf9d8d55000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:04.923622 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399442c5-acf1-4625-91a6-abf9d8d55000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:04.923916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399442c5-acf1-4625-91a6-abf9d8d55000 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:04.924218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399442c5-acf1-4625-91a6-abf9d8d55000 admin admin] PATH_INFO: `/v3/users/9b3ec374a241412884985735bd6187fb` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:04.925398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399442c5-acf1-4625-91a6-abf9d8d55000 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b3ec374a241412884985735bd6187fb)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:04.927302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399442c5-acf1-4625-91a6-abf9d8d55000 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:04.973035 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-399442c5-acf1-4625-91a6-abf9d8d55000 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b3ec374a241412884985735bd6187fb'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:04.979859 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-399442c5-acf1-4625-91a6-abf9d8d55000 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b3ec374a241412884985735bd6187fb'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:04.980575 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-399442c5-acf1-4625-91a6-abf9d8d55000 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b3ec374a241412884985735bd6187fb'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:04.981185 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-399442c5-acf1-4625-91a6-abf9d8d55000 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b3ec374a241412884985735bd6187fb'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:04.993433 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-399442c5-acf1-4625-91a6-abf9d8d55000 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b3ec374a241412884985735bd6187fb'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:05.005989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 928/1838] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:04 2022] DELETE /identity/v3/users/9b3ec374a241412884985735bd6187fb => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:05.368434 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e84626-3f42-42d0-91a7-3224efb33249 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:05.369996 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a9e84626-3f42-42d0-91a7-3224efb33249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:05.385936 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e84626-3f42-42d0-91a7-3224efb33249 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:05.459180 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb099343-1707-45a4-a1a8-0727ec08162b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:05.460087 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb099343-1707-45a4-a1a8-0727ec08162b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:05.460371 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb099343-1707-45a4-a1a8-0727ec08162b admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:05.460645 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb099343-1707-45a4-a1a8-0727ec08162b admin admin] PATH_INFO: `/v3/projects/53276fa1749d469b8c76cb5b6d4d521f` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:05.461819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb099343-1707-45a4-a1a8-0727ec08162b admin admin] RBAC: Authorizing `identity:delete_project(project_id=53276fa1749d469b8c76cb5b6d4d521f)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:05.463755 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb099343-1707-45a4-a1a8-0727ec08162b admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:05.495164 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:05.515392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-eb099343-1707-45a4-a1a8-0727ec08162b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53276fa1749d469b8c76cb5b6d4d521f', 'request_id': 'req-eb099343-1707-45a4-a1a8-0727ec08162b'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:05.521319 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-eb099343-1707-45a4-a1a8-0727ec08162b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53276fa1749d469b8c76cb5b6d4d521f', 'request_id': 'req-eb099343-1707-45a4-a1a8-0727ec08162b'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:05.527645 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-eb099343-1707-45a4-a1a8-0727ec08162b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53276fa1749d469b8c76cb5b6d4d521f', 'request_id': 'req-eb099343-1707-45a4-a1a8-0727ec08162b'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:05.540606 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-eb099343-1707-45a4-a1a8-0727ec08162b admin admin] The token cache is being invalidate because project 53276fa1749d469b8c76cb5b6d4d521f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:05.540895 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-eb099343-1707-45a4-a1a8-0727ec08162b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:05.541532 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-eb099343-1707-45a4-a1a8-0727ec08162b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:05.543314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 911/1839] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:05 2022] DELETE /identity/v3/projects/53276fa1749d469b8c76cb5b6d4d521f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:05.548158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb5a91-ab4c-4909-9288-1b8060500f96 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:05.548647 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb5a91-ab4c-4909-9288-1b8060500f96 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:05.548741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb5a91-ab4c-4909-9288-1b8060500f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:05.567658 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-edbb5a91-ab4c-4909-9288-1b8060500f96 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:05.568471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-edbb5a91-ab4c-4909-9288-1b8060500f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:05.632715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 929/1840] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:05.641346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067da24-b2ff-4f1e-afe9-53ea0ffe0360 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:05.641640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067da24-b2ff-4f1e-afe9-53ea0ffe0360 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:05.641917 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067da24-b2ff-4f1e-afe9-53ea0ffe0360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:05.659658 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-b067da24-b2ff-4f1e-afe9-53ea0ffe0360 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:05.660854 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-b067da24-b2ff-4f1e-afe9-53ea0ffe0360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:05.668597 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 912/1841] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:05.672743 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb5a91-ab4c-4909-9288-1b8060500f96 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:05.682460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb5a91-ab4c-4909-9288-1b8060500f96 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:05.687570 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a67bf0-0dac-43e4-becb-e5cba79877ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:05.689614 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a67bf0-0dac-43e4-becb-e5cba79877ad admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:05.689910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a67bf0-0dac-43e4-becb-e5cba79877ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:05.690193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a67bf0-0dac-43e4-becb-e5cba79877ad admin admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:05.691266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a67bf0-0dac-43e4-becb-e5cba79877ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:05.691266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a67bf0-0dac-43e4-becb-e5cba79877ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:05.692947 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a67bf0-0dac-43e4-becb-e5cba79877ad admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:05.705623 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 930/1842] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:27:05.709881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067da24-b2ff-4f1e-afe9-53ea0ffe0360 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:05.719581 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b067da24-b2ff-4f1e-afe9-53ea0ffe0360 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:05.724366 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4c3c8-c619-458f-b58c-00101d95a5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:05.725185 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4c3c8-c619-458f-b58c-00101d95a5d5 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:05.725474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4c3c8-c619-458f-b58c-00101d95a5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:05.725753 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f4c3c8-c619-458f-b58c-00101d95a5d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:05.726462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4c3c8-c619-458f-b58c-00101d95a5d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:05.728624 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f4c3c8-c619-458f-b58c-00101d95a5d5 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:05.754319 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 913/1843] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:05 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:05.758639 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a67bf0-0dac-43e4-becb-e5cba79877ad admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:05.769203 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a67bf0-0dac-43e4-becb-e5cba79877ad admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:05.788210 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:05.840254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2fea6-bedb-4fdd-9618-3f678822bdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:05.840934 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2fea6-bedb-4fdd-9618-3f678822bdaa admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:05.841224 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2fea6-bedb-4fdd-9618-3f678822bdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:05.841502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd2fea6-bedb-4fdd-9618-3f678822bdaa admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:05.842204 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2fea6-bedb-4fdd-9618-3f678822bdaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:05.844155 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd2fea6-bedb-4fdd-9618-3f678822bdaa admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:05.863822 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 931/1844] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:05 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:27:05.867904 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4c3c8-c619-458f-b58c-00101d95a5d5 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:05.878750 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f4c3c8-c619-458f-b58c-00101d95a5d5 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:05.883327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e5f3c-54fc-4e9a-a2ea-ce2fc57f772b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:05.884028 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e5f3c-54fc-4e9a-a2ea-ce2fc57f772b admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:05.884330 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e5f3c-54fc-4e9a-a2ea-ce2fc57f772b admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:05.884594 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e5f3c-54fc-4e9a-a2ea-ce2fc57f772b admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:05.885347 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e5f3c-54fc-4e9a-a2ea-ce2fc57f772b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:05.886947 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e5f3c-54fc-4e9a-a2ea-ce2fc57f772b admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:05.897548 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 914/1845] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:05.901475 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2fea6-bedb-4fdd-9618-3f678822bdaa admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:05.911200 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd2fea6-bedb-4fdd-9618-3f678822bdaa admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:05.915864 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ae1413-fff6-44d2-89fb-e0d2f5dc6aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:05.916518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae1413-fff6-44d2-89fb-e0d2f5dc6aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:05.916809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae1413-fff6-44d2-89fb-e0d2f5dc6aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:05.917094 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ae1413-fff6-44d2-89fb-e0d2f5dc6aa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:05.917821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae1413-fff6-44d2-89fb-e0d2f5dc6aa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:05.919417 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ae1413-fff6-44d2-89fb-e0d2f5dc6aa1 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:05.930452 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 932/1846] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:05.934578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e5f3c-54fc-4e9a-a2ea-ce2fc57f772b admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:05.945139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e5f3c-54fc-4e9a-a2ea-ce2fc57f772b admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:05.949805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb9934-89dc-4b03-a867-69551528e731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:05.950689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb9934-89dc-4b03-a867-69551528e731 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:05.950979 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb9934-89dc-4b03-a867-69551528e731 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:05.951261 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cb9934-89dc-4b03-a867-69551528e731 admin admin] PATH_INFO: `/v3/projects/b7b611f7424346948d635859e7cec7e7/users/fb94367fb81e4402aabdcd73a0255fda/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:05.965745 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb9934-89dc-4b03-a867-69551528e731 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7b611f7424346948d635859e7cec7e7, user_id=fb94367fb81e4402aabdcd73a0255fda, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:05.968478 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cb9934-89dc-4b03-a867-69551528e731 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:05.981200 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 915/1847] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:05 2022] PUT /identity/v3/projects/b7b611f7424346948d635859e7cec7e7/users/fb94367fb81e4402aabdcd73a0255fda/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:27:05.992124 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd340a-fbf5-4f18-ad3e-b0335c8e73dc None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:05.992416 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd340a-fbf5-4f18-ad3e-b0335c8e73dc None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:05.992699 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacd340a-fbf5-4f18-ad3e-b0335c8e73dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:06.018850 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-cacd340a-fbf5-4f18-ad3e-b0335c8e73dc None None] MFA Rules not processed for user `fb94367fb81e4402aabdcd73a0255fda`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:06.020155 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-cacd340a-fbf5-4f18-ad3e-b0335c8e73dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:06.081450 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 933/1848] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:06.086158 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb9934-89dc-4b03-a867-69551528e731 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:06.146365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cb9934-89dc-4b03-a867-69551528e731 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:06.150980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8107d-2213-4d63-b363-94f4dd5e0292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:06.151652 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8107d-2213-4d63-b363-94f4dd5e0292 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:06.151942 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8107d-2213-4d63-b363-94f4dd5e0292 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:06.152219 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df8107d-2213-4d63-b363-94f4dd5e0292 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:06.152911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8107d-2213-4d63-b363-94f4dd5e0292 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:06.154834 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df8107d-2213-4d63-b363-94f4dd5e0292 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:06.179397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 916/1849] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:06 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:06.183520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd340a-fbf5-4f18-ad3e-b0335c8e73dc None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:06.194202 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacd340a-fbf5-4f18-ad3e-b0335c8e73dc None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:06.250054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace3a7c-e02d-456d-91f2-258b3e6111f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:06.250726 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace3a7c-e02d-456d-91f2-258b3e6111f9 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:06.251013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace3a7c-e02d-456d-91f2-258b3e6111f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:06.251289 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ace3a7c-e02d-456d-91f2-258b3e6111f9 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:06.252018 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace3a7c-e02d-456d-91f2-258b3e6111f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:06.253965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ace3a7c-e02d-456d-91f2-258b3e6111f9 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:06.274778 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 934/1850] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:06 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:27:06.278853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8107d-2213-4d63-b363-94f4dd5e0292 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:06.289803 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df8107d-2213-4d63-b363-94f4dd5e0292 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:06.294561 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad767f98-e888-424b-a472-7a3ff367f0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:06.295322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad767f98-e888-424b-a472-7a3ff367f0e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:06.296244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad767f98-e888-424b-a472-7a3ff367f0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:06.296608 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad767f98-e888-424b-a472-7a3ff367f0e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:06.297402 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad767f98-e888-424b-a472-7a3ff367f0e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:06.299096 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad767f98-e888-424b-a472-7a3ff367f0e6 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:06.310235 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 917/1851] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:06.316142 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace3a7c-e02d-456d-91f2-258b3e6111f9 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:06.327577 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ace3a7c-e02d-456d-91f2-258b3e6111f9 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:06.335626 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5afeb-785f-403b-a8f9-2ec12a747448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:06.336321 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5afeb-785f-403b-a8f9-2ec12a747448 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:06.336611 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5afeb-785f-403b-a8f9-2ec12a747448 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:06.336894 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5afeb-785f-403b-a8f9-2ec12a747448 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:06.337627 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5afeb-785f-403b-a8f9-2ec12a747448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:06.339236 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5afeb-785f-403b-a8f9-2ec12a747448 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:06.351558 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 935/1852] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:06.355699 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad767f98-e888-424b-a472-7a3ff367f0e6 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:06.366225 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad767f98-e888-424b-a472-7a3ff367f0e6 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:06.377562 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22928c-4e56-451b-9a09-675cebcfefda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:06.378476 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22928c-4e56-451b-9a09-675cebcfefda admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:06.378764 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22928c-4e56-451b-9a09-675cebcfefda admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:06.379043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f22928c-4e56-451b-9a09-675cebcfefda admin admin] PATH_INFO: `/v3/projects/f3dca9054d164427b6d8252e3989ac3f/users/8c13f8986f9c457d86d5fa56348e0788/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:06.395683 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f22928c-4e56-451b-9a09-675cebcfefda admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3dca9054d164427b6d8252e3989ac3f, user_id=8c13f8986f9c457d86d5fa56348e0788, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:06.398234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f22928c-4e56-451b-9a09-675cebcfefda admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:06.408944 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:06.415484 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 918/1853] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:06 2022] PUT /identity/v3/projects/f3dca9054d164427b6d8252e3989ac3f/users/8c13f8986f9c457d86d5fa56348e0788/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:06.427325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898308c6-cd08-4d0c-96a5-7e6296c91b71 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:06.427585 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898308c6-cd08-4d0c-96a5-7e6296c91b71 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:06.427895 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898308c6-cd08-4d0c-96a5-7e6296c91b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:06.436486 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:06.458317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-898308c6-cd08-4d0c-96a5-7e6296c91b71 None None] MFA Rules not processed for user `8c13f8986f9c457d86d5fa56348e0788`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:06.459529 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-898308c6-cd08-4d0c-96a5-7e6296c91b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:06.524613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 936/1854] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:27:06.528972 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22928c-4e56-451b-9a09-675cebcfefda admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:06.591397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f22928c-4e56-451b-9a09-675cebcfefda admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:06.596969 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aaacf6-1757-4bfb-9405-6e6391ef6ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:06.597638 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaacf6-1757-4bfb-9405-6e6391ef6ac4 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:06.598057 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaacf6-1757-4bfb-9405-6e6391ef6ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:06.598346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aaacf6-1757-4bfb-9405-6e6391ef6ac4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:06.599047 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aaacf6-1757-4bfb-9405-6e6391ef6ac4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:06.601047 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aaacf6-1757-4bfb-9405-6e6391ef6ac4 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:06.636719 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 919/1855] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:06 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:06.638241 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898308c6-cd08-4d0c-96a5-7e6296c91b71 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:06.652496 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898308c6-cd08-4d0c-96a5-7e6296c91b71 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:06.711926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b770f3-8b4d-4fb3-8002-7f0ec706eb07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:06.712607 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b770f3-8b4d-4fb3-8002-7f0ec706eb07 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:06.712891 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b770f3-8b4d-4fb3-8002-7f0ec706eb07 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:06.713169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b770f3-8b4d-4fb3-8002-7f0ec706eb07 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:06.713866 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b770f3-8b4d-4fb3-8002-7f0ec706eb07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:06.715790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b770f3-8b4d-4fb3-8002-7f0ec706eb07 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:06.742339 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 937/1856] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:06 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:06.743694 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aaacf6-1757-4bfb-9405-6e6391ef6ac4 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:06.763791 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aaacf6-1757-4bfb-9405-6e6391ef6ac4 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:06.770312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aacde0-5f4f-42ea-9bcd-74146808ecda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:06.771199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aacde0-5f4f-42ea-9bcd-74146808ecda admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:06.771740 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aacde0-5f4f-42ea-9bcd-74146808ecda admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:06.772123 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50aacde0-5f4f-42ea-9bcd-74146808ecda admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:06.773207 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aacde0-5f4f-42ea-9bcd-74146808ecda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:06.775867 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50aacde0-5f4f-42ea-9bcd-74146808ecda admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:06.795325 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 920/1857] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:06.803266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b770f3-8b4d-4fb3-8002-7f0ec706eb07 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:06.816751 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b770f3-8b4d-4fb3-8002-7f0ec706eb07 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:06.821649 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f2602-1ab5-495e-a12c-5d449d300d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:06.822539 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f2602-1ab5-495e-a12c-5d449d300d53 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:06.822880 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f2602-1ab5-495e-a12c-5d449d300d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:06.823164 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62f2602-1ab5-495e-a12c-5d449d300d53 admin admin] PATH_INFO: `/v3/projects/11d03c10ff94444c95748905346ee8d8/users/075880ee517640dc836a5d30dd79343e/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:06.839965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f2602-1ab5-495e-a12c-5d449d300d53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11d03c10ff94444c95748905346ee8d8, user_id=075880ee517640dc836a5d30dd79343e, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:06.842698 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62f2602-1ab5-495e-a12c-5d449d300d53 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:06.855228 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 938/1858] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:06 2022] PUT /identity/v3/projects/11d03c10ff94444c95748905346ee8d8/users/075880ee517640dc836a5d30dd79343e/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:06.859736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aacde0-5f4f-42ea-9bcd-74146808ecda admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:06.869485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50aacde0-5f4f-42ea-9bcd-74146808ecda admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:06.924553 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1052325c-4f44-4baa-99b6-fbc2355d560d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:06.925219 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052325c-4f44-4baa-99b6-fbc2355d560d admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:06.925502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052325c-4f44-4baa-99b6-fbc2355d560d admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:06.925778 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1052325c-4f44-4baa-99b6-fbc2355d560d admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:06.926495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052325c-4f44-4baa-99b6-fbc2355d560d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:06.928117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1052325c-4f44-4baa-99b6-fbc2355d560d admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:06.937850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 921/1859] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:06 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:06.942020 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f2602-1ab5-495e-a12c-5d449d300d53 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:06.952995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62f2602-1ab5-495e-a12c-5d449d300d53 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:06.957665 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1c8e5-5929-4e5b-9c97-3adb45612c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:06.958539 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1c8e5-5929-4e5b-9c97-3adb45612c8a admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:06.958830 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1c8e5-5929-4e5b-9c97-3adb45612c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:06.959108 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1c8e5-5929-4e5b-9c97-3adb45612c8a admin admin] PATH_INFO: `/v3/projects/11d03c10ff94444c95748905346ee8d8/users/075880ee517640dc836a5d30dd79343e/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:06.961090 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1c8e5-5929-4e5b-9c97-3adb45612c8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=11d03c10ff94444c95748905346ee8d8, user_id=075880ee517640dc836a5d30dd79343e, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:06.963763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1c8e5-5929-4e5b-9c97-3adb45612c8a admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:06.974074 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 939/1860] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:06 2022] PUT /identity/v3/projects/11d03c10ff94444c95748905346ee8d8/users/075880ee517640dc836a5d30dd79343e/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:27:06.984930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578f5c8-8f22-4022-8eb7-bdf2bc6e5dbd None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:06.985230 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578f5c8-8f22-4022-8eb7-bdf2bc6e5dbd None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:06.985544 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c578f5c8-8f22-4022-8eb7-bdf2bc6e5dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:07.012138 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-c578f5c8-8f22-4022-8eb7-bdf2bc6e5dbd None None] MFA Rules not processed for user `075880ee517640dc836a5d30dd79343e`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:07.013591 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-c578f5c8-8f22-4022-8eb7-bdf2bc6e5dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:07.071133 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:07.080874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 922/1861] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:27:07.091366 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1c8e5-5929-4e5b-9c97-3adb45612c8a admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:07.093628 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-65a1c8e5-5929-4e5b-9c97-3adb45612c8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:07.144753 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:07.151353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1c8e5-5929-4e5b-9c97-3adb45612c8a admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:07.155942 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c795c09-21a3-47a3-9d69-1e7ca258c383 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:07.156583 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c795c09-21a3-47a3-9d69-1e7ca258c383 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:07.156867 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c795c09-21a3-47a3-9d69-1e7ca258c383 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:07.157144 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c795c09-21a3-47a3-9d69-1e7ca258c383 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:07.166066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c795c09-21a3-47a3-9d69-1e7ca258c383 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:07.167497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c795c09-21a3-47a3-9d69-1e7ca258c383 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:07.176863 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 940/1862] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:07.727845 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578f5c8-8f22-4022-8eb7-bdf2bc6e5dbd None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:07.729274 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-c578f5c8-8f22-4022-8eb7-bdf2bc6e5dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:07.741257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c578f5c8-8f22-4022-8eb7-bdf2bc6e5dbd None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:07.744817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616975e-5d1b-451c-b8e7-6d5d6bd2d03c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:07.745460 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616975e-5d1b-451c-b8e7-6d5d6bd2d03c service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:07.745746 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616975e-5d1b-451c-b8e7-6d5d6bd2d03c service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:07.746025 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616975e-5d1b-451c-b8e7-6d5d6bd2d03c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:07.808201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616975e-5d1b-451c-b8e7-6d5d6bd2d03c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:07.809695 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616975e-5d1b-451c-b8e7-6d5d6bd2d03c service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:07.819557 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 923/1863] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:09.925076 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c795c09-21a3-47a3-9d69-1e7ca258c383 service cinder] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:09.926557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-3c795c09-21a3-47a3-9d69-1e7ca258c383 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:09.989978 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c795c09-21a3-47a3-9d69-1e7ca258c383 service cinder] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:09.994434 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe9dc5-a8f9-48f8-ab9c-ece6c25ac076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:09.995394 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe9dc5-a8f9-48f8-ab9c-ece6c25ac076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:09.995726 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe9dc5-a8f9-48f8-ab9c-ece6c25ac076 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:09.995999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fe9dc5-a8f9-48f8-ab9c-ece6c25ac076 admin admin] PATH_INFO: `/v3/users/fed981514ac540c98d58560422ca8660` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:09.997239 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe9dc5-a8f9-48f8-ab9c-ece6c25ac076 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fed981514ac540c98d58560422ca8660)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:09.999780 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fe9dc5-a8f9-48f8-ab9c-ece6c25ac076 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:10.051467 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-79fe9dc5-a8f9-48f8-ab9c-ece6c25ac076 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fed981514ac540c98d58560422ca8660'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:10.063025 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-79fe9dc5-a8f9-48f8-ab9c-ece6c25ac076 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fed981514ac540c98d58560422ca8660'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:10.063680 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-79fe9dc5-a8f9-48f8-ab9c-ece6c25ac076 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fed981514ac540c98d58560422ca8660'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:10.064346 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-79fe9dc5-a8f9-48f8-ab9c-ece6c25ac076 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fed981514ac540c98d58560422ca8660'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:10.079907 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-79fe9dc5-a8f9-48f8-ab9c-ece6c25ac076 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fed981514ac540c98d58560422ca8660'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:10.095395 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 941/1864] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:09 2022] DELETE /identity/v3/users/fed981514ac540c98d58560422ca8660 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:10.099765 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871e90e-bd90-4d51-86ec-79da578825ce None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:10.100293 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871e90e-bd90-4d51-86ec-79da578825ce None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:10.100454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871e90e-bd90-4d51-86ec-79da578825ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:10.117988 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-e871e90e-bd90-4d51-86ec-79da578825ce None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:10.119209 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e871e90e-bd90-4d51-86ec-79da578825ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:10.181112 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 924/1865] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:10.203111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe9dc5-a8f9-48f8-ab9c-ece6c25ac076 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:10.206939 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-79fe9dc5-a8f9-48f8-ab9c-ece6c25ac076 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:10.308787 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fe9dc5-a8f9-48f8-ab9c-ece6c25ac076 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:10.314193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a92911-7d26-411a-9bab-9cb8b6503ef3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:10.315213 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a92911-7d26-411a-9bab-9cb8b6503ef3 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:10.315707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a92911-7d26-411a-9bab-9cb8b6503ef3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:10.316135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a92911-7d26-411a-9bab-9cb8b6503ef3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:10.329022 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a92911-7d26-411a-9bab-9cb8b6503ef3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:10.330863 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a92911-7d26-411a-9bab-9cb8b6503ef3 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:10.342175 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 942/1866] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:11.318682 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871e90e-bd90-4d51-86ec-79da578825ce None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:11.322044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e871e90e-bd90-4d51-86ec-79da578825ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:11.354505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871e90e-bd90-4d51-86ec-79da578825ce None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:11.376985 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0026576-0a3a-4b4d-ab11-744587dba50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:11.379385 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0026576-0a3a-4b4d-ab11-744587dba50c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:11.381230 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0026576-0a3a-4b4d-ab11-744587dba50c admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:11.381722 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0026576-0a3a-4b4d-ab11-744587dba50c admin admin] PATH_INFO: `/v3/projects/8b63ee7b958a4bb2bdd48b34f8284181` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:11.386449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0026576-0a3a-4b4d-ab11-744587dba50c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b63ee7b958a4bb2bdd48b34f8284181)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:11.392204 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0026576-0a3a-4b4d-ab11-744587dba50c admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:11.466089 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-e0026576-0a3a-4b4d-ab11-744587dba50c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b63ee7b958a4bb2bdd48b34f8284181', 'request_id': 'req-e0026576-0a3a-4b4d-ab11-744587dba50c'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:11.472921 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-e0026576-0a3a-4b4d-ab11-744587dba50c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b63ee7b958a4bb2bdd48b34f8284181', 'request_id': 'req-e0026576-0a3a-4b4d-ab11-744587dba50c'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:11.480703 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-e0026576-0a3a-4b4d-ab11-744587dba50c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b63ee7b958a4bb2bdd48b34f8284181', 'request_id': 'req-e0026576-0a3a-4b4d-ab11-744587dba50c'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:11.496919 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-e0026576-0a3a-4b4d-ab11-744587dba50c admin admin] The token cache is being invalidate because project 8b63ee7b958a4bb2bdd48b34f8284181 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:11.497211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-e0026576-0a3a-4b4d-ab11-744587dba50c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:11.498156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-e0026576-0a3a-4b4d-ab11-744587dba50c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:11.499848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 925/1867] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:11 2022] DELETE /identity/v3/projects/8b63ee7b958a4bb2bdd48b34f8284181 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:11.503898 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a92911-7d26-411a-9bab-9cb8b6503ef3 service neutron] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:11.515197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a92911-7d26-411a-9bab-9cb8b6503ef3 service neutron] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:11.522965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:11.573141 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c43177-cc9d-4001-9dc7-7c760d542022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:11.574012 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c43177-cc9d-4001-9dc7-7c760d542022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:11.574300 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c43177-cc9d-4001-9dc7-7c760d542022 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:11.574582 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c43177-cc9d-4001-9dc7-7c760d542022 admin admin] PATH_INFO: `/v3/users/3227e24a10c74ea9bb447b2ba3620a51` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:11.575798 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c43177-cc9d-4001-9dc7-7c760d542022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3227e24a10c74ea9bb447b2ba3620a51)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:11.578276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c43177-cc9d-4001-9dc7-7c760d542022 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:11.631450 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-92c43177-cc9d-4001-9dc7-7c760d542022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3227e24a10c74ea9bb447b2ba3620a51'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:11.640418 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-92c43177-cc9d-4001-9dc7-7c760d542022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3227e24a10c74ea9bb447b2ba3620a51'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:11.641102 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-92c43177-cc9d-4001-9dc7-7c760d542022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3227e24a10c74ea9bb447b2ba3620a51'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:11.641773 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-92c43177-cc9d-4001-9dc7-7c760d542022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3227e24a10c74ea9bb447b2ba3620a51'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:11.654382 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-92c43177-cc9d-4001-9dc7-7c760d542022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3227e24a10c74ea9bb447b2ba3620a51'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:11.666802 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 943/1868] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:11 2022] DELETE /identity/v3/users/3227e24a10c74ea9bb447b2ba3620a51 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:27:11.935512 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0026576-0a3a-4b4d-ab11-744587dba50c admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:11.937559 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e0026576-0a3a-4b4d-ab11-744587dba50c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:11.950636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0026576-0a3a-4b4d-ab11-744587dba50c admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:11.964291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:12.010968 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6b4ae0-3912-43f6-ab95-0c378f7bbceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:12.011802 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b4ae0-3912-43f6-ab95-0c378f7bbceb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:12.012337 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b4ae0-3912-43f6-ab95-0c378f7bbceb admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:12.012613 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6b4ae0-3912-43f6-ab95-0c378f7bbceb admin admin] PATH_INFO: `/v3/projects/e6a564c5c00c43689168301fb8e7a9c2` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:12.013792 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b4ae0-3912-43f6-ab95-0c378f7bbceb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6a564c5c00c43689168301fb8e7a9c2)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:12.015780 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6b4ae0-3912-43f6-ab95-0c378f7bbceb admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:12.059872 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8a6b4ae0-3912-43f6-ab95-0c378f7bbceb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6a564c5c00c43689168301fb8e7a9c2', 'request_id': 'req-8a6b4ae0-3912-43f6-ab95-0c378f7bbceb'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:12.066491 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8a6b4ae0-3912-43f6-ab95-0c378f7bbceb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6a564c5c00c43689168301fb8e7a9c2', 'request_id': 'req-8a6b4ae0-3912-43f6-ab95-0c378f7bbceb'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:12.072350 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8a6b4ae0-3912-43f6-ab95-0c378f7bbceb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6a564c5c00c43689168301fb8e7a9c2', 'request_id': 'req-8a6b4ae0-3912-43f6-ab95-0c378f7bbceb'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:12.085083 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8a6b4ae0-3912-43f6-ab95-0c378f7bbceb admin admin] The token cache is being invalidate because project e6a564c5c00c43689168301fb8e7a9c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:12.085371 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8a6b4ae0-3912-43f6-ab95-0c378f7bbceb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:12.086010 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8a6b4ae0-3912-43f6-ab95-0c378f7bbceb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:12.087544 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 926/1869] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:11 2022] DELETE /identity/v3/projects/e6a564c5c00c43689168301fb8e7a9c2 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:12.093561 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabf9de-5865-4c98-9fbb-f5a7c4dabcb4 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:12.093855 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabf9de-5865-4c98-9fbb-f5a7c4dabcb4 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:12.094137 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbabf9de-5865-4c98-9fbb-f5a7c4dabcb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:12.112528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-dbabf9de-5865-4c98-9fbb-f5a7c4dabcb4 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:12.113720 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-dbabf9de-5865-4c98-9fbb-f5a7c4dabcb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:12.192633 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 944/1870] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:12.194307 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cf203-7656-4422-aa92-5df8ff1f10ec None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:12.194607 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cf203-7656-4422-aa92-5df8ff1f10ec None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:12.194891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99cf203-7656-4422-aa92-5df8ff1f10ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:12.222807 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-d99cf203-7656-4422-aa92-5df8ff1f10ec None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:12.224934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d99cf203-7656-4422-aa92-5df8ff1f10ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:12.238225 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 927/1871] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:12.239412 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabf9de-5865-4c98-9fbb-f5a7c4dabcb4 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:12.249854 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbabf9de-5865-4c98-9fbb-f5a7c4dabcb4 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:12.254890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e92a95-d81d-46b8-9b8d-9783fe5b1197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:12.255559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e92a95-d81d-46b8-9b8d-9783fe5b1197 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:12.255885 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e92a95-d81d-46b8-9b8d-9783fe5b1197 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:12.256158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e92a95-d81d-46b8-9b8d-9783fe5b1197 admin admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:12.256876 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e92a95-d81d-46b8-9b8d-9783fe5b1197 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:12.257183 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e92a95-d81d-46b8-9b8d-9783fe5b1197 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:12.258772 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e92a95-d81d-46b8-9b8d-9783fe5b1197 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:12.275661 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 945/1872] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:27:12.281085 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cf203-7656-4422-aa92-5df8ff1f10ec None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:12.298965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99cf203-7656-4422-aa92-5df8ff1f10ec None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:12.298965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef904d2d-85c8-496d-8902-99b474b2938e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:12.298965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef904d2d-85c8-496d-8902-99b474b2938e admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:12.298965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef904d2d-85c8-496d-8902-99b474b2938e admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:12.299375 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef904d2d-85c8-496d-8902-99b474b2938e admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:12.299375 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef904d2d-85c8-496d-8902-99b474b2938e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:12.301207 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef904d2d-85c8-496d-8902-99b474b2938e admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:12.330639 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 928/1873] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:12 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:12.334854 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e92a95-d81d-46b8-9b8d-9783fe5b1197 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:12.345501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e92a95-d81d-46b8-9b8d-9783fe5b1197 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:12.358658 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:12.410128 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354dccb-acc0-48c5-b224-353ff6ea6ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:12.410805 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354dccb-acc0-48c5-b224-353ff6ea6ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:12.411097 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354dccb-acc0-48c5-b224-353ff6ea6ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:12.411391 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354dccb-acc0-48c5-b224-353ff6ea6ab0 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:12.413493 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354dccb-acc0-48c5-b224-353ff6ea6ab0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:12.414044 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c354dccb-acc0-48c5-b224-353ff6ea6ab0 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:12.436326 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 946/1874] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:12 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:12.439674 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef904d2d-85c8-496d-8902-99b474b2938e admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:12.450991 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef904d2d-85c8-496d-8902-99b474b2938e admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:12.456409 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f9588-8550-4e35-9a2f-5ecba751f4e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:12.457084 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f9588-8550-4e35-9a2f-5ecba751f4e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:12.457748 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f9588-8550-4e35-9a2f-5ecba751f4e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:12.458177 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00f9588-8550-4e35-9a2f-5ecba751f4e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:12.459043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f9588-8550-4e35-9a2f-5ecba751f4e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:12.460898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00f9588-8550-4e35-9a2f-5ecba751f4e6 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:12.473268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 929/1875] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:27:12.478311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354dccb-acc0-48c5-b224-353ff6ea6ab0 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:12.490800 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354dccb-acc0-48c5-b224-353ff6ea6ab0 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:12.495591 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405e9d23-fb4a-4218-827a-212c8f8cf848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:12.496336 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e9d23-fb4a-4218-827a-212c8f8cf848 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:12.496616 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e9d23-fb4a-4218-827a-212c8f8cf848 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:12.496927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405e9d23-fb4a-4218-827a-212c8f8cf848 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:12.497659 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e9d23-fb4a-4218-827a-212c8f8cf848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:12.499302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405e9d23-fb4a-4218-827a-212c8f8cf848 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:12.509412 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 947/1876] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:12.513662 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f9588-8550-4e35-9a2f-5ecba751f4e6 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:12.523842 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00f9588-8550-4e35-9a2f-5ecba751f4e6 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:12.528424 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36eb78-d371-4f96-bffd-128a0bf584ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:12.529311 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36eb78-d371-4f96-bffd-128a0bf584ec admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:12.530135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36eb78-d371-4f96-bffd-128a0bf584ec admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:12.530416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce36eb78-d371-4f96-bffd-128a0bf584ec admin admin] PATH_INFO: `/v3/projects/4ce9e26a37314c04952e2da069688749/users/5ae533410e3c452d9ba1c15ac214812e/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:12.545883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36eb78-d371-4f96-bffd-128a0bf584ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ce9e26a37314c04952e2da069688749, user_id=5ae533410e3c452d9ba1c15ac214812e, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:12.548612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce36eb78-d371-4f96-bffd-128a0bf584ec admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:12.561681 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 930/1877] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:12 2022] PUT /identity/v3/projects/4ce9e26a37314c04952e2da069688749/users/5ae533410e3c452d9ba1c15ac214812e/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:27:12.573961 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1fc7d-5d90-44ae-bc61-677bcd6c5812 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:12.574256 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1fc7d-5d90-44ae-bc61-677bcd6c5812 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:12.574537 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e1fc7d-5d90-44ae-bc61-677bcd6c5812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:12.606886 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-e8e1fc7d-5d90-44ae-bc61-677bcd6c5812 None None] MFA Rules not processed for user `5ae533410e3c452d9ba1c15ac214812e`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:12.608766 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-e8e1fc7d-5d90-44ae-bc61-677bcd6c5812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:12.679419 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 948/1878] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:12.691134 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36eb78-d371-4f96-bffd-128a0bf584ec admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:12.692935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-ce36eb78-d371-4f96-bffd-128a0bf584ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:12.738518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:12.751098 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce36eb78-d371-4f96-bffd-128a0bf584ec admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:12.754924 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4481d-e757-4d7c-a65b-d73cf7c0e5ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:12.755562 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4481d-e757-4d7c-a65b-d73cf7c0e5ba service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:12.755899 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4481d-e757-4d7c-a65b-d73cf7c0e5ba service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:12.756176 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a4481d-e757-4d7c-a65b-d73cf7c0e5ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:12.764690 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4481d-e757-4d7c-a65b-d73cf7c0e5ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:12.766117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a4481d-e757-4d7c-a65b-d73cf7c0e5ba service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:12.774870 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 931/1879] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:13.698622 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1fc7d-5d90-44ae-bc61-677bcd6c5812 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:13.700190 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-e8e1fc7d-5d90-44ae-bc61-677bcd6c5812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:13.715742 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e1fc7d-5d90-44ae-bc61-677bcd6c5812 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:13.719570 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d1778b-c9ae-4279-ab4a-9dc5ad5e048f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:13.720101 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1778b-c9ae-4279-ab4a-9dc5ad5e048f service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:13.720391 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1778b-c9ae-4279-ab4a-9dc5ad5e048f service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:13.720669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d1778b-c9ae-4279-ab4a-9dc5ad5e048f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:13.722483 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-a7d1778b-c9ae-4279-ab4a-9dc5ad5e048f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:13.796261 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1778b-c9ae-4279-ab4a-9dc5ad5e048f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:13.798145 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d1778b-c9ae-4279-ab4a-9dc5ad5e048f service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:13.810206 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 949/1880] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:13.906052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4481d-e757-4d7c-a65b-d73cf7c0e5ba service cinder] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:13.907509 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-24a4481d-e757-4d7c-a65b-d73cf7c0e5ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:13.991226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a4481d-e757-4d7c-a65b-d73cf7c0e5ba service cinder] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:13.997321 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e97d9f-aba4-4aa6-95e3-5010d47e052c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:14.014486 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e97d9f-aba4-4aa6-95e3-5010d47e052c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:14.014844 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e97d9f-aba4-4aa6-95e3-5010d47e052c admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:14.016642 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e97d9f-aba4-4aa6-95e3-5010d47e052c admin admin] PATH_INFO: `/v3/users/f43114a6bba048dbbb680788399f0284` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:14.019404 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e97d9f-aba4-4aa6-95e3-5010d47e052c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f43114a6bba048dbbb680788399f0284)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:14.022873 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e97d9f-aba4-4aa6-95e3-5010d47e052c admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:14.179498 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-78e97d9f-aba4-4aa6-95e3-5010d47e052c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f43114a6bba048dbbb680788399f0284'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:14.191419 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-78e97d9f-aba4-4aa6-95e3-5010d47e052c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f43114a6bba048dbbb680788399f0284'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:14.192472 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-78e97d9f-aba4-4aa6-95e3-5010d47e052c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f43114a6bba048dbbb680788399f0284'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:14.214333 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-78e97d9f-aba4-4aa6-95e3-5010d47e052c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f43114a6bba048dbbb680788399f0284'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:14.215475 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-78e97d9f-aba4-4aa6-95e3-5010d47e052c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f43114a6bba048dbbb680788399f0284'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:14.233706 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 932/1881] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:13 2022] DELETE /identity/v3/users/f43114a6bba048dbbb680788399f0284 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:14.239449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac340e-4808-4a5b-a85f-e4143d694897 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:14.240039 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac340e-4808-4a5b-a85f-e4143d694897 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:14.240312 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ac340e-4808-4a5b-a85f-e4143d694897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:14.274625 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-41ac340e-4808-4a5b-a85f-e4143d694897 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:14.275986 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-41ac340e-4808-4a5b-a85f-e4143d694897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:14.307346 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:14.419481 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 950/1882] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:14.430245 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e97d9f-aba4-4aa6-95e3-5010d47e052c admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:14.432004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-78e97d9f-aba4-4aa6-95e3-5010d47e052c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:14.653650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e97d9f-aba4-4aa6-95e3-5010d47e052c admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:14.663991 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3513014-3384-4f8c-831d-ddb89706c65b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:14.664946 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3513014-3384-4f8c-831d-ddb89706c65b service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:14.665430 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3513014-3384-4f8c-831d-ddb89706c65b service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:14.666304 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3513014-3384-4f8c-831d-ddb89706c65b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:14.681867 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3513014-3384-4f8c-831d-ddb89706c65b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:14.685069 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3513014-3384-4f8c-831d-ddb89706c65b service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:14.698763 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 933/1883] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:15.082279 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac340e-4808-4a5b-a85f-e4143d694897 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:15.084967 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-41ac340e-4808-4a5b-a85f-e4143d694897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:15.098564 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ac340e-4808-4a5b-a85f-e4143d694897 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:15.106872 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54876590-e4a9-401c-af31-da5bfa66d9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:15.108586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54876590-e4a9-401c-af31-da5bfa66d9a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:15.108905 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54876590-e4a9-401c-af31-da5bfa66d9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:15.109859 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54876590-e4a9-401c-af31-da5bfa66d9a8 admin admin] PATH_INFO: `/v3/projects/6f287106f64d4ff887b7f0b153f60b9f` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:15.111755 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54876590-e4a9-401c-af31-da5bfa66d9a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f287106f64d4ff887b7f0b153f60b9f)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:15.113789 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54876590-e4a9-401c-af31-da5bfa66d9a8 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:15.166011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-54876590-e4a9-401c-af31-da5bfa66d9a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f287106f64d4ff887b7f0b153f60b9f', 'request_id': 'req-54876590-e4a9-401c-af31-da5bfa66d9a8'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:15.173442 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-54876590-e4a9-401c-af31-da5bfa66d9a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f287106f64d4ff887b7f0b153f60b9f', 'request_id': 'req-54876590-e4a9-401c-af31-da5bfa66d9a8'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:15.180119 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-54876590-e4a9-401c-af31-da5bfa66d9a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f287106f64d4ff887b7f0b153f60b9f', 'request_id': 'req-54876590-e4a9-401c-af31-da5bfa66d9a8'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:15.193598 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-54876590-e4a9-401c-af31-da5bfa66d9a8 admin admin] The token cache is being invalidate because project 6f287106f64d4ff887b7f0b153f60b9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:15.193879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-54876590-e4a9-401c-af31-da5bfa66d9a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:15.194512 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-54876590-e4a9-401c-af31-da5bfa66d9a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:15.196083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 951/1884] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:15 2022] DELETE /identity/v3/projects/6f287106f64d4ff887b7f0b153f60b9f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:15.200294 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3513014-3384-4f8c-831d-ddb89706c65b service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:15.209957 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3513014-3384-4f8c-831d-ddb89706c65b service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:15.215918 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:15.270281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8503f04b-704b-4a83-875e-a8346402dea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:15.271164 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503f04b-704b-4a83-875e-a8346402dea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:15.271445 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503f04b-704b-4a83-875e-a8346402dea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:15.271765 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8503f04b-704b-4a83-875e-a8346402dea9 admin admin] PATH_INFO: `/v3/users/740ea31263c945ad97656185a3686b7f` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:15.273040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503f04b-704b-4a83-875e-a8346402dea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=740ea31263c945ad97656185a3686b7f)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:15.275004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8503f04b-704b-4a83-875e-a8346402dea9 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:15.322286 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8503f04b-704b-4a83-875e-a8346402dea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '740ea31263c945ad97656185a3686b7f'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:15.329898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8503f04b-704b-4a83-875e-a8346402dea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '740ea31263c945ad97656185a3686b7f'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:15.330624 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8503f04b-704b-4a83-875e-a8346402dea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '740ea31263c945ad97656185a3686b7f'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:15.342822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8503f04b-704b-4a83-875e-a8346402dea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '740ea31263c945ad97656185a3686b7f'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:15.343476 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8503f04b-704b-4a83-875e-a8346402dea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '740ea31263c945ad97656185a3686b7f'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:15.355533 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 934/1885] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:15 2022] DELETE /identity/v3/users/740ea31263c945ad97656185a3686b7f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:15.620951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54876590-e4a9-401c-af31-da5bfa66d9a8 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:15.623120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-54876590-e4a9-401c-af31-da5bfa66d9a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:15.636508 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54876590-e4a9-401c-af31-da5bfa66d9a8 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:15.693948 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040b393-b8d2-435d-bf88-8b3da8bb0c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:15.695076 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040b393-b8d2-435d-bf88-8b3da8bb0c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:15.695367 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040b393-b8d2-435d-bf88-8b3da8bb0c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:15.695674 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040b393-b8d2-435d-bf88-8b3da8bb0c28 admin admin] PATH_INFO: `/v3/projects/23c472aaeec44113b9e9d30e1fa20a90` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:15.696925 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040b393-b8d2-435d-bf88-8b3da8bb0c28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23c472aaeec44113b9e9d30e1fa20a90)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:15.698839 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040b393-b8d2-435d-bf88-8b3da8bb0c28 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:15.758605 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7040b393-b8d2-435d-bf88-8b3da8bb0c28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23c472aaeec44113b9e9d30e1fa20a90', 'request_id': 'req-7040b393-b8d2-435d-bf88-8b3da8bb0c28'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:15.759906 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:15.765788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7040b393-b8d2-435d-bf88-8b3da8bb0c28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23c472aaeec44113b9e9d30e1fa20a90', 'request_id': 'req-7040b393-b8d2-435d-bf88-8b3da8bb0c28'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:15.773060 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7040b393-b8d2-435d-bf88-8b3da8bb0c28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23c472aaeec44113b9e9d30e1fa20a90', 'request_id': 'req-7040b393-b8d2-435d-bf88-8b3da8bb0c28'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:15.792645 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7040b393-b8d2-435d-bf88-8b3da8bb0c28 admin admin] The token cache is being invalidate because project 23c472aaeec44113b9e9d30e1fa20a90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:15.792949 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7040b393-b8d2-435d-bf88-8b3da8bb0c28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:15.793801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7040b393-b8d2-435d-bf88-8b3da8bb0c28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:15.796299 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 952/1886] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:15 2022] DELETE /identity/v3/projects/23c472aaeec44113b9e9d30e1fa20a90 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:15.801784 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cefd15-aeda-40b6-8de6-09fcca586650 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:15.802082 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cefd15-aeda-40b6-8de6-09fcca586650 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:15.802862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cefd15-aeda-40b6-8de6-09fcca586650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:15.820283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-68cefd15-aeda-40b6-8de6-09fcca586650 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:15.821494 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-68cefd15-aeda-40b6-8de6-09fcca586650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:15.889429 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 935/1887] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:27:15.896861 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6e005-07d9-4c56-9c7a-8dada3912670 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:15.897160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6e005-07d9-4c56-9c7a-8dada3912670 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:15.897448 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a6e005-07d9-4c56-9c7a-8dada3912670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:15.916161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-79a6e005-07d9-4c56-9c7a-8dada3912670 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:15.917378 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-79a6e005-07d9-4c56-9c7a-8dada3912670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:15.925278 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 953/1888] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:15.929520 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cefd15-aeda-40b6-8de6-09fcca586650 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:15.939009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cefd15-aeda-40b6-8de6-09fcca586650 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:15.943784 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd142f45-b5c2-45d5-905c-43e74719b904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:15.944438 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd142f45-b5c2-45d5-905c-43e74719b904 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:15.944723 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd142f45-b5c2-45d5-905c-43e74719b904 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:15.945000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd142f45-b5c2-45d5-905c-43e74719b904 admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:15.945726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd142f45-b5c2-45d5-905c-43e74719b904 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:15.946033 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd142f45-b5c2-45d5-905c-43e74719b904 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:15.947649 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd142f45-b5c2-45d5-905c-43e74719b904 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:15.959327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 936/1889] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:27:15.963676 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6e005-07d9-4c56-9c7a-8dada3912670 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:15.973478 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a6e005-07d9-4c56-9c7a-8dada3912670 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:15.978231 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7bcbb-1232-4537-bdff-15c361463be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:15.978880 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7bcbb-1232-4537-bdff-15c361463be3 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:15.979166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7bcbb-1232-4537-bdff-15c361463be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:15.979449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7bcbb-1232-4537-bdff-15c361463be3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:15.980182 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7bcbb-1232-4537-bdff-15c361463be3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:15.982078 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d7bcbb-1232-4537-bdff-15c361463be3 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:16.008479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 954/1890] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:15 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:16.014445 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd142f45-b5c2-45d5-905c-43e74719b904 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:16.024259 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd142f45-b5c2-45d5-905c-43e74719b904 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:16.036418 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:16.093127 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff8ea4-2809-48eb-8895-e160fee9c298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:16.093800 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff8ea4-2809-48eb-8895-e160fee9c298 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:16.094089 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff8ea4-2809-48eb-8895-e160fee9c298 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:16.094422 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff8ea4-2809-48eb-8895-e160fee9c298 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:16.095142 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff8ea4-2809-48eb-8895-e160fee9c298 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:16.097086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff8ea4-2809-48eb-8895-e160fee9c298 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:16.115800 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 937/1891] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:16 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:16.119900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7bcbb-1232-4537-bdff-15c361463be3 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:16.130575 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7bcbb-1232-4537-bdff-15c361463be3 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:16.135174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae782c7-3d99-4a0a-a07e-4cba9be92762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:16.135872 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae782c7-3d99-4a0a-a07e-4cba9be92762 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:16.136165 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae782c7-3d99-4a0a-a07e-4cba9be92762 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:16.136449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae782c7-3d99-4a0a-a07e-4cba9be92762 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:16.137437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae782c7-3d99-4a0a-a07e-4cba9be92762 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:16.139653 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae782c7-3d99-4a0a-a07e-4cba9be92762 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:16.149913 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 955/1892] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:16.153660 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff8ea4-2809-48eb-8895-e160fee9c298 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:16.164192 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff8ea4-2809-48eb-8895-e160fee9c298 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:16.168784 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbd7ac-b589-4092-858d-b9d72007eaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:16.169437 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbd7ac-b589-4092-858d-b9d72007eaef admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:16.169718 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbd7ac-b589-4092-858d-b9d72007eaef admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:16.170600 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbd7ac-b589-4092-858d-b9d72007eaef admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:16.171327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efbd7ac-b589-4092-858d-b9d72007eaef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:16.172937 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9efbd7ac-b589-4092-858d-b9d72007eaef admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:16.184039 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 938/1893] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:16.188278 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae782c7-3d99-4a0a-a07e-4cba9be92762 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:16.198155 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae782c7-3d99-4a0a-a07e-4cba9be92762 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:16.202743 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b2a18-334d-4f14-806d-565e2e2b346c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:16.203641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b2a18-334d-4f14-806d-565e2e2b346c admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:16.203941 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b2a18-334d-4f14-806d-565e2e2b346c admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:16.204220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6b2a18-334d-4f14-806d-565e2e2b346c admin admin] PATH_INFO: `/v3/projects/23a667ac1b4d4bbd904e4290ea5e9339/users/695e7172fe82450cb26c82887daeeeb5/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:16.219413 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b2a18-334d-4f14-806d-565e2e2b346c admin admin] RBAC: Authorizing `identity:create_grant(project_id=23a667ac1b4d4bbd904e4290ea5e9339, user_id=695e7172fe82450cb26c82887daeeeb5, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:16.222156 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6b2a18-334d-4f14-806d-565e2e2b346c admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:16.236443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 956/1894] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:16 2022] PUT /identity/v3/projects/23a667ac1b4d4bbd904e4290ea5e9339/users/695e7172fe82450cb26c82887daeeeb5/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:16.247298 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203c763-8d01-42a5-9eaf-29c0532d38a6 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:16.247851 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203c763-8d01-42a5-9eaf-29c0532d38a6 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:16.248008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9203c763-8d01-42a5-9eaf-29c0532d38a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:16.275772 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-9203c763-8d01-42a5-9eaf-29c0532d38a6 None None] MFA Rules not processed for user `695e7172fe82450cb26c82887daeeeb5`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:16.277007 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-9203c763-8d01-42a5-9eaf-29c0532d38a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:16.347123 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 939/1895] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:16 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:16.351901 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b2a18-334d-4f14-806d-565e2e2b346c admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:16.422383 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6b2a18-334d-4f14-806d-565e2e2b346c admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:16.427393 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b218c7-ea9f-4c8d-9d8b-c9bfb2ad1546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:16.428268 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b218c7-ea9f-4c8d-9d8b-c9bfb2ad1546 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:16.428402 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b218c7-ea9f-4c8d-9d8b-c9bfb2ad1546 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:16.428661 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b218c7-ea9f-4c8d-9d8b-c9bfb2ad1546 admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:16.429375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b218c7-ea9f-4c8d-9d8b-c9bfb2ad1546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:16.431288 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b218c7-ea9f-4c8d-9d8b-c9bfb2ad1546 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:16.461012 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 957/1896] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:16 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:27:16.463994 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203c763-8d01-42a5-9eaf-29c0532d38a6 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:16.475223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9203c763-8d01-42a5-9eaf-29c0532d38a6 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:16.532670 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ff7b4-7daa-48ce-9cf8-f399082cc407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:16.533375 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ff7b4-7daa-48ce-9cf8-f399082cc407 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:16.533660 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ff7b4-7daa-48ce-9cf8-f399082cc407 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:16.533935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49ff7b4-7daa-48ce-9cf8-f399082cc407 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:16.534624 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ff7b4-7daa-48ce-9cf8-f399082cc407 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:16.536595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49ff7b4-7daa-48ce-9cf8-f399082cc407 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:16.562604 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 940/1897] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:16 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:16.563666 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b218c7-ea9f-4c8d-9d8b-c9bfb2ad1546 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:16.577494 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b218c7-ea9f-4c8d-9d8b-c9bfb2ad1546 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:16.582019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56562326-1939-4b3c-bbff-7d9c641a78ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:16.582676 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56562326-1939-4b3c-bbff-7d9c641a78ca admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:16.582960 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56562326-1939-4b3c-bbff-7d9c641a78ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:16.583239 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56562326-1939-4b3c-bbff-7d9c641a78ca admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:16.583995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56562326-1939-4b3c-bbff-7d9c641a78ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:16.585590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56562326-1939-4b3c-bbff-7d9c641a78ca admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:16.597790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 958/1898] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:16.601870 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ff7b4-7daa-48ce-9cf8-f399082cc407 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:16.612196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49ff7b4-7daa-48ce-9cf8-f399082cc407 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:16.616749 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c38e7d-7f18-498d-9838-ca8319f8e1a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:16.617848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c38e7d-7f18-498d-9838-ca8319f8e1a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:16.618132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c38e7d-7f18-498d-9838-ca8319f8e1a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:16.618410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c38e7d-7f18-498d-9838-ca8319f8e1a7 admin admin] PATH_INFO: `/v3/projects/aa085dbaed334b2fa622e8ba005ec379/users/0ff802a34e4244a9b327b84254dc0fd1/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:16.633224 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:16.638333 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c38e7d-7f18-498d-9838-ca8319f8e1a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa085dbaed334b2fa622e8ba005ec379, user_id=0ff802a34e4244a9b327b84254dc0fd1, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:16.641313 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c38e7d-7f18-498d-9838-ca8319f8e1a7 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:16.654069 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 941/1899] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:16 2022] PUT /identity/v3/projects/aa085dbaed334b2fa622e8ba005ec379/users/0ff802a34e4244a9b327b84254dc0fd1/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:16.657948 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56562326-1939-4b3c-bbff-7d9c641a78ca admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:16.667741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56562326-1939-4b3c-bbff-7d9c641a78ca admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:16.711631 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:16.725147 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ddeeb5-3f70-4d0a-80b2-7a61c0fe81bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:16.725815 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddeeb5-3f70-4d0a-80b2-7a61c0fe81bd admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:16.726099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddeeb5-3f70-4d0a-80b2-7a61c0fe81bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:16.726374 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddeeb5-3f70-4d0a-80b2-7a61c0fe81bd admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:16.727093 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ddeeb5-3f70-4d0a-80b2-7a61c0fe81bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:16.728705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ddeeb5-3f70-4d0a-80b2-7a61c0fe81bd admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:16.738980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 959/1900] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:16.743002 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c38e7d-7f18-498d-9838-ca8319f8e1a7 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:16.754046 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c38e7d-7f18-498d-9838-ca8319f8e1a7 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:16.758762 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94871c7-ad8c-4d52-a4ea-270325b9bec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:16.759867 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94871c7-ad8c-4d52-a4ea-270325b9bec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:16.760149 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94871c7-ad8c-4d52-a4ea-270325b9bec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:16.760446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94871c7-ad8c-4d52-a4ea-270325b9bec5 admin admin] PATH_INFO: `/v3/projects/aa085dbaed334b2fa622e8ba005ec379/users/0ff802a34e4244a9b327b84254dc0fd1/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:16.762656 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94871c7-ad8c-4d52-a4ea-270325b9bec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa085dbaed334b2fa622e8ba005ec379, user_id=0ff802a34e4244a9b327b84254dc0fd1, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:16.765370 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94871c7-ad8c-4d52-a4ea-270325b9bec5 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:16.776197 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 942/1901] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:16 2022] PUT /identity/v3/projects/aa085dbaed334b2fa622e8ba005ec379/users/0ff802a34e4244a9b327b84254dc0fd1/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:16.787065 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4300a0-ca44-4880-9eb8-1e2fd505b104 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:16.787361 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4300a0-ca44-4880-9eb8-1e2fd505b104 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:16.787739 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4300a0-ca44-4880-9eb8-1e2fd505b104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:16.815024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-ea4300a0-ca44-4880-9eb8-1e2fd505b104 None None] MFA Rules not processed for user `0ff802a34e4244a9b327b84254dc0fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:16.816273 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-ea4300a0-ca44-4880-9eb8-1e2fd505b104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:16.882278 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 960/1902] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:16.894303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94871c7-ad8c-4d52-a4ea-270325b9bec5 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:16.896057 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-c94871c7-ad8c-4d52-a4ea-270325b9bec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:16.955395 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94871c7-ad8c-4d52-a4ea-270325b9bec5 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:16.959010 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b175e6-3d00-4b73-ac08-54977609bb88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:16.959697 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b175e6-3d00-4b73-ac08-54977609bb88 service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:16.959997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b175e6-3d00-4b73-ac08-54977609bb88 service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:16.960270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b175e6-3d00-4b73-ac08-54977609bb88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:16.970078 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b175e6-3d00-4b73-ac08-54977609bb88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:16.971531 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b175e6-3d00-4b73-ac08-54977609bb88 service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:16.981128 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 943/1903] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:16 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:17.060913 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4300a0-ca44-4880-9eb8-1e2fd505b104 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:17.070395 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4300a0-ca44-4880-9eb8-1e2fd505b104 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:17.074085 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c98df-4738-4fa7-a1a1-78bb706e9197 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:17.074754 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c98df-4738-4fa7-a1a1-78bb706e9197 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:17.075054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c98df-4738-4fa7-a1a1-78bb706e9197 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:17.075336 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c98df-4738-4fa7-a1a1-78bb706e9197 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:17.135584 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c98df-4738-4fa7-a1a1-78bb706e9197 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:17.137465 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c98df-4738-4fa7-a1a1-78bb706e9197 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:17.146852 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 961/1904] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:20.706445 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b175e6-3d00-4b73-ac08-54977609bb88 service cinder] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:20.708262 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-c3b175e6-3d00-4b73-ac08-54977609bb88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:20.801950 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b175e6-3d00-4b73-ac08-54977609bb88 service cinder] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:20.811770 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094787dc-2d9b-4730-90bc-1375c6a03fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:20.813100 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094787dc-2d9b-4730-90bc-1375c6a03fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:20.813782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094787dc-2d9b-4730-90bc-1375c6a03fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:20.814111 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094787dc-2d9b-4730-90bc-1375c6a03fd4 admin admin] PATH_INFO: `/v3/users/fb94367fb81e4402aabdcd73a0255fda` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:20.819644 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094787dc-2d9b-4730-90bc-1375c6a03fd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb94367fb81e4402aabdcd73a0255fda)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:20.821268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094787dc-2d9b-4730-90bc-1375c6a03fd4 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:20.904423 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-094787dc-2d9b-4730-90bc-1375c6a03fd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb94367fb81e4402aabdcd73a0255fda'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:20.914514 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-094787dc-2d9b-4730-90bc-1375c6a03fd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb94367fb81e4402aabdcd73a0255fda'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:20.915301 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-094787dc-2d9b-4730-90bc-1375c6a03fd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb94367fb81e4402aabdcd73a0255fda'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:20.932767 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-094787dc-2d9b-4730-90bc-1375c6a03fd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb94367fb81e4402aabdcd73a0255fda'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:20.933596 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-094787dc-2d9b-4730-90bc-1375c6a03fd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb94367fb81e4402aabdcd73a0255fda'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:20.941559 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:20.947103 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 944/1905] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:20 2022] DELETE /identity/v3/users/fb94367fb81e4402aabdcd73a0255fda => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:20.952509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28d164-a723-4346-ba39-e811cf62ac14 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:20.952962 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28d164-a723-4346-ba39-e811cf62ac14 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:20.953082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e28d164-a723-4346-ba39-e811cf62ac14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:20.971386 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-4e28d164-a723-4346-ba39-e811cf62ac14 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:20.972696 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-4e28d164-a723-4346-ba39-e811cf62ac14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:21.045613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 962/1906] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:27:21.055492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094787dc-2d9b-4730-90bc-1375c6a03fd4 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:21.057024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-094787dc-2d9b-4730-90bc-1375c6a03fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:21.113827 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094787dc-2d9b-4730-90bc-1375c6a03fd4 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:21.118148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68de5c-3585-4452-a0e0-c30ea863c228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:21.118873 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68de5c-3585-4452-a0e0-c30ea863c228 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:21.119167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68de5c-3585-4452-a0e0-c30ea863c228 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:21.119449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e68de5c-3585-4452-a0e0-c30ea863c228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:21.138985 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68de5c-3585-4452-a0e0-c30ea863c228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:21.140924 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e68de5c-3585-4452-a0e0-c30ea863c228 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:21.154167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 945/1907] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:21.669966 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28d164-a723-4346-ba39-e811cf62ac14 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:21.671511 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-4e28d164-a723-4346-ba39-e811cf62ac14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:21.685257 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e28d164-a723-4346-ba39-e811cf62ac14 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:21.691660 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dd316-6393-4453-8b42-fdd978ed34ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:21.692809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dd316-6393-4453-8b42-fdd978ed34ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:21.693150 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dd316-6393-4453-8b42-fdd978ed34ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:21.693483 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5dd316-6393-4453-8b42-fdd978ed34ad admin admin] PATH_INFO: `/v3/projects/b7b611f7424346948d635859e7cec7e7` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:21.694935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5dd316-6393-4453-8b42-fdd978ed34ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7b611f7424346948d635859e7cec7e7)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:21.697762 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5dd316-6393-4453-8b42-fdd978ed34ad admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:21.700596 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:21.758651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-eb5dd316-6393-4453-8b42-fdd978ed34ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7b611f7424346948d635859e7cec7e7', 'request_id': 'req-eb5dd316-6393-4453-8b42-fdd978ed34ad'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:21.766027 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-eb5dd316-6393-4453-8b42-fdd978ed34ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7b611f7424346948d635859e7cec7e7', 'request_id': 'req-eb5dd316-6393-4453-8b42-fdd978ed34ad'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:21.772557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-eb5dd316-6393-4453-8b42-fdd978ed34ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7b611f7424346948d635859e7cec7e7', 'request_id': 'req-eb5dd316-6393-4453-8b42-fdd978ed34ad'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:21.791213 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-eb5dd316-6393-4453-8b42-fdd978ed34ad admin admin] The token cache is being invalidate because project b7b611f7424346948d635859e7cec7e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:21.791514 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-eb5dd316-6393-4453-8b42-fdd978ed34ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:21.792372 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-eb5dd316-6393-4453-8b42-fdd978ed34ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:21.798296 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 963/1908] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:21 2022] DELETE /identity/v3/projects/b7b611f7424346948d635859e7cec7e7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:21.799558 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68de5c-3585-4452-a0e0-c30ea863c228 service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:21.811990 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e68de5c-3585-4452-a0e0-c30ea863c228 service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:21.912390 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58198d-7290-4e03-af56-db49dcbb5022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:21.913308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58198d-7290-4e03-af56-db49dcbb5022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:21.913698 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58198d-7290-4e03-af56-db49dcbb5022 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:21.914013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58198d-7290-4e03-af56-db49dcbb5022 admin admin] PATH_INFO: `/v3/users/8c13f8986f9c457d86d5fa56348e0788` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:21.915319 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58198d-7290-4e03-af56-db49dcbb5022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c13f8986f9c457d86d5fa56348e0788)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:21.917366 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58198d-7290-4e03-af56-db49dcbb5022 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:21.981305 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-4d58198d-7290-4e03-af56-db49dcbb5022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c13f8986f9c457d86d5fa56348e0788'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:22.005821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-4d58198d-7290-4e03-af56-db49dcbb5022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c13f8986f9c457d86d5fa56348e0788'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:22.010961 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-4d58198d-7290-4e03-af56-db49dcbb5022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c13f8986f9c457d86d5fa56348e0788'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:22.035074 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-4d58198d-7290-4e03-af56-db49dcbb5022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c13f8986f9c457d86d5fa56348e0788'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:22.037138 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-4d58198d-7290-4e03-af56-db49dcbb5022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c13f8986f9c457d86d5fa56348e0788'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:22.062570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 946/1909] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:21 2022] DELETE /identity/v3/users/8c13f8986f9c457d86d5fa56348e0788 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:22.595811 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dd316-6393-4453-8b42-fdd978ed34ad admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:22.597853 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-eb5dd316-6393-4453-8b42-fdd978ed34ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:22.611928 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5dd316-6393-4453-8b42-fdd978ed34ad admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:22.699440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d4d72a-e3a2-45c5-95fe-683c5dc0baef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:22.700350 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4d72a-e3a2-45c5-95fe-683c5dc0baef admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:22.701178 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4d72a-e3a2-45c5-95fe-683c5dc0baef admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:22.701461 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d4d72a-e3a2-45c5-95fe-683c5dc0baef admin admin] PATH_INFO: `/v3/users/5ae533410e3c452d9ba1c15ac214812e` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:22.702681 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4d72a-e3a2-45c5-95fe-683c5dc0baef admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ae533410e3c452d9ba1c15ac214812e)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:22.704659 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d4d72a-e3a2-45c5-95fe-683c5dc0baef admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:22.729622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58198d-7290-4e03-af56-db49dcbb5022 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:22.731283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-4d58198d-7290-4e03-af56-db49dcbb5022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:22.758244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58198d-7290-4e03-af56-db49dcbb5022 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:22.766290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89566f49-ff07-4b46-b100-7b7188549253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:22.767256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566f49-ff07-4b46-b100-7b7188549253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:22.767634 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566f49-ff07-4b46-b100-7b7188549253 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:22.767991 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89566f49-ff07-4b46-b100-7b7188549253 admin admin] PATH_INFO: `/v3/projects/f3dca9054d164427b6d8252e3989ac3f` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:22.769900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89566f49-ff07-4b46-b100-7b7188549253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3dca9054d164427b6d8252e3989ac3f)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:22.771299 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89566f49-ff07-4b46-b100-7b7188549253 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:22.772112 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-41d4d72a-e3a2-45c5-95fe-683c5dc0baef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ae533410e3c452d9ba1c15ac214812e'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:22.793260 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:22.797888 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-41d4d72a-e3a2-45c5-95fe-683c5dc0baef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ae533410e3c452d9ba1c15ac214812e'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:22.798689 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-41d4d72a-e3a2-45c5-95fe-683c5dc0baef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ae533410e3c452d9ba1c15ac214812e'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:22.799816 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-41d4d72a-e3a2-45c5-95fe-683c5dc0baef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ae533410e3c452d9ba1c15ac214812e'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:22.830179 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-41d4d72a-e3a2-45c5-95fe-683c5dc0baef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ae533410e3c452d9ba1c15ac214812e'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:22.839820 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-89566f49-ff07-4b46-b100-7b7188549253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3dca9054d164427b6d8252e3989ac3f', 'request_id': 'req-89566f49-ff07-4b46-b100-7b7188549253'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:22.846790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 964/1910] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:22 2022] DELETE /identity/v3/users/5ae533410e3c452d9ba1c15ac214812e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:22.849221 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-89566f49-ff07-4b46-b100-7b7188549253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3dca9054d164427b6d8252e3989ac3f', 'request_id': 'req-89566f49-ff07-4b46-b100-7b7188549253'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:22.852592 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bbdb2-6195-48c5-a366-f3a340e20cdc None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:22.852967 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bbdb2-6195-48c5-a366-f3a340e20cdc None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:22.853248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766bbdb2-6195-48c5-a366-f3a340e20cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:22.856089 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-89566f49-ff07-4b46-b100-7b7188549253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3dca9054d164427b6d8252e3989ac3f', 'request_id': 'req-89566f49-ff07-4b46-b100-7b7188549253'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:22.874925 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-89566f49-ff07-4b46-b100-7b7188549253 admin admin] The token cache is being invalidate because project f3dca9054d164427b6d8252e3989ac3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:22.875366 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-89566f49-ff07-4b46-b100-7b7188549253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:22.876125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-89566f49-ff07-4b46-b100-7b7188549253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:22.876696 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-766bbdb2-6195-48c5-a366-f3a340e20cdc None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:22.878001 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-766bbdb2-6195-48c5-a366-f3a340e20cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:22.878528 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 947/1911] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:22 2022] DELETE /identity/v3/projects/f3dca9054d164427b6d8252e3989ac3f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:27:22.882283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89566f49-ff07-4b46-b100-7b7188549253 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:22.884619 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-89566f49-ff07-4b46-b100-7b7188549253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:22.887956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:22.978253 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89566f49-ff07-4b46-b100-7b7188549253 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:22.982879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 965/1912] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:22.984187 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238833c6-6de5-464c-a422-ed98d426ef3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:22.985174 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238833c6-6de5-464c-a422-ed98d426ef3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:22.985547 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238833c6-6de5-464c-a422-ed98d426ef3a admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:22.985884 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238833c6-6de5-464c-a422-ed98d426ef3a admin admin] PATH_INFO: `/v3/users/075880ee517640dc836a5d30dd79343e` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:22.987128 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238833c6-6de5-464c-a422-ed98d426ef3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=075880ee517640dc836a5d30dd79343e)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:22.989150 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238833c6-6de5-464c-a422-ed98d426ef3a admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:22.996157 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bbdb2-6195-48c5-a366-f3a340e20cdc None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:22.998230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-766bbdb2-6195-48c5-a366-f3a340e20cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:23.073193 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-238833c6-6de5-464c-a422-ed98d426ef3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '075880ee517640dc836a5d30dd79343e'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:23.085376 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-238833c6-6de5-464c-a422-ed98d426ef3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '075880ee517640dc836a5d30dd79343e'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:23.088036 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-238833c6-6de5-464c-a422-ed98d426ef3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '075880ee517640dc836a5d30dd79343e'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:23.096169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766bbdb2-6195-48c5-a366-f3a340e20cdc None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:23.116258 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdff5f96-e1f9-4578-b5a0-bad4b0e5e5a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:23.116610 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-238833c6-6de5-464c-a422-ed98d426ef3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '075880ee517640dc836a5d30dd79343e'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:23.117584 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff5f96-e1f9-4578-b5a0-bad4b0e5e5a8 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:23.118044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-238833c6-6de5-464c-a422-ed98d426ef3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '075880ee517640dc836a5d30dd79343e'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:23.119422 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff5f96-e1f9-4578-b5a0-bad4b0e5e5a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:23.119936 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdff5f96-e1f9-4578-b5a0-bad4b0e5e5a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:23.127076 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-fdff5f96-e1f9-4578-b5a0-bad4b0e5e5a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:23.146069 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 948/1913] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:22 2022] DELETE /identity/v3/users/075880ee517640dc836a5d30dd79343e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:23.154785 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff5f96-e1f9-4578-b5a0-bad4b0e5e5a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:23.157607 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdff5f96-e1f9-4578-b5a0-bad4b0e5e5a8 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:23.183167 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 966/1914] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:27:23.213864 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb4a38-cbcb-4f1b-9af4-03c10c6fe9e6 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:23.214314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb4a38-cbcb-4f1b-9af4-03c10c6fe9e6 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:23.214845 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99eb4a38-cbcb-4f1b-9af4-03c10c6fe9e6 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:23.216967 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 949/1915] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 16 00:27:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:27:23.225587 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd2f6a-833c-4d8f-945e-4ce0e2e6d8d7 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:23.225878 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd2f6a-833c-4d8f-945e-4ce0e2e6d8d7 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:23.226155 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfd2f6a-833c-4d8f-945e-4ce0e2e6d8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:23.255799 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-8bfd2f6a-833c-4d8f-945e-4ce0e2e6d8d7 None None] MFA Rules not processed for user `9164f14fe6894daba1a9f2d8f1f4929c`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:23.256809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-8bfd2f6a-833c-4d8f-945e-4ce0e2e6d8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:23.343377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 967/1916] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 16 00:27:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:27:23.354260 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb4a38-cbcb-4f1b-9af4-03c10c6fe9e6 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:23.355960 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-99eb4a38-cbcb-4f1b-9af4-03c10c6fe9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:23.373300 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99eb4a38-cbcb-4f1b-9af4-03c10c6fe9e6 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:23.379715 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83efc23c-cfed-4790-9ea9-2aa68d0de46a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9164f14fe6894daba1a9f2d8f1f4929c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:23.380372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83efc23c-cfed-4790-9ea9-2aa68d0de46a service placement] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:23.380655 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83efc23c-cfed-4790-9ea9-2aa68d0de46a service placement] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:23.380932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83efc23c-cfed-4790-9ea9-2aa68d0de46a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:23.392345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83efc23c-cfed-4790-9ea9-2aa68d0de46a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:23.394346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83efc23c-cfed-4790-9ea9-2aa68d0de46a service placement] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:23.406284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 950/1917] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:23.955079 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd2f6a-833c-4d8f-945e-4ce0e2e6d8d7 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:23.957130 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-8bfd2f6a-833c-4d8f-945e-4ce0e2e6d8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:23.964093 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83efc23c-cfed-4790-9ea9-2aa68d0de46a service placement] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:23.965660 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-83efc23c-cfed-4790-9ea9-2aa68d0de46a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:23.981519 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:24.065395 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:24.066231 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83efc23c-cfed-4790-9ea9-2aa68d0de46a service placement] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:24.072224 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c817a47-65a3-4c9e-b376-ec8f76805706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:24.073223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c817a47-65a3-4c9e-b376-ec8f76805706 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:24.073616 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c817a47-65a3-4c9e-b376-ec8f76805706 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:24.074020 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c817a47-65a3-4c9e-b376-ec8f76805706 admin admin] PATH_INFO: `/v3/projects/4ce9e26a37314c04952e2da069688749` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:24.075353 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c817a47-65a3-4c9e-b376-ec8f76805706 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ce9e26a37314c04952e2da069688749)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:24.078179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c817a47-65a3-4c9e-b376-ec8f76805706 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:24.086168 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfd2f6a-833c-4d8f-945e-4ce0e2e6d8d7 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:24.095273 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e6ce6-ea4b-4732-8a87-660b7bb0589d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:24.096972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e6ce6-ea4b-4732-8a87-660b7bb0589d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:24.097515 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e6ce6-ea4b-4732-8a87-660b7bb0589d admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:24.097809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e6ce6-ea4b-4732-8a87-660b7bb0589d admin admin] PATH_INFO: `/v3/projects/11d03c10ff94444c95748905346ee8d8` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:24.099058 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e6ce6-ea4b-4732-8a87-660b7bb0589d admin admin] RBAC: Authorizing `identity:delete_project(project_id=11d03c10ff94444c95748905346ee8d8)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:24.101203 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e6ce6-ea4b-4732-8a87-660b7bb0589d admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:24.136068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8c817a47-65a3-4c9e-b376-ec8f76805706 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ce9e26a37314c04952e2da069688749', 'request_id': 'req-8c817a47-65a3-4c9e-b376-ec8f76805706'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:24.143585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8c817a47-65a3-4c9e-b376-ec8f76805706 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ce9e26a37314c04952e2da069688749', 'request_id': 'req-8c817a47-65a3-4c9e-b376-ec8f76805706'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:24.150591 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8c817a47-65a3-4c9e-b376-ec8f76805706 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ce9e26a37314c04952e2da069688749', 'request_id': 'req-8c817a47-65a3-4c9e-b376-ec8f76805706'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:24.166214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8c817a47-65a3-4c9e-b376-ec8f76805706 admin admin] The token cache is being invalidate because project 4ce9e26a37314c04952e2da069688749 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:24.166521 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8c817a47-65a3-4c9e-b376-ec8f76805706 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:24.167322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8c817a47-65a3-4c9e-b376-ec8f76805706 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:24.167779 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-834e6ce6-ea4b-4732-8a87-660b7bb0589d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11d03c10ff94444c95748905346ee8d8', 'request_id': 'req-834e6ce6-ea4b-4732-8a87-660b7bb0589d'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:24.170251 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 951/1918] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:23 2022] DELETE /identity/v3/projects/4ce9e26a37314c04952e2da069688749 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:24.176937 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c1039-d698-47c0-b6e4-50b3cb87d398 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:24.177236 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c1039-d698-47c0-b6e4-50b3cb87d398 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:24.177519 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c1039-d698-47c0-b6e4-50b3cb87d398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:24.183459 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-834e6ce6-ea4b-4732-8a87-660b7bb0589d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11d03c10ff94444c95748905346ee8d8', 'request_id': 'req-834e6ce6-ea4b-4732-8a87-660b7bb0589d'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:24.196179 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-834e6ce6-ea4b-4732-8a87-660b7bb0589d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11d03c10ff94444c95748905346ee8d8', 'request_id': 'req-834e6ce6-ea4b-4732-8a87-660b7bb0589d'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:24.232486 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-e65c1039-d698-47c0-b6e4-50b3cb87d398 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:24.233908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-834e6ce6-ea4b-4732-8a87-660b7bb0589d admin admin] The token cache is being invalidate because project 11d03c10ff94444c95748905346ee8d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:24.235285 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e65c1039-d698-47c0-b6e4-50b3cb87d398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:24.235752 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-834e6ce6-ea4b-4732-8a87-660b7bb0589d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:24.237272 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-834e6ce6-ea4b-4732-8a87-660b7bb0589d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:24.243379 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 968/1919] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:23 2022] DELETE /identity/v3/projects/11d03c10ff94444c95748905346ee8d8 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:24.250945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4508b6-8bfe-41b7-8f37-01bf9442efab None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:24.251242 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4508b6-8bfe-41b7-8f37-01bf9442efab None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:24.251529 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4508b6-8bfe-41b7-8f37-01bf9442efab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:24.284839 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-ae4508b6-8bfe-41b7-8f37-01bf9442efab None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:24.287537 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-ae4508b6-8bfe-41b7-8f37-01bf9442efab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:24.385320 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 969/1920] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:24.387685 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4321bd6-ce8b-40cc-97ec-21e9d1a1770c None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:24.387685 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4321bd6-ce8b-40cc-97ec-21e9d1a1770c None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:24.388812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4321bd6-ce8b-40cc-97ec-21e9d1a1770c None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:24.390261 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 970/1921] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 16 00:27:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:27:24.391023 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4321bd6-ce8b-40cc-97ec-21e9d1a1770c None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:24.393355 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-b4321bd6-ce8b-40cc-97ec-21e9d1a1770c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:24.417139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4321bd6-ce8b-40cc-97ec-21e9d1a1770c None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:24.424756 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302519b1-067e-450d-856d-ba115049796a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:24.425654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302519b1-067e-450d-856d-ba115049796a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:24.425942 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302519b1-067e-450d-856d-ba115049796a admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:24.426220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302519b1-067e-450d-856d-ba115049796a admin admin] PATH_INFO: `/v3/users/7760bdff0f0b4cae975138efc8677529` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:24.427465 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302519b1-067e-450d-856d-ba115049796a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7760bdff0f0b4cae975138efc8677529)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:24.429514 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302519b1-067e-450d-856d-ba115049796a admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:24.433004 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 952/1922] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:27:24.434409 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d130f-1a5e-4efe-a93e-83f81f7eb61d None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:24.434727 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d130f-1a5e-4efe-a93e-83f81f7eb61d None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:24.435029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07d130f-1a5e-4efe-a93e-83f81f7eb61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:24.458723 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-e07d130f-1a5e-4efe-a93e-83f81f7eb61d None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:24.460107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e07d130f-1a5e-4efe-a93e-83f81f7eb61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:24.479837 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 953/1923] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:24.481479 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae4914-33f0-4bc4-83e3-652a199699f4 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:24.483588 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae4914-33f0-4bc4-83e3-652a199699f4 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:24.484100 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae4914-33f0-4bc4-83e3-652a199699f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:24.509164 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-302519b1-067e-450d-856d-ba115049796a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7760bdff0f0b4cae975138efc8677529'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:24.520633 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-302519b1-067e-450d-856d-ba115049796a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7760bdff0f0b4cae975138efc8677529'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:24.521463 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-79ae4914-33f0-4bc4-83e3-652a199699f4 None None] MFA Rules not processed for user `9164f14fe6894daba1a9f2d8f1f4929c`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:24.522059 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-302519b1-067e-450d-856d-ba115049796a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7760bdff0f0b4cae975138efc8677529'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:24.524206 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-302519b1-067e-450d-856d-ba115049796a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7760bdff0f0b4cae975138efc8677529'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:24.529082 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-79ae4914-33f0-4bc4-83e3-652a199699f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:24.545809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-302519b1-067e-450d-856d-ba115049796a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7760bdff0f0b4cae975138efc8677529'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:24.550461 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:24.562338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 971/1924] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:24 2022] DELETE /identity/v3/users/7760bdff0f0b4cae975138efc8677529 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:24.563771 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3bfc8-6a0e-4c4d-b896-434ed3646d51 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:24.564071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3bfc8-6a0e-4c4d-b896-434ed3646d51 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:24.564355 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac3bfc8-6a0e-4c4d-b896-434ed3646d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:24.585088 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:24.596771 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-8ac3bfc8-6a0e-4c4d-b896-434ed3646d51 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:24.599680 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-8ac3bfc8-6a0e-4c4d-b896-434ed3646d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:24.639397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 954/1925] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 16 00:27:24 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:24.640362 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae4914-33f0-4bc4-83e3-652a199699f4 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:24.642380 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-79ae4914-33f0-4bc4-83e3-652a199699f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:24.662798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae4914-33f0-4bc4-83e3-652a199699f4 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:24.709175 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 972/1926] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:24.710141 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3bfc8-6a0e-4c4d-b896-434ed3646d51 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:24.711510 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-8ac3bfc8-6a0e-4c4d-b896-434ed3646d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:24.736170 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584180d0-4e3d-4f09-b660-8c332be25fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:24.737097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584180d0-4e3d-4f09-b660-8c332be25fef admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:24.737869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584180d0-4e3d-4f09-b660-8c332be25fef admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:24.738170 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584180d0-4e3d-4f09-b660-8c332be25fef admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:24.738910 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584180d0-4e3d-4f09-b660-8c332be25fef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:24.739597 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584180d0-4e3d-4f09-b660-8c332be25fef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:24.741309 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584180d0-4e3d-4f09-b660-8c332be25fef admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:24.758768 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 955/1927] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:27:24.759685 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584180d0-4e3d-4f09-b660-8c332be25fef admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:24.775124 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584180d0-4e3d-4f09-b660-8c332be25fef admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:24.780882 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcb75c-0df4-4138-bad4-895774dd299c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:24.781706 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcb75c-0df4-4138-bad4-895774dd299c admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:24.781996 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcb75c-0df4-4138-bad4-895774dd299c admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:24.782594 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcb75c-0df4-4138-bad4-895774dd299c admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:24.783805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcb75c-0df4-4138-bad4-895774dd299c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:24.784123 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcb75c-0df4-4138-bad4-895774dd299c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:24.785896 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcb75c-0df4-4138-bad4-895774dd299c admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:24.807713 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 956/1928] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:27:24.809143 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcb75c-0df4-4138-bad4-895774dd299c admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:24.810386 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac3bfc8-6a0e-4c4d-b896-434ed3646d51 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:24.819972 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcb75c-0df4-4138-bad4-895774dd299c admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:24.827479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b77f68-7508-49db-abc0-84d88e2c6cdf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9164f14fe6894daba1a9f2d8f1f4929c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:24.828183 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b77f68-7508-49db-abc0-84d88e2c6cdf service placement] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:24.828470 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b77f68-7508-49db-abc0-84d88e2c6cdf service placement] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:24.828752 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b77f68-7508-49db-abc0-84d88e2c6cdf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:24.829899 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867045c0-d658-4b3a-b2f4-c9fbbd91a79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:24.830609 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867045c0-d658-4b3a-b2f4-c9fbbd91a79b admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:24.830893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867045c0-d658-4b3a-b2f4-c9fbbd91a79b admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:24.831238 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867045c0-d658-4b3a-b2f4-c9fbbd91a79b admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:24.831944 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867045c0-d658-4b3a-b2f4-c9fbbd91a79b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:24.833998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867045c0-d658-4b3a-b2f4-c9fbbd91a79b admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:24.845756 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b77f68-7508-49db-abc0-84d88e2c6cdf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:24.847422 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b77f68-7508-49db-abc0-84d88e2c6cdf service placement] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:24.858522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 973/1929] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:24.859376 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b77f68-7508-49db-abc0-84d88e2c6cdf service placement] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:24.870182 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b77f68-7508-49db-abc0-84d88e2c6cdf service placement] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:24.875239 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81431fbe-72e1-4ac2-b403-60582c2e3f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:24.875990 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81431fbe-72e1-4ac2-b403-60582c2e3f7c admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:24.876323 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81431fbe-72e1-4ac2-b403-60582c2e3f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:24.876608 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81431fbe-72e1-4ac2-b403-60582c2e3f7c admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:24.877369 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81431fbe-72e1-4ac2-b403-60582c2e3f7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:24.879386 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81431fbe-72e1-4ac2-b403-60582c2e3f7c admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:24.893514 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 957/1930] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:24 2022] POST /identity/v3/projects => generated 377 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:24.894509 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867045c0-d658-4b3a-b2f4-c9fbbd91a79b admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:24.897305 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-867045c0-d658-4b3a-b2f4-c9fbbd91a79b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:24.919672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 974/1931] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:24 2022] POST /identity/v3/projects => generated 373 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:24.920717 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81431fbe-72e1-4ac2-b403-60582c2e3f7c admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:24.977833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867045c0-d658-4b3a-b2f4-c9fbbd91a79b admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:24.990405 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81431fbe-72e1-4ac2-b403-60582c2e3f7c admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:24.995222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c824c-a30a-48b8-ab25-af47264d8c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:24.996135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c824c-a30a-48b8-ab25-af47264d8c91 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:24.996421 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c824c-a30a-48b8-ab25-af47264d8c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:24.996851 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c824c-a30a-48b8-ab25-af47264d8c91 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:24.998233 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c824c-a30a-48b8-ab25-af47264d8c91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:25.000212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c824c-a30a-48b8-ab25-af47264d8c91 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:25.009304 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:25.019494 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:25.024510 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 975/1932] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:24 2022] POST /identity/v3/users => generated 289 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:25.025294 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c824c-a30a-48b8-ab25-af47264d8c91 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:25.037325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c824c-a30a-48b8-ab25-af47264d8c91 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:25.042241 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9cbb14-0d20-42b1-b6c6-8908dab6f8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:25.042947 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cbb14-0d20-42b1-b6c6-8908dab6f8b7 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:25.043394 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cbb14-0d20-42b1-b6c6-8908dab6f8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:25.043716 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9cbb14-0d20-42b1-b6c6-8908dab6f8b7 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:25.044615 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9cbb14-0d20-42b1-b6c6-8908dab6f8b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:25.046446 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9cbb14-0d20-42b1-b6c6-8908dab6f8b7 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:25.050796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ea9b1-4b9f-4193-a0d4-289b48061996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:25.051660 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ea9b1-4b9f-4193-a0d4-289b48061996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:25.051952 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ea9b1-4b9f-4193-a0d4-289b48061996 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:25.052333 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956ea9b1-4b9f-4193-a0d4-289b48061996 admin admin] PATH_INFO: `/v3/projects/f2c9fcd7f4ac4946b4fe139118255ade` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:25.053768 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ea9b1-4b9f-4193-a0d4-289b48061996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2c9fcd7f4ac4946b4fe139118255ade)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:25.056782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956ea9b1-4b9f-4193-a0d4-289b48061996 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:25.071333 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 976/1933] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:25 2022] POST /identity/v3/users => generated 287 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:25.072231 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9cbb14-0d20-42b1-b6c6-8908dab6f8b7 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:25.088678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9cbb14-0d20-42b1-b6c6-8908dab6f8b7 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:25.095056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8135e1-1511-4d6a-a381-b003d39a7ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:25.095779 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8135e1-1511-4d6a-a381-b003d39a7ebe admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:25.096379 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8135e1-1511-4d6a-a381-b003d39a7ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:25.096669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8135e1-1511-4d6a-a381-b003d39a7ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:25.097418 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8135e1-1511-4d6a-a381-b003d39a7ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:25.099146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8135e1-1511-4d6a-a381-b003d39a7ebe admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:25.115210 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 977/1934] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:25.115210 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8135e1-1511-4d6a-a381-b003d39a7ebe admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:25.119156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-956ea9b1-4b9f-4193-a0d4-289b48061996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2c9fcd7f4ac4946b4fe139118255ade', 'request_id': 'req-956ea9b1-4b9f-4193-a0d4-289b48061996'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:25.123885 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8135e1-1511-4d6a-a381-b003d39a7ebe admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:25.127535 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-956ea9b1-4b9f-4193-a0d4-289b48061996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2c9fcd7f4ac4946b4fe139118255ade', 'request_id': 'req-956ea9b1-4b9f-4193-a0d4-289b48061996'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:25.134290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-956ea9b1-4b9f-4193-a0d4-289b48061996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2c9fcd7f4ac4946b4fe139118255ade', 'request_id': 'req-956ea9b1-4b9f-4193-a0d4-289b48061996'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:25.151686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-956ea9b1-4b9f-4193-a0d4-289b48061996 admin admin] The token cache is being invalidate because project f2c9fcd7f4ac4946b4fe139118255ade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:25.152008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-956ea9b1-4b9f-4193-a0d4-289b48061996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:25.152827 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-956ea9b1-4b9f-4193-a0d4-289b48061996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:25.155603 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 958/1935] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:24 2022] DELETE /identity/v3/projects/f2c9fcd7f4ac4946b4fe139118255ade => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:25.156300 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ea9b1-4b9f-4193-a0d4-289b48061996 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:25.157674 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-956ea9b1-4b9f-4193-a0d4-289b48061996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:25.197210 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e71cfa-0ea7-4528-beb6-9931fd6234ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:25.197897 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e71cfa-0ea7-4528-beb6-9931fd6234ce admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:25.198228 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e71cfa-0ea7-4528-beb6-9931fd6234ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:25.198510 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e71cfa-0ea7-4528-beb6-9931fd6234ce admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:25.199248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e71cfa-0ea7-4528-beb6-9931fd6234ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:25.200972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e71cfa-0ea7-4528-beb6-9931fd6234ce admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:25.215297 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 978/1936] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:25.217188 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e71cfa-0ea7-4528-beb6-9931fd6234ce admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:25.218736 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-83e71cfa-0ea7-4528-beb6-9931fd6234ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:25.230250 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956ea9b1-4b9f-4193-a0d4-289b48061996 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:25.231387 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e71cfa-0ea7-4528-beb6-9931fd6234ce admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:25.235073 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428504f7-fe63-4e55-a5ad-562ea756c7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:25.235801 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428504f7-fe63-4e55-a5ad-562ea756c7a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:25.236082 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428504f7-fe63-4e55-a5ad-562ea756c7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:25.236360 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428504f7-fe63-4e55-a5ad-562ea756c7a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:25.236502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea28cd-2eb3-4a6a-96cb-bdc552537bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:25.237091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428504f7-fe63-4e55-a5ad-562ea756c7a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:25.237526 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea28cd-2eb3-4a6a-96cb-bdc552537bb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:25.237880 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea28cd-2eb3-4a6a-96cb-bdc552537bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:25.238227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea28cd-2eb3-4a6a-96cb-bdc552537bb9 admin admin] PATH_INFO: `/v3/users/a120976a25644875a71c96dbd9433668` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:25.238703 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428504f7-fe63-4e55-a5ad-562ea756c7a4 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:25.239528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea28cd-2eb3-4a6a-96cb-bdc552537bb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a120976a25644875a71c96dbd9433668)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:25.241704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea28cd-2eb3-4a6a-96cb-bdc552537bb9 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:25.250527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 959/1937] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:25.251385 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428504f7-fe63-4e55-a5ad-562ea756c7a4 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:25.256282 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-428504f7-fe63-4e55-a5ad-562ea756c7a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:25.274252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428504f7-fe63-4e55-a5ad-562ea756c7a4 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:25.281668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f0e43-c724-49bf-88df-1681b9ea3904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:25.282705 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f0e43-c724-49bf-88df-1681b9ea3904 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:25.282827 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f0e43-c724-49bf-88df-1681b9ea3904 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:25.283183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1f0e43-c724-49bf-88df-1681b9ea3904 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:25.284139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f0e43-c724-49bf-88df-1681b9ea3904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:25.286020 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1f0e43-c724-49bf-88df-1681b9ea3904 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:25.303713 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 960/1938] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:25.304925 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f0e43-c724-49bf-88df-1681b9ea3904 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:25.317961 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1f0e43-c724-49bf-88df-1681b9ea3904 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:25.325168 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-34ea28cd-2eb3-4a6a-96cb-bdc552537bb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a120976a25644875a71c96dbd9433668'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:25.330729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e9582-68fc-4e6b-953f-e8a8204b6f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:25.339222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-34ea28cd-2eb3-4a6a-96cb-bdc552537bb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a120976a25644875a71c96dbd9433668'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:25.339829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e9582-68fc-4e6b-953f-e8a8204b6f42 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:25.339989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-34ea28cd-2eb3-4a6a-96cb-bdc552537bb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a120976a25644875a71c96dbd9433668'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:25.340853 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-34ea28cd-2eb3-4a6a-96cb-bdc552537bb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a120976a25644875a71c96dbd9433668'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:25.341169 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e9582-68fc-4e6b-953f-e8a8204b6f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:25.341647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e9582-68fc-4e6b-953f-e8a8204b6f42 admin admin] PATH_INFO: `/v3/projects/a00c3ffe5270433f97a474793820342f/users/1708b77b7d2947fe8abbc20786434ad6/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:25.357641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-34ea28cd-2eb3-4a6a-96cb-bdc552537bb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a120976a25644875a71c96dbd9433668'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:25.361333 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e9582-68fc-4e6b-953f-e8a8204b6f42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a00c3ffe5270433f97a474793820342f, user_id=1708b77b7d2947fe8abbc20786434ad6, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:25.364022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e9582-68fc-4e6b-953f-e8a8204b6f42 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:25.374736 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 979/1939] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:25 2022] DELETE /identity/v3/users/a120976a25644875a71c96dbd9433668 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:25.376038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea28cd-2eb3-4a6a-96cb-bdc552537bb9 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:25.377477 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-34ea28cd-2eb3-4a6a-96cb-bdc552537bb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:25.380282 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 961/1940] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:25 2022] PUT /identity/v3/projects/a00c3ffe5270433f97a474793820342f/users/1708b77b7d2947fe8abbc20786434ad6/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:25.391859 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104cd3a-f114-45cd-8205-ce97f04ea54e None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:25.392154 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104cd3a-f114-45cd-8205-ce97f04ea54e None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:25.392433 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5104cd3a-f114-45cd-8205-ce97f04ea54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:25.428228 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-5104cd3a-f114-45cd-8205-ce97f04ea54e None None] MFA Rules not processed for user `1708b77b7d2947fe8abbc20786434ad6`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:25.429595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-5104cd3a-f114-45cd-8205-ce97f04ea54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:25.433391 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:INSERT=6,keystone:SELECT=84,keystone:DELETE=10 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:25.451426 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:25.474997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea28cd-2eb3-4a6a-96cb-bdc552537bb9 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:25.489371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bc8c5-297d-4159-9e8d-cddd3947f7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:25.491062 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bc8c5-297d-4159-9e8d-cddd3947f7ce admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:25.491370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bc8c5-297d-4159-9e8d-cddd3947f7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:25.491691 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9bc8c5-297d-4159-9e8d-cddd3947f7ce admin admin] PATH_INFO: `/v3/projects/572e79ce0a7c49b784aa301e367a176b/users/4cca20d97f474e52bf6581a6a8c57670/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:25.511258 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9bc8c5-297d-4159-9e8d-cddd3947f7ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=572e79ce0a7c49b784aa301e367a176b, user_id=4cca20d97f474e52bf6581a6a8c57670, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:25.514520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9bc8c5-297d-4159-9e8d-cddd3947f7ce admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:25.531300 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 980/1941] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:25 2022] PUT /identity/v3/projects/572e79ce0a7c49b784aa301e367a176b/users/4cca20d97f474e52bf6581a6a8c57670/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:25.531763 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 962/1942] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:25 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:27:25.534072 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bc8c5-297d-4159-9e8d-cddd3947f7ce admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:25.536292 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14f288-8d26-4e2e-9e3d-ce9888465bb1 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:25.536817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14f288-8d26-4e2e-9e3d-ce9888465bb1 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:25.537125 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-6b9bc8c5-297d-4159-9e8d-cddd3947f7ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:25.537680 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c14f288-8d26-4e2e-9e3d-ce9888465bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:25.568039 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-2c14f288-8d26-4e2e-9e3d-ce9888465bb1 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:25.569534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-2c14f288-8d26-4e2e-9e3d-ce9888465bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:25.691795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9bc8c5-297d-4159-9e8d-cddd3947f7ce admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:25.696624 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65693b9c-7cbf-4a62-a9d8-b9392002af2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:25.697297 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65693b9c-7cbf-4a62-a9d8-b9392002af2b admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:25.697626 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65693b9c-7cbf-4a62-a9d8-b9392002af2b admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:25.697937 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65693b9c-7cbf-4a62-a9d8-b9392002af2b admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:25.698688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65693b9c-7cbf-4a62-a9d8-b9392002af2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:25.701233 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65693b9c-7cbf-4a62-a9d8-b9392002af2b admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:25.720076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 963/1943] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:25.721693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14f288-8d26-4e2e-9e3d-ce9888465bb1 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:25.723372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-2c14f288-8d26-4e2e-9e3d-ce9888465bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:25.736367 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c14f288-8d26-4e2e-9e3d-ce9888465bb1 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:25.742707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431451e-54f1-4dd4-9e15-b6d252059ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:25.743955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431451e-54f1-4dd4-9e15-b6d252059ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:25.744369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431451e-54f1-4dd4-9e15-b6d252059ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:25.744779 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431451e-54f1-4dd4-9e15-b6d252059ef3 admin admin] PATH_INFO: `/v3/projects/020cb42e2d554316866aae789bac9f81` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:25.750189 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 981/1944] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:25 2022] POST /identity/v3/projects => generated 377 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:25.750336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431451e-54f1-4dd4-9e15-b6d252059ef3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=020cb42e2d554316866aae789bac9f81)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:25.750418 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65693b9c-7cbf-4a62-a9d8-b9392002af2b admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:25.750493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431451e-54f1-4dd4-9e15-b6d252059ef3 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:25.751920 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-65693b9c-7cbf-4a62-a9d8-b9392002af2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:25.821915 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-c431451e-54f1-4dd4-9e15-b6d252059ef3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '020cb42e2d554316866aae789bac9f81', 'request_id': 'req-c431451e-54f1-4dd4-9e15-b6d252059ef3'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:25.829025 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-c431451e-54f1-4dd4-9e15-b6d252059ef3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '020cb42e2d554316866aae789bac9f81', 'request_id': 'req-c431451e-54f1-4dd4-9e15-b6d252059ef3'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:25.836904 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-c431451e-54f1-4dd4-9e15-b6d252059ef3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '020cb42e2d554316866aae789bac9f81', 'request_id': 'req-c431451e-54f1-4dd4-9e15-b6d252059ef3'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:25.847145 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65693b9c-7cbf-4a62-a9d8-b9392002af2b admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:25.855291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-c431451e-54f1-4dd4-9e15-b6d252059ef3 admin admin] The token cache is being invalidate because project 020cb42e2d554316866aae789bac9f81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:25.856100 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-c431451e-54f1-4dd4-9e15-b6d252059ef3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:25.857359 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-c431451e-54f1-4dd4-9e15-b6d252059ef3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:25.859214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 964/1945] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:25 2022] DELETE /identity/v3/projects/020cb42e2d554316866aae789bac9f81 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:25.860398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431451e-54f1-4dd4-9e15-b6d252059ef3 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:25.862201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-c431451e-54f1-4dd4-9e15-b6d252059ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:25.922878 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:25.927344 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a88a20-3482-4cbd-8dec-9f930225f9b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:25.928247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a88a20-3482-4cbd-8dec-9f930225f9b3 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:25.928539 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a88a20-3482-4cbd-8dec-9f930225f9b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:25.928821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a88a20-3482-4cbd-8dec-9f930225f9b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:25.930944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-d6a88a20-3482-4cbd-8dec-9f930225f9b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:25.944686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:25.951174 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431451e-54f1-4dd4-9e15-b6d252059ef3 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:25.956393 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcda0b2f-302e-41ae-a933-958a562bfea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:25.957049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda0b2f-302e-41ae-a933-958a562bfea3 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:25.957397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda0b2f-302e-41ae-a933-958a562bfea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:25.957746 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcda0b2f-302e-41ae-a933-958a562bfea3 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:25.958710 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda0b2f-302e-41ae-a933-958a562bfea3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:25.960704 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcda0b2f-302e-41ae-a933-958a562bfea3 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:25.984456 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 965/1946] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:25 2022] POST /identity/v3/users => generated 289 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:25.984456 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d62a2c-e2bf-4fa7-ad37-ebe7e28c9d82 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:25.984456 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d62a2c-e2bf-4fa7-ad37-ebe7e28c9d82 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:25.984456 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d62a2c-e2bf-4fa7-ad37-ebe7e28c9d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:26.002748 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-f2d62a2c-e2bf-4fa7-ad37-ebe7e28c9d82 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:26.004012 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-f2d62a2c-e2bf-4fa7-ad37-ebe7e28c9d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:26.012053 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a88a20-3482-4cbd-8dec-9f930225f9b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:26.014242 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a88a20-3482-4cbd-8dec-9f930225f9b3 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:26.015709 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 966/1947] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:26.016593 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d62a2c-e2bf-4fa7-ad37-ebe7e28c9d82 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:26.029277 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d62a2c-e2bf-4fa7-ad37-ebe7e28c9d82 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:26.031636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 982/1948] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:26.032800 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87823aa0-2348-4e34-992b-b8c7f3da7022 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:26.033090 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87823aa0-2348-4e34-992b-b8c7f3da7022 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:26.033363 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87823aa0-2348-4e34-992b-b8c7f3da7022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:26.034773 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea86db-e86e-419a-a6ff-a312b91b6f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:26.035555 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea86db-e86e-419a-a6ff-a312b91b6f22 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:26.035949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea86db-e86e-419a-a6ff-a312b91b6f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:26.036316 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cea86db-e86e-419a-a6ff-a312b91b6f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:26.037125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea86db-e86e-419a-a6ff-a312b91b6f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:26.039218 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cea86db-e86e-419a-a6ff-a312b91b6f22 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:26.051949 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-87823aa0-2348-4e34-992b-b8c7f3da7022 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:26.055536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 967/1949] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:26.055717 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-87823aa0-2348-4e34-992b-b8c7f3da7022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:26.057122 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea86db-e86e-419a-a6ff-a312b91b6f22 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:26.063256 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 983/1950] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:26.067584 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87823aa0-2348-4e34-992b-b8c7f3da7022 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:26.070268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cea86db-e86e-419a-a6ff-a312b91b6f22 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:26.077195 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc98bfc-0839-4d7e-a97f-03d5a548fa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:26.077875 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc98bfc-0839-4d7e-a97f-03d5a548fa2d admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:26.078160 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc98bfc-0839-4d7e-a97f-03d5a548fa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:26.078437 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc98bfc-0839-4d7e-a97f-03d5a548fa2d admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:26.079188 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc98bfc-0839-4d7e-a97f-03d5a548fa2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:26.079365 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87823aa0-2348-4e34-992b-b8c7f3da7022 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:26.081650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc98bfc-0839-4d7e-a97f-03d5a548fa2d admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:26.084825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fce4af-1059-4f3c-a672-321b1ec1f70c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:26.085922 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fce4af-1059-4f3c-a672-321b1ec1f70c admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:26.086360 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fce4af-1059-4f3c-a672-321b1ec1f70c admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:26.086871 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fce4af-1059-4f3c-a672-321b1ec1f70c admin admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:26.087924 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fce4af-1059-4f3c-a672-321b1ec1f70c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:26.088472 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fce4af-1059-4f3c-a672-321b1ec1f70c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:26.090391 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fce4af-1059-4f3c-a672-321b1ec1f70c admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:26.097043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 968/1951] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:26.102367 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc98bfc-0839-4d7e-a97f-03d5a548fa2d admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:26.109257 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 984/1952] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:27:26.110315 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fce4af-1059-4f3c-a672-321b1ec1f70c admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:26.116306 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc98bfc-0839-4d7e-a97f-03d5a548fa2d admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:26.120949 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fce4af-1059-4f3c-a672-321b1ec1f70c admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:26.124122 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11f37ff-3790-474d-8738-a5d9895fa0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:26.125657 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f37ff-3790-474d-8738-a5d9895fa0f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:26.126095 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f37ff-3790-474d-8738-a5d9895fa0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:26.126522 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11f37ff-3790-474d-8738-a5d9895fa0f0 admin admin] PATH_INFO: `/v3/projects/4cb648dd25d44151be0c168093d60d4e/users/088fe2664955478fbf70b7aad86149bf/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:26.127721 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fe4e1-294f-4a64-9879-6af85dd0d7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:26.128495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fe4e1-294f-4a64-9879-6af85dd0d7c5 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:26.128830 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fe4e1-294f-4a64-9879-6af85dd0d7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:26.129117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fe4e1-294f-4a64-9879-6af85dd0d7c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:26.129822 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fe4e1-294f-4a64-9879-6af85dd0d7c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:26.133574 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76fe4e1-294f-4a64-9879-6af85dd0d7c5 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:26.150019 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f37ff-3790-474d-8738-a5d9895fa0f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cb648dd25d44151be0c168093d60d4e, user_id=088fe2664955478fbf70b7aad86149bf, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:26.154707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11f37ff-3790-474d-8738-a5d9895fa0f0 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:26.169763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 985/1953] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:26 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:26.174051 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fe4e1-294f-4a64-9879-6af85dd0d7c5 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:26.186941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 969/1954] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:26 2022] PUT /identity/v3/projects/4cb648dd25d44151be0c168093d60d4e/users/088fe2664955478fbf70b7aad86149bf/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:26.190277 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd0238-8ef9-47a7-8f7f-ff5d53ac5a11 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:26.190569 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd0238-8ef9-47a7-8f7f-ff5d53ac5a11 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:26.190851 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cd0238-8ef9-47a7-8f7f-ff5d53ac5a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:26.223187 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-41cd0238-8ef9-47a7-8f7f-ff5d53ac5a11 None None] MFA Rules not processed for user `088fe2664955478fbf70b7aad86149bf`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:26.224476 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-41cd0238-8ef9-47a7-8f7f-ff5d53ac5a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:26.258658 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fe4e1-294f-4a64-9879-6af85dd0d7c5 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:26.307664 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 970/1955] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:26 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:27:26.308725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd0238-8ef9-47a7-8f7f-ff5d53ac5a11 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:26.335408 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4da48-f0a4-4745-8655-4deb7f34951c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:26.336156 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4da48-f0a4-4745-8655-4deb7f34951c admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:26.336655 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4da48-f0a4-4745-8655-4deb7f34951c admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:26.336799 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4da48-f0a4-4745-8655-4deb7f34951c admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:26.337412 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4da48-f0a4-4745-8655-4deb7f34951c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:26.339536 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4da48-f0a4-4745-8655-4deb7f34951c admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:26.360593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:26.373592 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 986/1956] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:26 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:27:26.377970 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4da48-f0a4-4745-8655-4deb7f34951c admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:26.389503 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4da48-f0a4-4745-8655-4deb7f34951c admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:26.394742 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d96edc-360c-4795-829c-2023672fb405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:26.395486 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d96edc-360c-4795-829c-2023672fb405 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:26.395873 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d96edc-360c-4795-829c-2023672fb405 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:26.396221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d96edc-360c-4795-829c-2023672fb405 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:26.397153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d96edc-360c-4795-829c-2023672fb405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:26.399013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d96edc-360c-4795-829c-2023672fb405 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:26.410038 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41cd0238-8ef9-47a7-8f7f-ff5d53ac5a11 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:26.415603 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9f325-6b5e-4759-8e69-19e6161562b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:26.416707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9f325-6b5e-4759-8e69-19e6161562b6 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:26.417221 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9f325-6b5e-4759-8e69-19e6161562b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:26.417496 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc9f325-6b5e-4759-8e69-19e6161562b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:26.418208 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9f325-6b5e-4759-8e69-19e6161562b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:26.420703 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 987/1957] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:26.420853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc9f325-6b5e-4759-8e69-19e6161562b6 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:26.424540 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d96edc-360c-4795-829c-2023672fb405 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:26.432707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:26.437154 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d96edc-360c-4795-829c-2023672fb405 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:26.443702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a1b92-7cb8-4cf1-9257-a2d10661924b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:26.445113 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a1b92-7cb8-4cf1-9257-a2d10661924b admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:26.445514 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a1b92-7cb8-4cf1-9257-a2d10661924b admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:26.445860 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54a1b92-7cb8-4cf1-9257-a2d10661924b admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:26.446677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a1b92-7cb8-4cf1-9257-a2d10661924b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:26.448394 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54a1b92-7cb8-4cf1-9257-a2d10661924b admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:26.460016 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 971/1958] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:26 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:27:26.461258 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9f325-6b5e-4759-8e69-19e6161562b6 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:26.463277 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 988/1959] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:26.464048 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a1b92-7cb8-4cf1-9257-a2d10661924b admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:26.475749 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54a1b92-7cb8-4cf1-9257-a2d10661924b admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:26.548226 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b019576f-7ebc-4131-8071-fa9aac67a028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:26.548480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc9f325-6b5e-4759-8e69-19e6161562b6 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:26.549743 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019576f-7ebc-4131-8071-fa9aac67a028 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:26.550234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019576f-7ebc-4131-8071-fa9aac67a028 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:26.550714 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b019576f-7ebc-4131-8071-fa9aac67a028 admin admin] PATH_INFO: `/v3/projects/619e8d4c5c7b47c384ef638dff8492e8/users/59dc4a9e25cf414ba0695f13193819e5/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:26.555161 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4c13e-4279-408a-909c-64c91fe52aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:26.556059 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4c13e-4279-408a-909c-64c91fe52aaf admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:26.556446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4c13e-4279-408a-909c-64c91fe52aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:26.556724 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce4c13e-4279-408a-909c-64c91fe52aaf admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:26.557460 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4c13e-4279-408a-909c-64c91fe52aaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:26.559403 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce4c13e-4279-408a-909c-64c91fe52aaf admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:26.577421 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019576f-7ebc-4131-8071-fa9aac67a028 admin admin] RBAC: Authorizing `identity:create_grant(project_id=619e8d4c5c7b47c384ef638dff8492e8, user_id=59dc4a9e25cf414ba0695f13193819e5, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:26.581120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b019576f-7ebc-4131-8071-fa9aac67a028 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:26.589812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 972/1960] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:26 2022] POST /identity/v3/users => generated 295 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:27:26.594173 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4c13e-4279-408a-909c-64c91fe52aaf admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:26.609055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce4c13e-4279-408a-909c-64c91fe52aaf admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:26.611678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 989/1961] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:26 2022] PUT /identity/v3/projects/619e8d4c5c7b47c384ef638dff8492e8/users/59dc4a9e25cf414ba0695f13193819e5/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:26.622936 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e621a74-f8bb-4d23-a149-46a199ff2cfa None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:26.623248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e621a74-f8bb-4d23-a149-46a199ff2cfa None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:26.623595 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e621a74-f8bb-4d23-a149-46a199ff2cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:26.653735 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-4e621a74-f8bb-4d23-a149-46a199ff2cfa None None] MFA Rules not processed for user `59dc4a9e25cf414ba0695f13193819e5`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:26.655022 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-4e621a74-f8bb-4d23-a149-46a199ff2cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:26.683337 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452965a-ea6d-40d9-824f-8024310ceaa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:26.684066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452965a-ea6d-40d9-824f-8024310ceaa2 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:26.684350 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452965a-ea6d-40d9-824f-8024310ceaa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:26.684628 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7452965a-ea6d-40d9-824f-8024310ceaa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:26.686006 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452965a-ea6d-40d9-824f-8024310ceaa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:26.687824 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7452965a-ea6d-40d9-824f-8024310ceaa2 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:26.700602 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 973/1962] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:27:26.705820 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452965a-ea6d-40d9-824f-8024310ceaa2 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:26.718119 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7452965a-ea6d-40d9-824f-8024310ceaa2 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:26.724445 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fbe0e-9a95-47e1-b5e7-71c268f29552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:26.725441 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fbe0e-9a95-47e1-b5e7-71c268f29552 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:26.725734 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fbe0e-9a95-47e1-b5e7-71c268f29552 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:26.726014 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2fbe0e-9a95-47e1-b5e7-71c268f29552 admin admin] PATH_INFO: `/v3/projects/d15b26c758634910b3c80485d5db9357/users/713fe607aa8443ec9d77365ed5f56f01/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:26.741978 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fbe0e-9a95-47e1-b5e7-71c268f29552 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d15b26c758634910b3c80485d5db9357, user_id=713fe607aa8443ec9d77365ed5f56f01, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:26.742767 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 990/1963] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:26.744969 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2fbe0e-9a95-47e1-b5e7-71c268f29552 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:26.754959 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e621a74-f8bb-4d23-a149-46a199ff2cfa None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:26.756377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-4e621a74-f8bb-4d23-a149-46a199ff2cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:26.762677 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 974/1964] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:26 2022] PUT /identity/v3/projects/d15b26c758634910b3c80485d5db9357/users/713fe607aa8443ec9d77365ed5f56f01/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:26.766616 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fbe0e-9a95-47e1-b5e7-71c268f29552 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:26.826516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e621a74-f8bb-4d23-a149-46a199ff2cfa None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:26.830949 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:26.842749 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:26.858120 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2fbe0e-9a95-47e1-b5e7-71c268f29552 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:26.863008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db1e15-47d5-45ea-9e12-e54b3378c8a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:26.863716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db1e15-47d5-45ea-9e12-e54b3378c8a4 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:26.864107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db1e15-47d5-45ea-9e12-e54b3378c8a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:26.864394 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62db1e15-47d5-45ea-9e12-e54b3378c8a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:26.865188 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db1e15-47d5-45ea-9e12-e54b3378c8a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:26.866817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62db1e15-47d5-45ea-9e12-e54b3378c8a4 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:26.880319 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 975/1965] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:27:26.881378 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db1e15-47d5-45ea-9e12-e54b3378c8a4 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:26.892317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6888aeaf-8deb-41c1-af49-2b5844ba8ee2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:26.894247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888aeaf-8deb-41c1-af49-2b5844ba8ee2 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:26.894569 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888aeaf-8deb-41c1-af49-2b5844ba8ee2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:26.895182 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888aeaf-8deb-41c1-af49-2b5844ba8ee2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:26.899077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62db1e15-47d5-45ea-9e12-e54b3378c8a4 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:26.914963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e669f44-bdae-4334-8a5f-b774092c843c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:26.917423 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e669f44-bdae-4334-8a5f-b774092c843c admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:26.917999 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e669f44-bdae-4334-8a5f-b774092c843c admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:26.918379 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e669f44-bdae-4334-8a5f-b774092c843c admin admin] PATH_INFO: `/v3/projects/d15b26c758634910b3c80485d5db9357/users/713fe607aa8443ec9d77365ed5f56f01/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:26.922757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e669f44-bdae-4334-8a5f-b774092c843c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d15b26c758634910b3c80485d5db9357, user_id=713fe607aa8443ec9d77365ed5f56f01, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:26.927150 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e669f44-bdae-4334-8a5f-b774092c843c admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:26.942065 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 976/1966] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:26 2022] PUT /identity/v3/projects/d15b26c758634910b3c80485d5db9357/users/713fe607aa8443ec9d77365ed5f56f01/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:27:26.954219 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94647e1-227d-40cf-b492-6d210b2718bc None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:26.954441 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94647e1-227d-40cf-b492-6d210b2718bc None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:26.954866 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94647e1-227d-40cf-b492-6d210b2718bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:26.992566 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-e94647e1-227d-40cf-b492-6d210b2718bc None None] MFA Rules not processed for user `713fe607aa8443ec9d77365ed5f56f01`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:26.993907 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e94647e1-227d-40cf-b492-6d210b2718bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:27.020273 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888aeaf-8deb-41c1-af49-2b5844ba8ee2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:27.021759 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6888aeaf-8deb-41c1-af49-2b5844ba8ee2 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:27.035584 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 991/1967] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:26 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:27.037000 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd54dc-d0c1-4abe-9eae-3996e51a203b None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:27.037343 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd54dc-d0c1-4abe-9eae-3996e51a203b None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:27.038246 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd54dc-d0c1-4abe-9eae-3996e51a203b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:27.082782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 977/1968] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:26 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:27.083950 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94647e1-227d-40cf-b492-6d210b2718bc None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:27.085398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e94647e1-227d-40cf-b492-6d210b2718bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:27.085707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-88dd54dc-d0c1-4abe-9eae-3996e51a203b None None] MFA Rules not processed for user `4cca20d97f474e52bf6581a6a8c57670`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:27.087722 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-88dd54dc-d0c1-4abe-9eae-3996e51a203b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:27.149705 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94647e1-227d-40cf-b492-6d210b2718bc None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:27.153874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a3a57-a9d4-4e8c-a508-7726924e1137 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:27.154457 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a3a57-a9d4-4e8c-a508-7726924e1137 service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:27.154808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a3a57-a9d4-4e8c-a508-7726924e1137 service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:27.155157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917a3a57-a9d4-4e8c-a508-7726924e1137 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:27.165158 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a3a57-a9d4-4e8c-a508-7726924e1137 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:27.166724 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917a3a57-a9d4-4e8c-a508-7726924e1137 service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:27.179812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 978/1969] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:27 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:27:27.220316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 992/1970] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:27.227875 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a3a57-a9d4-4e8c-a508-7726924e1137 service cinder] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:27.242062 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917a3a57-a9d4-4e8c-a508-7726924e1137 service cinder] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:27.248068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84e8ba-a71b-480a-8630-422042df546e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:27.250024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84e8ba-a71b-480a-8630-422042df546e service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:27.250348 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84e8ba-a71b-480a-8630-422042df546e service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:27.250623 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84e8ba-a71b-480a-8630-422042df546e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:27.253263 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-ce84e8ba-a71b-480a-8630-422042df546e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:27.346032 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84e8ba-a71b-480a-8630-422042df546e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:27.347642 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84e8ba-a71b-480a-8630-422042df546e service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:27.359384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 979/1971] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:27 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:27.387957 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd54dc-d0c1-4abe-9eae-3996e51a203b None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:27.408166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd54dc-d0c1-4abe-9eae-3996e51a203b None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:27.413332 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77981d-6d70-45ee-9416-a2ebce149194 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:27.414001 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77981d-6d70-45ee-9416-a2ebce149194 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:27.415847 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77981d-6d70-45ee-9416-a2ebce149194 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:27.416152 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b77981d-6d70-45ee-9416-a2ebce149194 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:27.426134 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77981d-6d70-45ee-9416-a2ebce149194 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:27.427835 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b77981d-6d70-45ee-9416-a2ebce149194 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:27.437989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 993/1972] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:29.888321 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6d809-3b46-4ba8-86a1-7b3049a3d072 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:29.888921 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6d809-3b46-4ba8-86a1-7b3049a3d072 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:29.888921 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6d809-3b46-4ba8-86a1-7b3049a3d072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:29.894724 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:29.914045 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-d0b6d809-3b46-4ba8-86a1-7b3049a3d072 None None] MFA Rules not processed for user `4cca20d97f474e52bf6581a6a8c57670`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:29.915531 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d0b6d809-3b46-4ba8-86a1-7b3049a3d072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:29.923595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 980/1973] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:31.343408 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77981d-6d70-45ee-9416-a2ebce149194 service cinder] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:31.394866 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:31.423667 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b77981d-6d70-45ee-9416-a2ebce149194 service cinder] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:31.428511 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e06f3-d8f1-4ce0-9b63-585ab36f0eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:31.429393 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e06f3-d8f1-4ce0-9b63-585ab36f0eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:31.429681 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e06f3-d8f1-4ce0-9b63-585ab36f0eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:31.429967 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499e06f3-d8f1-4ce0-9b63-585ab36f0eb6 admin admin] PATH_INFO: `/v3/users/59dc4a9e25cf414ba0695f13193819e5` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:31.431205 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e06f3-d8f1-4ce0-9b63-585ab36f0eb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59dc4a9e25cf414ba0695f13193819e5)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:31.433234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499e06f3-d8f1-4ce0-9b63-585ab36f0eb6 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:31.488272 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-499e06f3-d8f1-4ce0-9b63-585ab36f0eb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59dc4a9e25cf414ba0695f13193819e5'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:31.495995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-499e06f3-d8f1-4ce0-9b63-585ab36f0eb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59dc4a9e25cf414ba0695f13193819e5'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:31.496938 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-499e06f3-d8f1-4ce0-9b63-585ab36f0eb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59dc4a9e25cf414ba0695f13193819e5'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:31.497588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-499e06f3-d8f1-4ce0-9b63-585ab36f0eb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59dc4a9e25cf414ba0695f13193819e5'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:31.511266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-499e06f3-d8f1-4ce0-9b63-585ab36f0eb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59dc4a9e25cf414ba0695f13193819e5'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:31.524869 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 994/1974] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:31 2022] DELETE /identity/v3/users/59dc4a9e25cf414ba0695f13193819e5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:31.530033 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc586cc7-9d61-4bed-b07c-3e71de00d3d5 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:31.530540 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc586cc7-9d61-4bed-b07c-3e71de00d3d5 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:31.530635 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc586cc7-9d61-4bed-b07c-3e71de00d3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:31.549006 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-bc586cc7-9d61-4bed-b07c-3e71de00d3d5 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:31.550441 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-bc586cc7-9d61-4bed-b07c-3e71de00d3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:31.701538 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 981/1975] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:27:31.725687 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e06f3-d8f1-4ce0-9b63-585ab36f0eb6 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:31.728994 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-499e06f3-d8f1-4ce0-9b63-585ab36f0eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:31.852417 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499e06f3-d8f1-4ce0-9b63-585ab36f0eb6 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:31.857555 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba6a06-f4bd-4da8-8716-ab77812270ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:31.858033 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba6a06-f4bd-4da8-8716-ab77812270ab service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:31.858326 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba6a06-f4bd-4da8-8716-ab77812270ab service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:31.858610 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba6a06-f4bd-4da8-8716-ab77812270ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:31.871694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba6a06-f4bd-4da8-8716-ab77812270ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:31.873294 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba6a06-f4bd-4da8-8716-ab77812270ab service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:31.886131 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 995/1976] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:31.932795 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc586cc7-9d61-4bed-b07c-3e71de00d3d5 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:31.934339 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-bc586cc7-9d61-4bed-b07c-3e71de00d3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:31.946375 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc586cc7-9d61-4bed-b07c-3e71de00d3d5 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:31.952264 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5609c-51e5-434d-a446-3874da17fc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:31.953170 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5609c-51e5-434d-a446-3874da17fc52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:31.953451 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5609c-51e5-434d-a446-3874da17fc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:31.953733 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5609c-51e5-434d-a446-3874da17fc52 admin admin] PATH_INFO: `/v3/users/695e7172fe82450cb26c82887daeeeb5` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:31.955454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5609c-51e5-434d-a446-3874da17fc52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=695e7172fe82450cb26c82887daeeeb5)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:31.958080 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5609c-51e5-434d-a446-3874da17fc52 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:32.014376 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-b6a5609c-51e5-434d-a446-3874da17fc52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '695e7172fe82450cb26c82887daeeeb5'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:32.022073 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-b6a5609c-51e5-434d-a446-3874da17fc52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '695e7172fe82450cb26c82887daeeeb5'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:32.022857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-b6a5609c-51e5-434d-a446-3874da17fc52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '695e7172fe82450cb26c82887daeeeb5'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:32.036591 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-b6a5609c-51e5-434d-a446-3874da17fc52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '695e7172fe82450cb26c82887daeeeb5'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:32.037270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-b6a5609c-51e5-434d-a446-3874da17fc52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '695e7172fe82450cb26c82887daeeeb5'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:32.050161 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 982/1977] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:31 2022] DELETE /identity/v3/users/695e7172fe82450cb26c82887daeeeb5 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:32.055578 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf988e-d500-4f46-bed4-cba678749614 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:32.055881 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf988e-d500-4f46-bed4-cba678749614 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:32.056190 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bf988e-d500-4f46-bed4-cba678749614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:32.074379 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-68bf988e-d500-4f46-bed4-cba678749614 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:32.076087 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-68bf988e-d500-4f46-bed4-cba678749614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:32.131402 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:32.147749 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 996/1978] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:32.156416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5609c-51e5-434d-a446-3874da17fc52 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:32.158016 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-b6a5609c-51e5-434d-a446-3874da17fc52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:32.223478 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5609c-51e5-434d-a446-3874da17fc52 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:32.227798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2b84c-9482-414f-8f67-648cac83090e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:32.228452 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2b84c-9482-414f-8f67-648cac83090e service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:32.228763 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2b84c-9482-414f-8f67-648cac83090e service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:32.229054 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e2b84c-9482-414f-8f67-648cac83090e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:32.238942 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2b84c-9482-414f-8f67-648cac83090e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:32.240403 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e2b84c-9482-414f-8f67-648cac83090e service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:32.250569 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 983/1979] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:32.625359 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf988e-d500-4f46-bed4-cba678749614 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:32.627642 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-68bf988e-d500-4f46-bed4-cba678749614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:32.645626 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bf988e-d500-4f46-bed4-cba678749614 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:32.657449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fab76f2-e3de-45e1-8042-9c45a551e111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:32.659430 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab76f2-e3de-45e1-8042-9c45a551e111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:32.660711 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab76f2-e3de-45e1-8042-9c45a551e111 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:32.661178 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fab76f2-e3de-45e1-8042-9c45a551e111 admin admin] PATH_INFO: `/v3/users/1708b77b7d2947fe8abbc20786434ad6` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:32.664130 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab76f2-e3de-45e1-8042-9c45a551e111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1708b77b7d2947fe8abbc20786434ad6)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:32.669164 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fab76f2-e3de-45e1-8042-9c45a551e111 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:32.732185 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2b84c-9482-414f-8f67-648cac83090e service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:32.734372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a2e2b84c-9482-414f-8f67-648cac83090e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:32.750838 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e2b84c-9482-414f-8f67-648cac83090e service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:32.755756 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2391d803-126a-4939-a011-7d780241465e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:32.756670 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391d803-126a-4939-a011-7d780241465e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:32.756953 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391d803-126a-4939-a011-7d780241465e admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:32.757407 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2391d803-126a-4939-a011-7d780241465e admin admin] PATH_INFO: `/v3/projects/619e8d4c5c7b47c384ef638dff8492e8` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:32.758962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391d803-126a-4939-a011-7d780241465e admin admin] RBAC: Authorizing `identity:delete_project(project_id=619e8d4c5c7b47c384ef638dff8492e8)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:32.761102 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2391d803-126a-4939-a011-7d780241465e admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:32.768930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:32.793236 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-5fab76f2-e3de-45e1-8042-9c45a551e111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1708b77b7d2947fe8abbc20786434ad6'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:32.815011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-5fab76f2-e3de-45e1-8042-9c45a551e111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1708b77b7d2947fe8abbc20786434ad6'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:32.815684 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-5fab76f2-e3de-45e1-8042-9c45a551e111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1708b77b7d2947fe8abbc20786434ad6'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:32.816361 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-5fab76f2-e3de-45e1-8042-9c45a551e111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1708b77b7d2947fe8abbc20786434ad6'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:32.837474 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-5fab76f2-e3de-45e1-8042-9c45a551e111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1708b77b7d2947fe8abbc20786434ad6'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:32.861276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 997/1980] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:32 2022] DELETE /identity/v3/users/1708b77b7d2947fe8abbc20786434ad6 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:32.863353 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2391d803-126a-4939-a011-7d780241465e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '619e8d4c5c7b47c384ef638dff8492e8', 'request_id': 'req-2391d803-126a-4939-a011-7d780241465e'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:32.866343 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cae59-50f5-4ee2-b114-1425a66f92a0 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:32.866838 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cae59-50f5-4ee2-b114-1425a66f92a0 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:32.867310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4cae59-50f5-4ee2-b114-1425a66f92a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:32.875300 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2391d803-126a-4939-a011-7d780241465e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '619e8d4c5c7b47c384ef638dff8492e8', 'request_id': 'req-2391d803-126a-4939-a011-7d780241465e'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:32.885910 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2391d803-126a-4939-a011-7d780241465e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '619e8d4c5c7b47c384ef638dff8492e8', 'request_id': 'req-2391d803-126a-4939-a011-7d780241465e'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:32.912485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2391d803-126a-4939-a011-7d780241465e admin admin] The token cache is being invalidate because project 619e8d4c5c7b47c384ef638dff8492e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:32.912896 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2391d803-126a-4939-a011-7d780241465e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:32.913504 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2391d803-126a-4939-a011-7d780241465e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:32.919726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 984/1981] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:32 2022] DELETE /identity/v3/projects/619e8d4c5c7b47c384ef638dff8492e8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:32.922014 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccef7e-8061-4936-aa6b-3ed716721f9d None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:32.922458 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccef7e-8061-4936-aa6b-3ed716721f9d None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:32.922831 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ccef7e-8061-4936-aa6b-3ed716721f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:32.924632 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-0e4cae59-50f5-4ee2-b114-1425a66f92a0 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:32.927117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-0e4cae59-50f5-4ee2-b114-1425a66f92a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:32.971950 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-22ccef7e-8061-4936-aa6b-3ed716721f9d None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:32.974606 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-22ccef7e-8061-4936-aa6b-3ed716721f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:33.018411 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 998/1982] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:33.019369 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4cae59-50f5-4ee2-b114-1425a66f92a0 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:33.020824 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-0e4cae59-50f5-4ee2-b114-1425a66f92a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:33.074753 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 985/1983] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:33.077358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020c68d-d979-428b-87d6-b61a67f637d5 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:33.077956 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020c68d-d979-428b-87d6-b61a67f637d5 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:33.078119 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020c68d-d979-428b-87d6-b61a67f637d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:33.103294 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4cae59-50f5-4ee2-b114-1425a66f92a0 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:33.107874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-0020c68d-d979-428b-87d6-b61a67f637d5 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:33.108434 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ffd66-75c5-46a6-a9bb-7530b47e8cbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:33.109328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ffd66-75c5-46a6-a9bb-7530b47e8cbb service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:33.109476 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-0020c68d-d979-428b-87d6-b61a67f637d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:33.109730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ffd66-75c5-46a6-a9bb-7530b47e8cbb service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:33.110081 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ffd66-75c5-46a6-a9bb-7530b47e8cbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:33.119735 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 986/1984] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:27:33.123385 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020c68d-d979-428b-87d6-b61a67f637d5 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:33.127497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ffd66-75c5-46a6-a9bb-7530b47e8cbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:33.130089 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ffd66-75c5-46a6-a9bb-7530b47e8cbb service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:33.133875 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020c68d-d979-428b-87d6-b61a67f637d5 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:33.140432 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48136d-4504-4fd5-80b6-f2d4e88dc954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:33.141242 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48136d-4504-4fd5-80b6-f2d4e88dc954 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:33.141667 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48136d-4504-4fd5-80b6-f2d4e88dc954 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:33.141951 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48136d-4504-4fd5-80b6-f2d4e88dc954 admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:33.142689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48136d-4504-4fd5-80b6-f2d4e88dc954 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:33.143000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48136d-4504-4fd5-80b6-f2d4e88dc954 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:33.144841 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48136d-4504-4fd5-80b6-f2d4e88dc954 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:33.145870 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 999/1985] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:27:33.168255 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 987/1986] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:27:33.174469 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ffd66-75c5-46a6-a9bb-7530b47e8cbb service neutron] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:33.189562 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ffd66-75c5-46a6-a9bb-7530b47e8cbb service neutron] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:33.198876 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c99e14-5fef-4afc-ad85-4912f63b4425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:33.200482 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c99e14-5fef-4afc-ad85-4912f63b4425 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:33.201026 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c99e14-5fef-4afc-ad85-4912f63b4425 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:33.201644 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c99e14-5fef-4afc-ad85-4912f63b4425 admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:33.203080 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c99e14-5fef-4afc-ad85-4912f63b4425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:33.207090 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c99e14-5fef-4afc-ad85-4912f63b4425 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:33.233300 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:33.256714 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1000/1987] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:33 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:33.260773 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48136d-4504-4fd5-80b6-f2d4e88dc954 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:33.273937 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48136d-4504-4fd5-80b6-f2d4e88dc954 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:33.361571 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c99e14-5fef-4afc-ad85-4912f63b4425 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:33.364817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-56c99e14-5fef-4afc-ad85-4912f63b4425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:33.442115 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8d005-5ee7-41a4-b1ad-d07e4b1b472c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:33.442908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8d005-5ee7-41a4-b1ad-d07e4b1b472c admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:33.443217 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8d005-5ee7-41a4-b1ad-d07e4b1b472c admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:33.443544 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8d005-5ee7-41a4-b1ad-d07e4b1b472c admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:33.444443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8d005-5ee7-41a4-b1ad-d07e4b1b472c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:33.446850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c8d005-5ee7-41a4-b1ad-d07e4b1b472c admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:33.477673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 988/1988] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:33 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:27:33.483076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8d005-5ee7-41a4-b1ad-d07e4b1b472c admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:33.497733 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:33.508288 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8d005-5ee7-41a4-b1ad-d07e4b1b472c admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:33.514919 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c99e14-5fef-4afc-ad85-4912f63b4425 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:33.522540 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee1589-4d46-4e9d-99ea-61d0aa512562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:33.524880 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee1589-4d46-4e9d-99ea-61d0aa512562 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:33.524880 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee1589-4d46-4e9d-99ea-61d0aa512562 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:33.524880 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee1589-4d46-4e9d-99ea-61d0aa512562 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:33.526701 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee1589-4d46-4e9d-99ea-61d0aa512562 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:33.534576 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254292c9-06af-42f5-add5-d7cca18fede9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:33.536790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee1589-4d46-4e9d-99ea-61d0aa512562 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:33.537270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254292c9-06af-42f5-add5-d7cca18fede9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:33.537744 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254292c9-06af-42f5-add5-d7cca18fede9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:33.538757 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254292c9-06af-42f5-add5-d7cca18fede9 admin admin] PATH_INFO: `/v3/projects/23a667ac1b4d4bbd904e4290ea5e9339` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:33.542786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254292c9-06af-42f5-add5-d7cca18fede9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=23a667ac1b4d4bbd904e4290ea5e9339)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:33.548353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254292c9-06af-42f5-add5-d7cca18fede9 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:33.567396 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 989/1989] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:33.568735 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee1589-4d46-4e9d-99ea-61d0aa512562 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:33.596275 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee1589-4d46-4e9d-99ea-61d0aa512562 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:33.611735 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f451a8-a758-41d2-b051-02e02c81f66c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:33.612717 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f451a8-a758-41d2-b051-02e02c81f66c admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:33.613009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f451a8-a758-41d2-b051-02e02c81f66c admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:33.613288 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f451a8-a758-41d2-b051-02e02c81f66c admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:33.614260 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f451a8-a758-41d2-b051-02e02c81f66c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:33.623831 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f451a8-a758-41d2-b051-02e02c81f66c admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:33.639207 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-254292c9-06af-42f5-add5-d7cca18fede9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23a667ac1b4d4bbd904e4290ea5e9339', 'request_id': 'req-254292c9-06af-42f5-add5-d7cca18fede9'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:33.645499 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-254292c9-06af-42f5-add5-d7cca18fede9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23a667ac1b4d4bbd904e4290ea5e9339', 'request_id': 'req-254292c9-06af-42f5-add5-d7cca18fede9'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:33.649588 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 990/1990] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:33 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:33.654012 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f451a8-a758-41d2-b051-02e02c81f66c admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:33.659694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-254292c9-06af-42f5-add5-d7cca18fede9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23a667ac1b4d4bbd904e4290ea5e9339', 'request_id': 'req-254292c9-06af-42f5-add5-d7cca18fede9'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:33.675450 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f451a8-a758-41d2-b051-02e02c81f66c admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:33.688240 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-254292c9-06af-42f5-add5-d7cca18fede9 admin admin] The token cache is being invalidate because project 23a667ac1b4d4bbd904e4290ea5e9339 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:33.688507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-254292c9-06af-42f5-add5-d7cca18fede9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:33.690963 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-254292c9-06af-42f5-add5-d7cca18fede9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:33.698105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1001/1991] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:33 2022] DELETE /identity/v3/projects/23a667ac1b4d4bbd904e4290ea5e9339 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:27:33.699549 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254292c9-06af-42f5-add5-d7cca18fede9 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:33.713096 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-254292c9-06af-42f5-add5-d7cca18fede9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:33.772089 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23353041-21b7-46e3-8b67-a3a6c9b4131a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:33.772923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23353041-21b7-46e3-8b67-a3a6c9b4131a admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:33.773206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23353041-21b7-46e3-8b67-a3a6c9b4131a admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:33.773482 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23353041-21b7-46e3-8b67-a3a6c9b4131a admin admin] PATH_INFO: `/v3/projects/78a025d31d8a44ae82b9496bf09ceb33/users/a0b73a2fdfa64aa18a3338bbae7c3270/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:33.801429 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23353041-21b7-46e3-8b67-a3a6c9b4131a admin admin] RBAC: Authorizing `identity:create_grant(project_id=78a025d31d8a44ae82b9496bf09ceb33, user_id=a0b73a2fdfa64aa18a3338bbae7c3270, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:33.804555 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23353041-21b7-46e3-8b67-a3a6c9b4131a admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:33.841259 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 991/1992] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:33 2022] PUT /identity/v3/projects/78a025d31d8a44ae82b9496bf09ceb33/users/a0b73a2fdfa64aa18a3338bbae7c3270/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:33.843076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66194c-648f-49ad-b8af-8e08541da054 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:33.843390 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66194c-648f-49ad-b8af-8e08541da054 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:33.843782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a66194c-648f-49ad-b8af-8e08541da054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:33.871523 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254292c9-06af-42f5-add5-d7cca18fede9 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:33.904570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-0a66194c-648f-49ad-b8af-8e08541da054 None None] MFA Rules not processed for user `a0b73a2fdfa64aa18a3338bbae7c3270`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:33.905777 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-0a66194c-648f-49ad-b8af-8e08541da054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:33.952623 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:INSERT=2,keystone:SELECT=91,keystone:DELETE=7 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:34.012472 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0861d0-4726-42ae-8f82-0950e1bef2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:34.014626 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0861d0-4726-42ae-8f82-0950e1bef2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:34.015250 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0861d0-4726-42ae-8f82-0950e1bef2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:34.016162 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0861d0-4726-42ae-8f82-0950e1bef2a5 admin admin] PATH_INFO: `/v3/users/0ff802a34e4244a9b327b84254dc0fd1` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:34.022548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0861d0-4726-42ae-8f82-0950e1bef2a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ff802a34e4244a9b327b84254dc0fd1)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:34.032052 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0861d0-4726-42ae-8f82-0950e1bef2a5 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:34.079256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 992/1993] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:34.080662 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66194c-648f-49ad-b8af-8e08541da054 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:34.085254 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-0a66194c-648f-49ad-b8af-8e08541da054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:34.109079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a66194c-648f-49ad-b8af-8e08541da054 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:34.118628 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d78b9-f678-40a5-b2a6-b1e44359e6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:34.120180 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d78b9-f678-40a5-b2a6-b1e44359e6e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:34.120459 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d78b9-f678-40a5-b2a6-b1e44359e6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:34.120734 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d78b9-f678-40a5-b2a6-b1e44359e6e2 admin admin] PATH_INFO: `/v3/projects/a00c3ffe5270433f97a474793820342f` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:34.126327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d78b9-f678-40a5-b2a6-b1e44359e6e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a00c3ffe5270433f97a474793820342f)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:34.128809 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d78b9-f678-40a5-b2a6-b1e44359e6e2 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:34.154550 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-5a0861d0-4726-42ae-8f82-0950e1bef2a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ff802a34e4244a9b327b84254dc0fd1'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:34.168492 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-5a0861d0-4726-42ae-8f82-0950e1bef2a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ff802a34e4244a9b327b84254dc0fd1'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:34.170097 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-5a0861d0-4726-42ae-8f82-0950e1bef2a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ff802a34e4244a9b327b84254dc0fd1'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:34.170988 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-5a0861d0-4726-42ae-8f82-0950e1bef2a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ff802a34e4244a9b327b84254dc0fd1'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:34.187454 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-5a0861d0-4726-42ae-8f82-0950e1bef2a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ff802a34e4244a9b327b84254dc0fd1'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:34.204528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1002/1994] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:33 2022] DELETE /identity/v3/users/0ff802a34e4244a9b327b84254dc0fd1 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:27:34.205613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0861d0-4726-42ae-8f82-0950e1bef2a5 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:34.209991 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-5a0861d0-4726-42ae-8f82-0950e1bef2a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:34.216647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8b3d78b9-f678-40a5-b2a6-b1e44359e6e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a00c3ffe5270433f97a474793820342f', 'request_id': 'req-8b3d78b9-f678-40a5-b2a6-b1e44359e6e2'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:34.218254 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:34.226009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8b3d78b9-f678-40a5-b2a6-b1e44359e6e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a00c3ffe5270433f97a474793820342f', 'request_id': 'req-8b3d78b9-f678-40a5-b2a6-b1e44359e6e2'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:34.242807 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8b3d78b9-f678-40a5-b2a6-b1e44359e6e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a00c3ffe5270433f97a474793820342f', 'request_id': 'req-8b3d78b9-f678-40a5-b2a6-b1e44359e6e2'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:34.265429 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8b3d78b9-f678-40a5-b2a6-b1e44359e6e2 admin admin] The token cache is being invalidate because project a00c3ffe5270433f97a474793820342f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:34.266021 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8b3d78b9-f678-40a5-b2a6-b1e44359e6e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:34.267032 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-8b3d78b9-f678-40a5-b2a6-b1e44359e6e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:34.270264 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 993/1995] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:34 2022] DELETE /identity/v3/projects/a00c3ffe5270433f97a474793820342f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:34.274213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d78b9-f678-40a5-b2a6-b1e44359e6e2 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:34.277085 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-8b3d78b9-f678-40a5-b2a6-b1e44359e6e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:34.297438 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0861d0-4726-42ae-8f82-0950e1bef2a5 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:34.303564 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2006a-ea3e-47e9-9f22-34ccadcc2227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:34.304827 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2006a-ea3e-47e9-9f22-34ccadcc2227 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:34.305214 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2006a-ea3e-47e9-9f22-34ccadcc2227 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:34.305577 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2006a-ea3e-47e9-9f22-34ccadcc2227 admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:34.306909 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2006a-ea3e-47e9-9f22-34ccadcc2227 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:34.309536 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c2006a-ea3e-47e9-9f22-34ccadcc2227 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:34.347543 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1003/1996] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:34 2022] POST /identity/v3/projects => generated 385 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:34.351301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2006a-ea3e-47e9-9f22-34ccadcc2227 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:34.354060 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-f2c2006a-ea3e-47e9-9f22-34ccadcc2227 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:34.371115 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d78b9-f678-40a5-b2a6-b1e44359e6e2 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:34.425113 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:34.469038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2006a-ea3e-47e9-9f22-34ccadcc2227 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:34.473853 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa2b87-d8a1-4567-9ee0-d5e44b470f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:34.474678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa2b87-d8a1-4567-9ee0-d5e44b470f81 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:34.474967 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa2b87-d8a1-4567-9ee0-d5e44b470f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:34.475245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fa2b87-d8a1-4567-9ee0-d5e44b470f81 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:34.475410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895aa02a-2512-42b0-ad2d-76885c561d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:34.475986 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa2b87-d8a1-4567-9ee0-d5e44b470f81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:34.476629 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895aa02a-2512-42b0-ad2d-76885c561d95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:34.476921 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895aa02a-2512-42b0-ad2d-76885c561d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:34.477287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895aa02a-2512-42b0-ad2d-76885c561d95 admin admin] PATH_INFO: `/v3/users/088fe2664955478fbf70b7aad86149bf` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:34.477932 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fa2b87-d8a1-4567-9ee0-d5e44b470f81 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:34.479024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895aa02a-2512-42b0-ad2d-76885c561d95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=088fe2664955478fbf70b7aad86149bf)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:34.482371 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895aa02a-2512-42b0-ad2d-76885c561d95 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:34.507042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1004/1997] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:34 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:34.510117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa2b87-d8a1-4567-9ee0-d5e44b470f81 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:34.526174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fa2b87-d8a1-4567-9ee0-d5e44b470f81 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:34.539310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044855c9-e34f-4b57-bd91-9503c2a91a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:34.540163 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044855c9-e34f-4b57-bd91-9503c2a91a5f admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:34.540521 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044855c9-e34f-4b57-bd91-9503c2a91a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:34.540891 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044855c9-e34f-4b57-bd91-9503c2a91a5f admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:34.541931 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044855c9-e34f-4b57-bd91-9503c2a91a5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:34.550140 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044855c9-e34f-4b57-bd91-9503c2a91a5f admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:34.554378 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-895aa02a-2512-42b0-ad2d-76885c561d95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '088fe2664955478fbf70b7aad86149bf'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:34.563182 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1005/1998] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:34.564181 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-895aa02a-2512-42b0-ad2d-76885c561d95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '088fe2664955478fbf70b7aad86149bf'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:34.565333 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-895aa02a-2512-42b0-ad2d-76885c561d95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '088fe2664955478fbf70b7aad86149bf'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:34.567021 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044855c9-e34f-4b57-bd91-9503c2a91a5f admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:34.569201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-044855c9-e34f-4b57-bd91-9503c2a91a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:34.581161 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-895aa02a-2512-42b0-ad2d-76885c561d95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '088fe2664955478fbf70b7aad86149bf'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:34.582387 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-895aa02a-2512-42b0-ad2d-76885c561d95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '088fe2664955478fbf70b7aad86149bf'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:34.582501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044855c9-e34f-4b57-bd91-9503c2a91a5f admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:34.586830 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8cbea7-8e07-46e3-918f-071f86915dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:34.588232 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cbea7-8e07-46e3-918f-071f86915dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:34.588232 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cbea7-8e07-46e3-918f-071f86915dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:34.588444 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cbea7-8e07-46e3-918f-071f86915dc0 admin admin] PATH_INFO: `/v3/projects/aa085dbaed334b2fa622e8ba005ec379` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:34.589478 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8cbea7-8e07-46e3-918f-071f86915dc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa085dbaed334b2fa622e8ba005ec379)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:34.591445 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8cbea7-8e07-46e3-918f-071f86915dc0 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:34.611329 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 994/1999] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:34 2022] DELETE /identity/v3/users/088fe2664955478fbf70b7aad86149bf => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:34.612618 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895aa02a-2512-42b0-ad2d-76885c561d95 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:34.616337 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-895aa02a-2512-42b0-ad2d-76885c561d95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:34.625400 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:34.683718 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0f8cbea7-8e07-46e3-918f-071f86915dc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa085dbaed334b2fa622e8ba005ec379', 'request_id': 'req-0f8cbea7-8e07-46e3-918f-071f86915dc0'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:34.696862 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0f8cbea7-8e07-46e3-918f-071f86915dc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa085dbaed334b2fa622e8ba005ec379', 'request_id': 'req-0f8cbea7-8e07-46e3-918f-071f86915dc0'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:34.706590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0f8cbea7-8e07-46e3-918f-071f86915dc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa085dbaed334b2fa622e8ba005ec379', 'request_id': 'req-0f8cbea7-8e07-46e3-918f-071f86915dc0'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:34.718348 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895aa02a-2512-42b0-ad2d-76885c561d95 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:34.722008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0f8cbea7-8e07-46e3-918f-071f86915dc0 admin admin] The token cache is being invalidate because project aa085dbaed334b2fa622e8ba005ec379 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:34.722495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0f8cbea7-8e07-46e3-918f-071f86915dc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:34.723188 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0f8cbea7-8e07-46e3-918f-071f86915dc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:34.725550 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1006/2000] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:34 2022] DELETE /identity/v3/projects/aa085dbaed334b2fa622e8ba005ec379 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:34.732483 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83abc4-49e0-41c7-8336-ada5e56cbb79 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:34.734859 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83abc4-49e0-41c7-8336-ada5e56cbb79 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:34.735161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e83abc4-49e0-41c7-8336-ada5e56cbb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:34.764829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-8e83abc4-49e0-41c7-8336-ada5e56cbb79 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:34.766749 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-8e83abc4-49e0-41c7-8336-ada5e56cbb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:34.791681 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1a030-c9a7-4543-b221-68f48e5cc253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:34.792476 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1a030-c9a7-4543-b221-68f48e5cc253 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:34.793053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1a030-c9a7-4543-b221-68f48e5cc253 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:34.793429 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd1a030-c9a7-4543-b221-68f48e5cc253 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:34.794337 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1a030-c9a7-4543-b221-68f48e5cc253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:34.796276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd1a030-c9a7-4543-b221-68f48e5cc253 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:34.820124 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 995/2001] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:34.821881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1a030-c9a7-4543-b221-68f48e5cc253 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:34.825634 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-acd1a030-c9a7-4543-b221-68f48e5cc253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:34.862704 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd1a030-c9a7-4543-b221-68f48e5cc253 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:34.867509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1007/2002] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:34.870332 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5296ce-d227-4d00-8fb4-6ca06c5283c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:34.871492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5296ce-d227-4d00-8fb4-6ca06c5283c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:34.871906 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5296ce-d227-4d00-8fb4-6ca06c5283c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:34.872254 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5296ce-d227-4d00-8fb4-6ca06c5283c6 admin admin] PATH_INFO: `/v3/projects/a9f8350de9a44114869486400d8709b1/users/8263e3c0a7c44915ac5b43d2973737a9/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:34.876489 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4bec5-8aa1-44e5-a9c5-dd3d6b75a5c8 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:34.876749 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4bec5-8aa1-44e5-a9c5-dd3d6b75a5c8 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:34.876911 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e4bec5-8aa1-44e5-a9c5-dd3d6b75a5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:34.894770 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5296ce-d227-4d00-8fb4-6ca06c5283c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9f8350de9a44114869486400d8709b1, user_id=8263e3c0a7c44915ac5b43d2973737a9, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:34.899078 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5296ce-d227-4d00-8fb4-6ca06c5283c6 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:34.906487 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-85e4bec5-8aa1-44e5-a9c5-dd3d6b75a5c8 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:34.907990 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-85e4bec5-8aa1-44e5-a9c5-dd3d6b75a5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:34.918710 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 996/2003] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:34 2022] PUT /identity/v3/projects/a9f8350de9a44114869486400d8709b1/users/8263e3c0a7c44915ac5b43d2973737a9/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:34.932523 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65616906-dc51-46c8-a5b9-c08f656024c4 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:34.932882 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65616906-dc51-46c8-a5b9-c08f656024c4 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:34.933175 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65616906-dc51-46c8-a5b9-c08f656024c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:34.961843 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:34.973824 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-65616906-dc51-46c8-a5b9-c08f656024c4 None None] MFA Rules not processed for user `8263e3c0a7c44915ac5b43d2973737a9`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:34.975438 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-65616906-dc51-46c8-a5b9-c08f656024c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:34.995861 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1008/2004] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:27:35.000292 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4bec5-8aa1-44e5-a9c5-dd3d6b75a5c8 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:35.011076 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e4bec5-8aa1-44e5-a9c5-dd3d6b75a5c8 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:35.016484 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ef101-f578-40fd-865d-975bc90eb28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:35.017205 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ef101-f578-40fd-865d-975bc90eb28a admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:35.017500 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ef101-f578-40fd-865d-975bc90eb28a admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:35.017791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ef101-f578-40fd-865d-975bc90eb28a admin admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:35.018527 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ef101-f578-40fd-865d-975bc90eb28a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:35.019160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ef101-f578-40fd-865d-975bc90eb28a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:35.020487 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ef101-f578-40fd-865d-975bc90eb28a admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:35.039800 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1009/2005] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:27:35.040826 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ef101-f578-40fd-865d-975bc90eb28a admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:35.051531 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ef101-f578-40fd-865d-975bc90eb28a admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:35.056917 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250401a-755a-4d73-bbf4-94e052c1feaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:35.057589 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250401a-755a-4d73-bbf4-94e052c1feaa admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:35.057879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250401a-755a-4d73-bbf4-94e052c1feaa admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:35.058396 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250401a-755a-4d73-bbf4-94e052c1feaa admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:35.058513 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 997/2006] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:27:35.058869 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250401a-755a-4d73-bbf4-94e052c1feaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:35.061808 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250401a-755a-4d73-bbf4-94e052c1feaa admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:35.063107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65616906-dc51-46c8-a5b9-c08f656024c4 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:35.074492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65616906-dc51-46c8-a5b9-c08f656024c4 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:35.079339 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704cfc4c-3d19-45e7-bae0-659ab0c869e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:35.080052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cfc4c-3d19-45e7-bae0-659ab0c869e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:35.080342 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cfc4c-3d19-45e7-bae0-659ab0c869e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:35.080622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704cfc4c-3d19-45e7-bae0-659ab0c869e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:35.081352 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704cfc4c-3d19-45e7-bae0-659ab0c869e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:35.083340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704cfc4c-3d19-45e7-bae0-659ab0c869e1 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:35.095507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:35.097624 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1010/2007] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:35 2022] POST /identity/v3/projects => generated 369 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:35.107308 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250401a-755a-4d73-bbf4-94e052c1feaa admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:35.132123 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 998/2008] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:35 2022] POST /identity/v3/projects => generated 383 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:27:35.132123 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704cfc4c-3d19-45e7-bae0-659ab0c869e1 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:35.133138 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-704cfc4c-3d19-45e7-bae0-659ab0c869e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:35.183275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250401a-755a-4d73-bbf4-94e052c1feaa admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:35.216918 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704cfc4c-3d19-45e7-bae0-659ab0c869e1 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:35.225899 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b1725-355f-49d2-a522-b32a07c47ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:35.226876 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b1725-355f-49d2-a522-b32a07c47ddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:35.227329 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b1725-355f-49d2-a522-b32a07c47ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:35.227680 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4b1725-355f-49d2-a522-b32a07c47ddf admin admin] PATH_INFO: `/v3/projects/4cb648dd25d44151be0c168093d60d4e` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:35.230835 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b1725-355f-49d2-a522-b32a07c47ddf admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cb648dd25d44151be0c168093d60d4e)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:35.233962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4b1725-355f-49d2-a522-b32a07c47ddf admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:35.250314 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c548327-bc3a-47e3-a9ba-70d100813c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:35.251009 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c548327-bc3a-47e3-a9ba-70d100813c3e admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:35.251313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c548327-bc3a-47e3-a9ba-70d100813c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:35.251574 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c548327-bc3a-47e3-a9ba-70d100813c3e admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:35.252861 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c548327-bc3a-47e3-a9ba-70d100813c3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:35.255768 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c548327-bc3a-47e3-a9ba-70d100813c3e admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:35.284301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1011/2009] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:35 2022] POST /identity/v3/users => generated 285 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:35.287084 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c548327-bc3a-47e3-a9ba-70d100813c3e admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:35.302381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c548327-bc3a-47e3-a9ba-70d100813c3e admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:35.306543 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-5a4b1725-355f-49d2-a522-b32a07c47ddf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cb648dd25d44151be0c168093d60d4e', 'request_id': 'req-5a4b1725-355f-49d2-a522-b32a07c47ddf'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:35.313265 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-5a4b1725-355f-49d2-a522-b32a07c47ddf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cb648dd25d44151be0c168093d60d4e', 'request_id': 'req-5a4b1725-355f-49d2-a522-b32a07c47ddf'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:35.320203 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-5a4b1725-355f-49d2-a522-b32a07c47ddf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cb648dd25d44151be0c168093d60d4e', 'request_id': 'req-5a4b1725-355f-49d2-a522-b32a07c47ddf'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:35.336231 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-5a4b1725-355f-49d2-a522-b32a07c47ddf admin admin] The token cache is being invalidate because project 4cb648dd25d44151be0c168093d60d4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:35.336526 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-5a4b1725-355f-49d2-a522-b32a07c47ddf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:35.337186 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-5a4b1725-355f-49d2-a522-b32a07c47ddf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:35.338771 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 999/2010] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:35 2022] DELETE /identity/v3/projects/4cb648dd25d44151be0c168093d60d4e => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:35.339702 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b1725-355f-49d2-a522-b32a07c47ddf admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:35.342043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-5a4b1725-355f-49d2-a522-b32a07c47ddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:35.350074 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:35.372635 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f168f69-a51d-4d2e-a80e-3362fac07ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:35.373316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f168f69-a51d-4d2e-a80e-3362fac07ea5 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:35.373607 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f168f69-a51d-4d2e-a80e-3362fac07ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:35.373939 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f168f69-a51d-4d2e-a80e-3362fac07ea5 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:35.374642 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f168f69-a51d-4d2e-a80e-3362fac07ea5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:35.376624 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f168f69-a51d-4d2e-a80e-3362fac07ea5 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:35.402385 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1012/2011] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:35 2022] POST /identity/v3/users => generated 298 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:35.402385 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f168f69-a51d-4d2e-a80e-3362fac07ea5 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:35.402385 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-8f168f69-a51d-4d2e-a80e-3362fac07ea5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:35.413670 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f168f69-a51d-4d2e-a80e-3362fac07ea5 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:35.419151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42682fff-7732-4c72-b947-c10b34495e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:35.419422 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4b1725-355f-49d2-a522-b32a07c47ddf admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:35.420053 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42682fff-7732-4c72-b947-c10b34495e20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:35.420341 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42682fff-7732-4c72-b947-c10b34495e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:35.420616 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42682fff-7732-4c72-b947-c10b34495e20 admin admin] PATH_INFO: `/v3/users/713fe607aa8443ec9d77365ed5f56f01` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:35.421819 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42682fff-7732-4c72-b947-c10b34495e20 admin admin] RBAC: Authorizing `identity:delete_user(user_id=713fe607aa8443ec9d77365ed5f56f01)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:35.423775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42682fff-7732-4c72-b947-c10b34495e20 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:35.424240 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e39fb-69b1-41c0-a1a9-6aee44164619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:35.424904 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e39fb-69b1-41c0-a1a9-6aee44164619 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:35.425752 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e39fb-69b1-41c0-a1a9-6aee44164619 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:35.426042 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5e39fb-69b1-41c0-a1a9-6aee44164619 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:35.426778 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e39fb-69b1-41c0-a1a9-6aee44164619 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:35.428498 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5e39fb-69b1-41c0-a1a9-6aee44164619 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:35.439098 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1000/2012] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:35.439773 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e39fb-69b1-41c0-a1a9-6aee44164619 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:35.441450 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-9b5e39fb-69b1-41c0-a1a9-6aee44164619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:35.454763 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5e39fb-69b1-41c0-a1a9-6aee44164619 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:35.460726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdac36-92c3-4d2b-8ac0-4c88d99e510c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:35.461324 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdac36-92c3-4d2b-8ac0-4c88d99e510c admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:35.461612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdac36-92c3-4d2b-8ac0-4c88d99e510c admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:35.461895 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdac36-92c3-4d2b-8ac0-4c88d99e510c admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:35.462650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bdac36-92c3-4d2b-8ac0-4c88d99e510c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:35.464319 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bdac36-92c3-4d2b-8ac0-4c88d99e510c admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:35.471579 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-42682fff-7732-4c72-b947-c10b34495e20 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '713fe607aa8443ec9d77365ed5f56f01'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:35.474505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1001/2013] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:35.475365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdac36-92c3-4d2b-8ac0-4c88d99e510c admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:35.479554 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-42682fff-7732-4c72-b947-c10b34495e20 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '713fe607aa8443ec9d77365ed5f56f01'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:35.480269 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-42682fff-7732-4c72-b947-c10b34495e20 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '713fe607aa8443ec9d77365ed5f56f01'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:35.481548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-42682fff-7732-4c72-b947-c10b34495e20 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '713fe607aa8443ec9d77365ed5f56f01'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:35.485981 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdac36-92c3-4d2b-8ac0-4c88d99e510c admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:35.491698 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabe407-9069-407d-97e9-0973aac5074b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:35.492400 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabe407-9069-407d-97e9-0973aac5074b admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:35.492686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabe407-9069-407d-97e9-0973aac5074b admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:35.492966 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caabe407-9069-407d-97e9-0973aac5074b admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:35.493969 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabe407-9069-407d-97e9-0973aac5074b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:35.495400 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-42682fff-7732-4c72-b947-c10b34495e20 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '713fe607aa8443ec9d77365ed5f56f01'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:35.495725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caabe407-9069-407d-97e9-0973aac5074b admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:35.497058 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:35.509032 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1002/2014] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:35.509889 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1013/2015] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:35 2022] DELETE /identity/v3/users/713fe607aa8443ec9d77365ed5f56f01 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:35.510501 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabe407-9069-407d-97e9-0973aac5074b admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:35.512700 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-caabe407-9069-407d-97e9-0973aac5074b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:35.513864 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42682fff-7732-4c72-b947-c10b34495e20 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:35.515951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-42682fff-7732-4c72-b947-c10b34495e20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:35.526544 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caabe407-9069-407d-97e9-0973aac5074b admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:35.594504 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42682fff-7732-4c72-b947-c10b34495e20 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:35.600675 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f300be5a-dc00-4420-a5a5-49a24d60f1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:35.601726 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300be5a-dc00-4420-a5a5-49a24d60f1c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:35.602020 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300be5a-dc00-4420-a5a5-49a24d60f1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:35.602682 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f300be5a-dc00-4420-a5a5-49a24d60f1c6 admin admin] PATH_INFO: `/v3/projects/6d93a014f9d74c60aa5a1dd3868da0c5/users/32e4568c5d2b448dbdd6467027ffc6ed/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:35.602944 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b85587-1c0c-4881-b928-82042f35f779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:35.604093 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b85587-1c0c-4881-b928-82042f35f779 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:35.604385 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b85587-1c0c-4881-b928-82042f35f779 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:35.604699 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b85587-1c0c-4881-b928-82042f35f779 admin admin] PATH_INFO: `/v3/projects/a9a7bc91444241f3aabce340f96d8ae9/users/b0fb321c16114da4ba07c88273cf997e/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:35.622571 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300be5a-dc00-4420-a5a5-49a24d60f1c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d93a014f9d74c60aa5a1dd3868da0c5, user_id=32e4568c5d2b448dbdd6467027ffc6ed, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:35.625702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f300be5a-dc00-4420-a5a5-49a24d60f1c6 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:35.634467 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b85587-1c0c-4881-b928-82042f35f779 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a7bc91444241f3aabce340f96d8ae9, user_id=b0fb321c16114da4ba07c88273cf997e, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:35.638671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b85587-1c0c-4881-b928-82042f35f779 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:35.645859 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1014/2016] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:35 2022] PUT /identity/v3/projects/6d93a014f9d74c60aa5a1dd3868da0c5/users/32e4568c5d2b448dbdd6467027ffc6ed/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:35.656020 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff9ce3-1a85-42ce-b92c-a946693646c1 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:35.656508 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff9ce3-1a85-42ce-b92c-a946693646c1 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:35.656892 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fff9ce3-1a85-42ce-b92c-a946693646c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:35.671895 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1003/2017] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:35 2022] PUT /identity/v3/projects/a9a7bc91444241f3aabce340f96d8ae9/users/b0fb321c16114da4ba07c88273cf997e/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:35.671895 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b85587-1c0c-4881-b928-82042f35f779 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:35.696402 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-7fff9ce3-1a85-42ce-b92c-a946693646c1 None None] MFA Rules not processed for user `32e4568c5d2b448dbdd6467027ffc6ed`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:35.697617 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-7fff9ce3-1a85-42ce-b92c-a946693646c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:35.714091 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:35.748238 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b85587-1c0c-4881-b928-82042f35f779 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:35.754831 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b76343-6faf-404e-ab5c-1f81e8e06324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:35.755897 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b76343-6faf-404e-ab5c-1f81e8e06324 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:35.756315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b76343-6faf-404e-ab5c-1f81e8e06324 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:35.756472 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b76343-6faf-404e-ab5c-1f81e8e06324 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:35.757192 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b76343-6faf-404e-ab5c-1f81e8e06324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:35.759897 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b76343-6faf-404e-ab5c-1f81e8e06324 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:35.772378 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1004/2018] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:35.776824 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b76343-6faf-404e-ab5c-1f81e8e06324 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:35.783741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1015/2019] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:35 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:35.787583 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff9ce3-1a85-42ce-b92c-a946693646c1 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:35.787879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b76343-6faf-404e-ab5c-1f81e8e06324 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:35.794190 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6c2d7-f684-46d5-8782-15848a498086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:35.800233 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6c2d7-f684-46d5-8782-15848a498086 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:35.800772 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6c2d7-f684-46d5-8782-15848a498086 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:35.800881 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fff9ce3-1a85-42ce-b92c-a946693646c1 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:35.802246 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6c2d7-f684-46d5-8782-15848a498086 admin admin] PATH_INFO: `/v3/projects/a9a7bc91444241f3aabce340f96d8ae9/users/b0fb321c16114da4ba07c88273cf997e/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:35.805246 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6c2d7-f684-46d5-8782-15848a498086 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9a7bc91444241f3aabce340f96d8ae9, user_id=b0fb321c16114da4ba07c88273cf997e, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:35.806262 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02e228-18b4-4007-8ce5-d05babd5320a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:35.807180 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02e228-18b4-4007-8ce5-d05babd5320a admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:35.807561 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02e228-18b4-4007-8ce5-d05babd5320a admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:35.807896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02e228-18b4-4007-8ce5-d05babd5320a admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:35.808606 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6c2d7-f684-46d5-8782-15848a498086 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:35.808964 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02e228-18b4-4007-8ce5-d05babd5320a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:35.811336 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe02e228-18b4-4007-8ce5-d05babd5320a admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:35.820947 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1005/2020] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:35 2022] PUT /identity/v3/projects/a9a7bc91444241f3aabce340f96d8ae9/users/b0fb321c16114da4ba07c88273cf997e/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:27:35.831027 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703679f-46ab-41b4-b1f1-d33011851fa8 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:35.831321 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703679f-46ab-41b4-b1f1-d33011851fa8 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:35.831682 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3703679f-46ab-41b4-b1f1-d33011851fa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:35.853161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1016/2021] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:35 2022] POST /identity/v3/projects => generated 369 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:27:35.857164 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02e228-18b4-4007-8ce5-d05babd5320a admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:35.863315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-3703679f-46ab-41b4-b1f1-d33011851fa8 None None] MFA Rules not processed for user `b0fb321c16114da4ba07c88273cf997e`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:35.864640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-3703679f-46ab-41b4-b1f1-d33011851fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:35.920206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:35.924052 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe02e228-18b4-4007-8ce5-d05babd5320a admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:35.929184 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6bb72-4476-4f3a-ad99-d4ea1cdb4c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:35.929863 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6bb72-4476-4f3a-ad99-d4ea1cdb4c38 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:35.930149 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6bb72-4476-4f3a-ad99-d4ea1cdb4c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:35.930428 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6bb72-4476-4f3a-ad99-d4ea1cdb4c38 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:35.931118 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6bb72-4476-4f3a-ad99-d4ea1cdb4c38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:35.933096 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6bb72-4476-4f3a-ad99-d4ea1cdb4c38 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:35.945706 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1006/2022] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:27:35.946659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703679f-46ab-41b4-b1f1-d33011851fa8 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:35.948027 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-3703679f-46ab-41b4-b1f1-d33011851fa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:35.960761 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1017/2023] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:35 2022] POST /identity/v3/users => generated 291 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:27:35.960761 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6bb72-4476-4f3a-ad99-d4ea1cdb4c38 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:35.960761 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-afc6bb72-4476-4f3a-ad99-d4ea1cdb4c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:35.966316 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3703679f-46ab-41b4-b1f1-d33011851fa8 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:35.971510 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057fa0e-d8af-409d-8814-f85a08c1b8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:35.972494 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057fa0e-d8af-409d-8814-f85a08c1b8d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:35.972785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057fa0e-d8af-409d-8814-f85a08c1b8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:35.973066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b057fa0e-d8af-409d-8814-f85a08c1b8d5 admin admin] PATH_INFO: `/v3/projects/d15b26c758634910b3c80485d5db9357` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:35.974261 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057fa0e-d8af-409d-8814-f85a08c1b8d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d15b26c758634910b3c80485d5db9357)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:35.976328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b057fa0e-d8af-409d-8814-f85a08c1b8d5 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:36.019316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6bb72-4476-4f3a-ad99-d4ea1cdb4c38 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:36.023659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-b057fa0e-d8af-409d-8814-f85a08c1b8d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd15b26c758634910b3c80485d5db9357', 'request_id': 'req-b057fa0e-d8af-409d-8814-f85a08c1b8d5'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:36.029595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-b057fa0e-d8af-409d-8814-f85a08c1b8d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd15b26c758634910b3c80485d5db9357', 'request_id': 'req-b057fa0e-d8af-409d-8814-f85a08c1b8d5'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:36.035977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-b057fa0e-d8af-409d-8814-f85a08c1b8d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd15b26c758634910b3c80485d5db9357', 'request_id': 'req-b057fa0e-d8af-409d-8814-f85a08c1b8d5'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:36.050024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-b057fa0e-d8af-409d-8814-f85a08c1b8d5 admin admin] The token cache is being invalidate because project d15b26c758634910b3c80485d5db9357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:36.050318 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-b057fa0e-d8af-409d-8814-f85a08c1b8d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:36.051125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-b057fa0e-d8af-409d-8814-f85a08c1b8d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:36.052799 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1007/2024] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:35 2022] DELETE /identity/v3/projects/d15b26c758634910b3c80485d5db9357 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:36.056410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057fa0e-d8af-409d-8814-f85a08c1b8d5 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:36.059666 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:36.060565 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-b057fa0e-d8af-409d-8814-f85a08c1b8d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:36.080348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1649fcc-2ce0-42a9-a59d-9a5d29f7c32c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:36.081434 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1649fcc-2ce0-42a9-a59d-9a5d29f7c32c service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:36.081727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1649fcc-2ce0-42a9-a59d-9a5d29f7c32c service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:36.082059 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1649fcc-2ce0-42a9-a59d-9a5d29f7c32c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:36.084226 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-e1649fcc-2ce0-42a9-a59d-9a5d29f7c32c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:36.139258 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b057fa0e-d8af-409d-8814-f85a08c1b8d5 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:36.144102 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c0eeb-5749-4aa7-9499-8cd33cc8a276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:36.144771 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c0eeb-5749-4aa7-9499-8cd33cc8a276 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:36.145054 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c0eeb-5749-4aa7-9499-8cd33cc8a276 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:36.145475 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c0eeb-5749-4aa7-9499-8cd33cc8a276 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:36.146205 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c0eeb-5749-4aa7-9499-8cd33cc8a276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:36.149772 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c0eeb-5749-4aa7-9499-8cd33cc8a276 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:36.151151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1649fcc-2ce0-42a9-a59d-9a5d29f7c32c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:36.152632 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1649fcc-2ce0-42a9-a59d-9a5d29f7c32c service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:36.161663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1008/2025] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:36.162973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1018/2026] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:36.165749 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1649fcc-2ce0-42a9-a59d-9a5d29f7c32c service cinder] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:36.166075 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ba245-8941-4b1a-b10f-ef3044717509 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:36.166417 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ba245-8941-4b1a-b10f-ef3044717509 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:36.166788 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570ba245-8941-4b1a-b10f-ef3044717509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:36.179441 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1649fcc-2ce0-42a9-a59d-9a5d29f7c32c service cinder] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:36.187095 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18547ae0-8c21-4819-8f87-6055354b3449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:36.187302 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-570ba245-8941-4b1a-b10f-ef3044717509 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:36.188364 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18547ae0-8c21-4819-8f87-6055354b3449 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:36.188713 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-570ba245-8941-4b1a-b10f-ef3044717509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:36.188831 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18547ae0-8c21-4819-8f87-6055354b3449 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:36.189167 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18547ae0-8c21-4819-8f87-6055354b3449 admin admin] PATH_INFO: `/v3/projects/5b00d29735154af0a44572838463bd5d/users/045e7ffd67eb414cb240aeab4511820e/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:36.197560 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1009/2027] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:36.205545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf37dc3-b948-4c87-95ef-12341528f1e0 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:36.205835 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf37dc3-b948-4c87-95ef-12341528f1e0 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:36.206109 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf37dc3-b948-4c87-95ef-12341528f1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:36.211142 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18547ae0-8c21-4819-8f87-6055354b3449 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b00d29735154af0a44572838463bd5d, user_id=045e7ffd67eb414cb240aeab4511820e, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:36.213918 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18547ae0-8c21-4819-8f87-6055354b3449 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:36.229198 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-ebf37dc3-b948-4c87-95ef-12341528f1e0 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:36.230379 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1019/2028] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:36 2022] PUT /identity/v3/projects/5b00d29735154af0a44572838463bd5d/users/045e7ffd67eb414cb240aeab4511820e/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:36.230605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-ebf37dc3-b948-4c87-95ef-12341528f1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:36.234692 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18547ae0-8c21-4819-8f87-6055354b3449 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:36.288821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:36.312198 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18547ae0-8c21-4819-8f87-6055354b3449 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:36.318480 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e148a8-2513-459d-810f-c04c74db1c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:36.319282 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e148a8-2513-459d-810f-c04c74db1c58 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:36.319670 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e148a8-2513-459d-810f-c04c74db1c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:36.320109 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e148a8-2513-459d-810f-c04c74db1c58 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:36.321101 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e148a8-2513-459d-810f-c04c74db1c58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:36.322880 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e148a8-2513-459d-810f-c04c74db1c58 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:36.325060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1010/2029] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:36.334716 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1020/2030] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:27:36.335052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf37dc3-b948-4c87-95ef-12341528f1e0 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:36.338968 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e148a8-2513-459d-810f-c04c74db1c58 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:36.351775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e148a8-2513-459d-810f-c04c74db1c58 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:36.353234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf37dc3-b948-4c87-95ef-12341528f1e0 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:36.359223 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda5c600-04a5-4a3c-b32f-3ceb087a06db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:36.360662 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5c600-04a5-4a3c-b32f-3ceb087a06db admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:36.361276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5c600-04a5-4a3c-b32f-3ceb087a06db admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:36.361927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda5c600-04a5-4a3c-b32f-3ceb087a06db admin admin] PATH_INFO: `/v3/projects/5b00d29735154af0a44572838463bd5d/users/045e7ffd67eb414cb240aeab4511820e/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:36.364619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5c600-04a5-4a3c-b32f-3ceb087a06db admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b00d29735154af0a44572838463bd5d, user_id=045e7ffd67eb414cb240aeab4511820e, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:36.366869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d09a5-ba0c-4073-8eaa-d9469e7a2864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:36.367714 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d09a5-ba0c-4073-8eaa-d9469e7a2864 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:36.367845 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda5c600-04a5-4a3c-b32f-3ceb087a06db admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:36.368120 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d09a5-ba0c-4073-8eaa-d9469e7a2864 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:36.368401 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3d09a5-ba0c-4073-8eaa-d9469e7a2864 admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:36.369145 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d09a5-ba0c-4073-8eaa-d9469e7a2864 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:36.369495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d09a5-ba0c-4073-8eaa-d9469e7a2864 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:36.371789 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3d09a5-ba0c-4073-8eaa-d9469e7a2864 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:36.391273 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1021/2031] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:36 2022] PUT /identity/v3/projects/5b00d29735154af0a44572838463bd5d/users/045e7ffd67eb414cb240aeab4511820e/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:36.395602 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f532ad-09dc-4390-bbcf-a4074f869f8a None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:36.396432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f532ad-09dc-4390-bbcf-a4074f869f8a None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:36.397011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f532ad-09dc-4390-bbcf-a4074f869f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:36.401895 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1011/2032] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:27:36.403338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d09a5-ba0c-4073-8eaa-d9469e7a2864 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:36.416441 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3d09a5-ba0c-4073-8eaa-d9469e7a2864 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:36.437431 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-82f532ad-09dc-4390-bbcf-a4074f869f8a None None] MFA Rules not processed for user `045e7ffd67eb414cb240aeab4511820e`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:36.439239 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-82f532ad-09dc-4390-bbcf-a4074f869f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:36.530833 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:36.540873 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fab54a-9183-440a-bf1a-07e58b16fd56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:36.541724 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fab54a-9183-440a-bf1a-07e58b16fd56 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:36.542097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fab54a-9183-440a-bf1a-07e58b16fd56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:36.542528 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fab54a-9183-440a-bf1a-07e58b16fd56 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:36.544429 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fab54a-9183-440a-bf1a-07e58b16fd56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:36.547270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fab54a-9183-440a-bf1a-07e58b16fd56 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:36.569605 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1022/2033] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:36 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:27:36.582691 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f532ad-09dc-4390-bbcf-a4074f869f8a None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:36.585180 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-82f532ad-09dc-4390-bbcf-a4074f869f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:36.612206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1012/2034] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:36 2022] POST /identity/v3/projects => generated 367 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:36.612206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fab54a-9183-440a-bf1a-07e58b16fd56 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:36.681124 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f532ad-09dc-4390-bbcf-a4074f869f8a None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:36.759157 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1af80d-3aca-4287-9982-73a83ec2cad6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:36.761012 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1af80d-3aca-4287-9982-73a83ec2cad6 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:36.761564 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1af80d-3aca-4287-9982-73a83ec2cad6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:36.761849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1af80d-3aca-4287-9982-73a83ec2cad6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:36.791978 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fab54a-9183-440a-bf1a-07e58b16fd56 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:36.800618 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59aa6ad-6cb0-454e-b964-8c169b372a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:36.803829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59aa6ad-6cb0-454e-b964-8c169b372a38 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:36.804927 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59aa6ad-6cb0-454e-b964-8c169b372a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:36.806890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59aa6ad-6cb0-454e-b964-8c169b372a38 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:36.807759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59aa6ad-6cb0-454e-b964-8c169b372a38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:36.812425 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59aa6ad-6cb0-454e-b964-8c169b372a38 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:36.866886 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1013/2035] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:36 2022] POST /identity/v3/users => generated 284 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:36.871137 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59aa6ad-6cb0-454e-b964-8c169b372a38 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:36.871421 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1af80d-3aca-4287-9982-73a83ec2cad6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:36.872964 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1af80d-3aca-4287-9982-73a83ec2cad6 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:36.882065 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59aa6ad-6cb0-454e-b964-8c169b372a38 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:36.884416 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1023/2036] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:36 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:27:36.888179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea89af6-db6d-4c27-83ed-ef27aacbcb56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:36.888846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea89af6-db6d-4c27-83ed-ef27aacbcb56 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:36.889127 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea89af6-db6d-4c27-83ed-ef27aacbcb56 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:36.889408 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea89af6-db6d-4c27-83ed-ef27aacbcb56 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:36.890135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea89af6-db6d-4c27-83ed-ef27aacbcb56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:36.891762 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea89af6-db6d-4c27-83ed-ef27aacbcb56 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:36.902241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1014/2037] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:27:36.906819 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1af80d-3aca-4287-9982-73a83ec2cad6 service cinder] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:36.918826 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1af80d-3aca-4287-9982-73a83ec2cad6 service cinder] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:36.924279 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48331b-4ceb-416c-9817-8783c5c37649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:36.925550 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48331b-4ceb-416c-9817-8783c5c37649 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:36.925550 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48331b-4ceb-416c-9817-8783c5c37649 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:36.926002 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b48331b-4ceb-416c-9817-8783c5c37649 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:36.926924 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48331b-4ceb-416c-9817-8783c5c37649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:36.928914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b48331b-4ceb-416c-9817-8783c5c37649 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:36.943300 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1024/2038] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:36.947110 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea89af6-db6d-4c27-83ed-ef27aacbcb56 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:36.948986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-bea89af6-db6d-4c27-83ed-ef27aacbcb56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:36.951449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48331b-4ceb-416c-9817-8783c5c37649 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:36.961367 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b48331b-4ceb-416c-9817-8783c5c37649 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:36.962961 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea89af6-db6d-4c27-83ed-ef27aacbcb56 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:36.967373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684ba28-b68a-4915-881c-963b61123a41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:36.968074 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684ba28-b68a-4915-881c-963b61123a41 service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:36.968352 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4dad4e-1f18-4700-bf96-3ee9d686971f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:36.968506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684ba28-b68a-4915-881c-963b61123a41 service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:36.968623 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7684ba28-b68a-4915-881c-963b61123a41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:36.969507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dad4e-1f18-4700-bf96-3ee9d686971f admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:36.969912 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dad4e-1f18-4700-bf96-3ee9d686971f admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:36.970590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4dad4e-1f18-4700-bf96-3ee9d686971f admin admin] PATH_INFO: `/v3/projects/796816aee4fe49bdb69879ae2e9b6744/users/2a089ba1f0fb462ab5a939f54eae6e51/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:36.970790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-7684ba28-b68a-4915-881c-963b61123a41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:36.986643 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4dad4e-1f18-4700-bf96-3ee9d686971f admin admin] RBAC: Authorizing `identity:create_grant(project_id=796816aee4fe49bdb69879ae2e9b6744, user_id=2a089ba1f0fb462ab5a939f54eae6e51, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:36.989398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4dad4e-1f18-4700-bf96-3ee9d686971f admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:37.005993 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1025/2039] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:36 2022] PUT /identity/v3/projects/796816aee4fe49bdb69879ae2e9b6744/users/2a089ba1f0fb462ab5a939f54eae6e51/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:37.022528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2c393-78c9-439e-bb7e-bbc00f4413ae None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:37.022921 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2c393-78c9-439e-bb7e-bbc00f4413ae None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:37.023301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de2c393-78c9-439e-bb7e-bbc00f4413ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:37.039654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:37.050156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:37.058017 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-4de2c393-78c9-439e-bb7e-bbc00f4413ae None None] MFA Rules not processed for user `2a089ba1f0fb462ab5a939f54eae6e51`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:37.059397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-4de2c393-78c9-439e-bb7e-bbc00f4413ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:37.062544 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684ba28-b68a-4915-881c-963b61123a41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:37.064336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7684ba28-b68a-4915-881c-963b61123a41 service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:37.075395 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1015/2040] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:36 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:27:37.133952 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1026/2041] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:37 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:37.147104 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684ba28-b68a-4915-881c-963b61123a41 service cinder] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:37.148541 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-7684ba28-b68a-4915-881c-963b61123a41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:37.224998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7684ba28-b68a-4915-881c-963b61123a41 service cinder] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:37.314450 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f195caf-3dd1-43b8-b84e-037f30739c42 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faaab5440b7041faa5a6f9ea18c188c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:37.316036 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f195caf-3dd1-43b8-b84e-037f30739c42 service glance] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:37.316342 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f195caf-3dd1-43b8-b84e-037f30739c42 service glance] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:37.317895 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f195caf-3dd1-43b8-b84e-037f30739c42 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:37.349093 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f195caf-3dd1-43b8-b84e-037f30739c42 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:37.350635 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f195caf-3dd1-43b8-b84e-037f30739c42 service glance] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:37.367814 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1016/2042] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:37 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:37.978454 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2c393-78c9-439e-bb7e-bbc00f4413ae None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:38.039202 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de2c393-78c9-439e-bb7e-bbc00f4413ae None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:38.042975 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55823898-c6f9-4e60-9c4e-8ebc566ab8a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:38.043686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55823898-c6f9-4e60-9c4e-8ebc566ab8a6 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:38.043979 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55823898-c6f9-4e60-9c4e-8ebc566ab8a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:38.044264 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55823898-c6f9-4e60-9c4e-8ebc566ab8a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:38.046174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-55823898-c6f9-4e60-9c4e-8ebc566ab8a6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:38.104182 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55823898-c6f9-4e60-9c4e-8ebc566ab8a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:38.106160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55823898-c6f9-4e60-9c4e-8ebc566ab8a6 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:38.115829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1027/2043] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:38.826640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f195caf-3dd1-43b8-b84e-037f30739c42 service glance] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:38.838673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f195caf-3dd1-43b8-b84e-037f30739c42 service glance] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:38.843228 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df8efd-9f30-4fa4-b756-32bfc1845253 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:38.844439 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df8efd-9f30-4fa4-b756-32bfc1845253 service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:38.844819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df8efd-9f30-4fa4-b756-32bfc1845253 service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:38.845197 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df8efd-9f30-4fa4-b756-32bfc1845253 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:38.847182 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-b1df8efd-9f30-4fa4-b756-32bfc1845253 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:38.931168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df8efd-9f30-4fa4-b756-32bfc1845253 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:38.932867 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df8efd-9f30-4fa4-b756-32bfc1845253 service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:38.956785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1017/2044] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:40.853498 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55823898-c6f9-4e60-9c4e-8ebc566ab8a6 service cinder] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:40.917163 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:40.936705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55823898-c6f9-4e60-9c4e-8ebc566ab8a6 service cinder] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:40.941316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d0d67-4829-4ad3-866a-5246b632ccf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:40.942232 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d0d67-4829-4ad3-866a-5246b632ccf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:40.942518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d0d67-4829-4ad3-866a-5246b632ccf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:40.942801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d0d67-4829-4ad3-866a-5246b632ccf1 admin admin] PATH_INFO: `/v3/users/32e4568c5d2b448dbdd6467027ffc6ed` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:40.944080 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d0d67-4829-4ad3-866a-5246b632ccf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32e4568c5d2b448dbdd6467027ffc6ed)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:40.946287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0d0d67-4829-4ad3-866a-5246b632ccf1 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:41.008138 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-da0d0d67-4829-4ad3-866a-5246b632ccf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32e4568c5d2b448dbdd6467027ffc6ed'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:41.016039 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-da0d0d67-4829-4ad3-866a-5246b632ccf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32e4568c5d2b448dbdd6467027ffc6ed'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:41.016655 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-da0d0d67-4829-4ad3-866a-5246b632ccf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32e4568c5d2b448dbdd6467027ffc6ed'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:41.017293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-da0d0d67-4829-4ad3-866a-5246b632ccf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32e4568c5d2b448dbdd6467027ffc6ed'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:41.029350 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-da0d0d67-4829-4ad3-866a-5246b632ccf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32e4568c5d2b448dbdd6467027ffc6ed'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:41.041310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1028/2045] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:40 2022] DELETE /identity/v3/users/32e4568c5d2b448dbdd6467027ffc6ed => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:41.045880 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125eb1f-2fdc-46d0-a795-447a6bb0b14b None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:41.046387 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125eb1f-2fdc-46d0-a795-447a6bb0b14b None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:41.046553 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b125eb1f-2fdc-46d0-a795-447a6bb0b14b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:41.064520 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-b125eb1f-2fdc-46d0-a795-447a6bb0b14b None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:41.065779 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-b125eb1f-2fdc-46d0-a795-447a6bb0b14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:41.108759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:41.147958 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1018/2046] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:41.157403 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d0d67-4829-4ad3-866a-5246b632ccf1 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:41.159039 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-da0d0d67-4829-4ad3-866a-5246b632ccf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:41.217103 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0d0d67-4829-4ad3-866a-5246b632ccf1 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:41.220714 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b52bb9-8f0a-49e3-8f23-e8b922afd4a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:41.221351 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b52bb9-8f0a-49e3-8f23-e8b922afd4a8 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:41.221637 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b52bb9-8f0a-49e3-8f23-e8b922afd4a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:41.221944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b52bb9-8f0a-49e3-8f23-e8b922afd4a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:41.231801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b52bb9-8f0a-49e3-8f23-e8b922afd4a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:41.233242 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b52bb9-8f0a-49e3-8f23-e8b922afd4a8 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:41.243068 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1029/2047] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:41.512101 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125eb1f-2fdc-46d0-a795-447a6bb0b14b None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:41.513623 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-b125eb1f-2fdc-46d0-a795-447a6bb0b14b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:41.529473 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b125eb1f-2fdc-46d0-a795-447a6bb0b14b None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:41.534150 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96627e8e-c9d0-413b-8412-89a1666160a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:41.535022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96627e8e-c9d0-413b-8412-89a1666160a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:41.535391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96627e8e-c9d0-413b-8412-89a1666160a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:41.535570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96627e8e-c9d0-413b-8412-89a1666160a1 admin admin] PATH_INFO: `/v3/projects/6d93a014f9d74c60aa5a1dd3868da0c5` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:41.536786 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96627e8e-c9d0-413b-8412-89a1666160a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d93a014f9d74c60aa5a1dd3868da0c5)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:41.538719 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96627e8e-c9d0-413b-8412-89a1666160a1 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:41.585422 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-96627e8e-c9d0-413b-8412-89a1666160a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d93a014f9d74c60aa5a1dd3868da0c5', 'request_id': 'req-96627e8e-c9d0-413b-8412-89a1666160a1'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:41.591479 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-96627e8e-c9d0-413b-8412-89a1666160a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d93a014f9d74c60aa5a1dd3868da0c5', 'request_id': 'req-96627e8e-c9d0-413b-8412-89a1666160a1'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:41.597953 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-96627e8e-c9d0-413b-8412-89a1666160a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d93a014f9d74c60aa5a1dd3868da0c5', 'request_id': 'req-96627e8e-c9d0-413b-8412-89a1666160a1'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:41.611751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-96627e8e-c9d0-413b-8412-89a1666160a1 admin admin] The token cache is being invalidate because project 6d93a014f9d74c60aa5a1dd3868da0c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:41.612026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-96627e8e-c9d0-413b-8412-89a1666160a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:41.612719 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-96627e8e-c9d0-413b-8412-89a1666160a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:41.614359 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1019/2048] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:41 2022] DELETE /identity/v3/projects/6d93a014f9d74c60aa5a1dd3868da0c5 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:41.618517 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b52bb9-8f0a-49e3-8f23-e8b922afd4a8 service neutron] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:41.629116 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b52bb9-8f0a-49e3-8f23-e8b922afd4a8 service neutron] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:41.692722 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a36a22-7b9b-4ab1-bc29-bd014d18b61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:41.693688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a36a22-7b9b-4ab1-bc29-bd014d18b61d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:41.693976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a36a22-7b9b-4ab1-bc29-bd014d18b61d admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:41.694257 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a36a22-7b9b-4ab1-bc29-bd014d18b61d admin admin] PATH_INFO: `/v3/users/045e7ffd67eb414cb240aeab4511820e` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:41.695789 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a36a22-7b9b-4ab1-bc29-bd014d18b61d admin admin] RBAC: Authorizing `identity:delete_user(user_id=045e7ffd67eb414cb240aeab4511820e)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:41.697865 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a36a22-7b9b-4ab1-bc29-bd014d18b61d admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:41.712502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:41.754199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-98a36a22-7b9b-4ab1-bc29-bd014d18b61d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '045e7ffd67eb414cb240aeab4511820e'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:41.763059 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-98a36a22-7b9b-4ab1-bc29-bd014d18b61d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '045e7ffd67eb414cb240aeab4511820e'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:41.763718 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-98a36a22-7b9b-4ab1-bc29-bd014d18b61d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '045e7ffd67eb414cb240aeab4511820e'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:41.764469 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-98a36a22-7b9b-4ab1-bc29-bd014d18b61d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '045e7ffd67eb414cb240aeab4511820e'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:41.782622 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-98a36a22-7b9b-4ab1-bc29-bd014d18b61d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '045e7ffd67eb414cb240aeab4511820e'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:41.798527 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1030/2049] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:41 2022] DELETE /identity/v3/users/045e7ffd67eb414cb240aeab4511820e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:42.091411 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96627e8e-c9d0-413b-8412-89a1666160a1 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:42.092892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-96627e8e-c9d0-413b-8412-89a1666160a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:42.107029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96627e8e-c9d0-413b-8412-89a1666160a1 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:42.171461 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806b9a2b-3b29-4a1f-8b31-e2a3418c161c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:42.172585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b9a2b-3b29-4a1f-8b31-e2a3418c161c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:42.172969 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b9a2b-3b29-4a1f-8b31-e2a3418c161c admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:42.173346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b9a2b-3b29-4a1f-8b31-e2a3418c161c admin admin] PATH_INFO: `/v3/projects/5b00d29735154af0a44572838463bd5d` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:42.174779 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b9a2b-3b29-4a1f-8b31-e2a3418c161c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b00d29735154af0a44572838463bd5d)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:42.177009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806b9a2b-3b29-4a1f-8b31-e2a3418c161c admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:42.238918 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-806b9a2b-3b29-4a1f-8b31-e2a3418c161c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b00d29735154af0a44572838463bd5d', 'request_id': 'req-806b9a2b-3b29-4a1f-8b31-e2a3418c161c'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:42.244850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-806b9a2b-3b29-4a1f-8b31-e2a3418c161c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b00d29735154af0a44572838463bd5d', 'request_id': 'req-806b9a2b-3b29-4a1f-8b31-e2a3418c161c'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:42.251587 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-806b9a2b-3b29-4a1f-8b31-e2a3418c161c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b00d29735154af0a44572838463bd5d', 'request_id': 'req-806b9a2b-3b29-4a1f-8b31-e2a3418c161c'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:42.255412 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:42.266185 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-806b9a2b-3b29-4a1f-8b31-e2a3418c161c admin admin] The token cache is being invalidate because project 5b00d29735154af0a44572838463bd5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:42.266811 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-806b9a2b-3b29-4a1f-8b31-e2a3418c161c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:42.267594 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-806b9a2b-3b29-4a1f-8b31-e2a3418c161c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:42.272602 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1020/2050] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:42 2022] DELETE /identity/v3/projects/5b00d29735154af0a44572838463bd5d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:42.274387 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f91c9-2b2a-42db-bb1d-32f47b91d8f1 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:42.274857 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f91c9-2b2a-42db-bb1d-32f47b91d8f1 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:42.274998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f91c9-2b2a-42db-bb1d-32f47b91d8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:42.294928 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-3a0f91c9-2b2a-42db-bb1d-32f47b91d8f1 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:42.296177 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-3a0f91c9-2b2a-42db-bb1d-32f47b91d8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:42.356755 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1031/2051] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:42.365709 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747c043-871f-4819-acf2-c3fd9dffa059 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:42.366010 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747c043-871f-4819-acf2-c3fd9dffa059 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:42.366290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0747c043-871f-4819-acf2-c3fd9dffa059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:42.385339 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-0747c043-871f-4819-acf2-c3fd9dffa059 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:42.387368 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-0747c043-871f-4819-acf2-c3fd9dffa059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:42.395226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1021/2052] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:42.400269 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f91c9-2b2a-42db-bb1d-32f47b91d8f1 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:42.410531 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0f91c9-2b2a-42db-bb1d-32f47b91d8f1 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:42.415493 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b82b1-94a4-4ee4-ac30-1a5055980b7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:42.416178 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b82b1-94a4-4ee4-ac30-1a5055980b7f admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:42.416538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b82b1-94a4-4ee4-ac30-1a5055980b7f admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:42.416892 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58b82b1-94a4-4ee4-ac30-1a5055980b7f admin admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:42.417613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b82b1-94a4-4ee4-ac30-1a5055980b7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:42.417972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b82b1-94a4-4ee4-ac30-1a5055980b7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:42.419667 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e58b82b1-94a4-4ee4-ac30-1a5055980b7f admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:42.435248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1032/2053] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:27:42.439934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747c043-871f-4819-acf2-c3fd9dffa059 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:42.449944 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0747c043-871f-4819-acf2-c3fd9dffa059 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:42.454657 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224e134-3743-450f-9eba-982fbde83ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:42.455313 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224e134-3743-450f-9eba-982fbde83ffd admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:42.455597 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224e134-3743-450f-9eba-982fbde83ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:42.455907 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224e134-3743-450f-9eba-982fbde83ffd admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:42.456602 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224e134-3743-450f-9eba-982fbde83ffd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:42.458517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224e134-3743-450f-9eba-982fbde83ffd admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:42.483734 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1022/2054] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:42 2022] POST /identity/v3/projects => generated 385 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:42.487905 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b82b1-94a4-4ee4-ac30-1a5055980b7f admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:42.498631 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58b82b1-94a4-4ee4-ac30-1a5055980b7f admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:42.554809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d00af2-5874-4e60-92b6-a332d0202584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:42.555477 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d00af2-5874-4e60-92b6-a332d0202584 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:42.555802 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d00af2-5874-4e60-92b6-a332d0202584 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:42.556082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d00af2-5874-4e60-92b6-a332d0202584 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:42.556779 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d00af2-5874-4e60-92b6-a332d0202584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:42.559209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d00af2-5874-4e60-92b6-a332d0202584 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:42.584391 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1033/2055] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:42 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:42.585906 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224e134-3743-450f-9eba-982fbde83ffd admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:42.596566 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224e134-3743-450f-9eba-982fbde83ffd admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:42.601216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b0c1b-3b07-491d-8c3d-711c2ad5bdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:42.601879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b0c1b-3b07-491d-8c3d-711c2ad5bdb5 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:42.602170 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b0c1b-3b07-491d-8c3d-711c2ad5bdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:42.602528 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40b0c1b-3b07-491d-8c3d-711c2ad5bdb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:42.603183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b0c1b-3b07-491d-8c3d-711c2ad5bdb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:42.604831 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40b0c1b-3b07-491d-8c3d-711c2ad5bdb5 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:42.623486 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1023/2056] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:42.627674 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d00af2-5874-4e60-92b6-a332d0202584 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:42.638746 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d00af2-5874-4e60-92b6-a332d0202584 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:42.643412 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85d151-e8fb-4aee-9cd3-9013ed5fea6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:42.644121 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85d151-e8fb-4aee-9cd3-9013ed5fea6a admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:42.644597 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85d151-e8fb-4aee-9cd3-9013ed5fea6a admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:42.644930 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85d151-e8fb-4aee-9cd3-9013ed5fea6a admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:42.645714 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85d151-e8fb-4aee-9cd3-9013ed5fea6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:42.647317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce85d151-e8fb-4aee-9cd3-9013ed5fea6a admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:42.649943 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:42.661214 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1034/2057] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:42.665326 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b0c1b-3b07-491d-8c3d-711c2ad5bdb5 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:42.677817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40b0c1b-3b07-491d-8c3d-711c2ad5bdb5 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:42.683358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2bc69-f77c-4062-9755-3824f4dbd86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:42.684951 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2bc69-f77c-4062-9755-3824f4dbd86d admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:42.685305 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2bc69-f77c-4062-9755-3824f4dbd86d admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:42.685652 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c2bc69-f77c-4062-9755-3824f4dbd86d admin admin] PATH_INFO: `/v3/projects/873acb16113140879b649861eb3be2cc/users/7f816ed8bef242739ea32ff5086c01cb/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:42.704241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2bc69-f77c-4062-9755-3824f4dbd86d admin admin] RBAC: Authorizing `identity:create_grant(project_id=873acb16113140879b649861eb3be2cc, user_id=7f816ed8bef242739ea32ff5086c01cb, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:42.707088 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c2bc69-f77c-4062-9755-3824f4dbd86d admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:42.724136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1024/2058] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:42 2022] PUT /identity/v3/projects/873acb16113140879b649861eb3be2cc/users/7f816ed8bef242739ea32ff5086c01cb/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:42.734998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac72ce-a5f9-4945-ab88-f6895168323d None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:42.735310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac72ce-a5f9-4945-ab88-f6895168323d None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:42.735569 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fac72ce-a5f9-4945-ab88-f6895168323d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:42.763503 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-3fac72ce-a5f9-4945-ab88-f6895168323d None None] MFA Rules not processed for user `7f816ed8bef242739ea32ff5086c01cb`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:42.764910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-3fac72ce-a5f9-4945-ab88-f6895168323d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:42.850204 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1035/2059] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:42.854774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2bc69-f77c-4062-9755-3824f4dbd86d admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:42.920634 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c2bc69-f77c-4062-9755-3824f4dbd86d admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:42.925507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5b447-c361-4043-9d9c-191bc6f9fc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:42.926111 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5b447-c361-4043-9d9c-191bc6f9fc0b admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:42.926431 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5b447-c361-4043-9d9c-191bc6f9fc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:42.926709 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb5b447-c361-4043-9d9c-191bc6f9fc0b admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:42.927504 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5b447-c361-4043-9d9c-191bc6f9fc0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:42.929403 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb5b447-c361-4043-9d9c-191bc6f9fc0b admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:42.960212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1025/2060] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:42 2022] POST /identity/v3/projects => generated 387 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:42.964427 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac72ce-a5f9-4945-ab88-f6895168323d None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:42.975307 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fac72ce-a5f9-4945-ab88-f6895168323d None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:43.058914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d4042-99d3-4884-b766-d7ede1cf60a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:43.059743 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d4042-99d3-4884-b766-d7ede1cf60a4 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:43.060105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d4042-99d3-4884-b766-d7ede1cf60a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:43.060456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0d4042-99d3-4884-b766-d7ede1cf60a4 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:43.061496 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d4042-99d3-4884-b766-d7ede1cf60a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:43.063654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0d4042-99d3-4884-b766-d7ede1cf60a4 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:43.084658 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1036/2061] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:42 2022] POST /identity/v3/users => generated 300 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:43.088728 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5b447-c361-4043-9d9c-191bc6f9fc0b admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:43.100249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb5b447-c361-4043-9d9c-191bc6f9fc0b admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:43.105333 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1b1b3-8671-4152-948a-4be1005cd777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:43.106088 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1b1b3-8671-4152-948a-4be1005cd777 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:43.106378 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1b1b3-8671-4152-948a-4be1005cd777 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:43.106658 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1b1b3-8671-4152-948a-4be1005cd777 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:43.107398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1b1b3-8671-4152-948a-4be1005cd777 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:43.109070 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1b1b3-8671-4152-948a-4be1005cd777 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:43.123728 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1026/2062] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:43.128199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d4042-99d3-4884-b766-d7ede1cf60a4 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:43.143341 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0d4042-99d3-4884-b766-d7ede1cf60a4 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:43.148115 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946bf7e-d966-4a8c-89dc-e06ed460dd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:43.149168 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946bf7e-d966-4a8c-89dc-e06ed460dd38 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:43.150035 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946bf7e-d966-4a8c-89dc-e06ed460dd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:43.150321 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5946bf7e-d966-4a8c-89dc-e06ed460dd38 admin admin] PATH_INFO: `/v3/projects/05232c5ede984581ad7fd553cbc9facd/users/d0275450625c4f5b924ef8ed96b9dea9/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:43.168352 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946bf7e-d966-4a8c-89dc-e06ed460dd38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05232c5ede984581ad7fd553cbc9facd, user_id=d0275450625c4f5b924ef8ed96b9dea9, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:43.171478 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5946bf7e-d966-4a8c-89dc-e06ed460dd38 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:43.193058 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1037/2063] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:43 2022] PUT /identity/v3/projects/05232c5ede984581ad7fd553cbc9facd/users/d0275450625c4f5b924ef8ed96b9dea9/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:27:43.197181 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1b1b3-8671-4152-948a-4be1005cd777 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:43.209929 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1b1b3-8671-4152-948a-4be1005cd777 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:43.302174 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac1de39-74e8-410e-90bb-ce65bbfb98e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:43.302923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1de39-74e8-410e-90bb-ce65bbfb98e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:43.303273 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1de39-74e8-410e-90bb-ce65bbfb98e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:43.303555 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac1de39-74e8-410e-90bb-ce65bbfb98e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:43.304420 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1de39-74e8-410e-90bb-ce65bbfb98e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:43.306154 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac1de39-74e8-410e-90bb-ce65bbfb98e7 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:43.322554 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1027/2064] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:43 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:43.323656 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946bf7e-d966-4a8c-89dc-e06ed460dd38 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:43.349300 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5946bf7e-d966-4a8c-89dc-e06ed460dd38 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:43.355575 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cc992-a01f-4cf7-98d0-93756fc1a154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:43.356606 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cc992-a01f-4cf7-98d0-93756fc1a154 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:43.356958 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cc992-a01f-4cf7-98d0-93756fc1a154 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:43.357301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286cc992-a01f-4cf7-98d0-93756fc1a154 admin admin] PATH_INFO: `/v3/projects/05232c5ede984581ad7fd553cbc9facd/users/d0275450625c4f5b924ef8ed96b9dea9/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:43.359372 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286cc992-a01f-4cf7-98d0-93756fc1a154 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05232c5ede984581ad7fd553cbc9facd, user_id=d0275450625c4f5b924ef8ed96b9dea9, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:43.362240 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286cc992-a01f-4cf7-98d0-93756fc1a154 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:43.373620 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1038/2065] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:43 2022] PUT /identity/v3/projects/05232c5ede984581ad7fd553cbc9facd/users/d0275450625c4f5b924ef8ed96b9dea9/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:43.385053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4423087-40cd-4614-93bb-67414061456c None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:43.385767 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4423087-40cd-4614-93bb-67414061456c None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:43.386354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4423087-40cd-4614-93bb-67414061456c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:43.396998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:43.427863 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-e4423087-40cd-4614-93bb-67414061456c None None] MFA Rules not processed for user `d0275450625c4f5b924ef8ed96b9dea9`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:43.429415 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e4423087-40cd-4614-93bb-67414061456c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:43.505283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1028/2066] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:43.518666 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cc992-a01f-4cf7-98d0-93756fc1a154 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:43.520781 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-286cc992-a01f-4cf7-98d0-93756fc1a154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:43.572513 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:43.590486 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286cc992-a01f-4cf7-98d0-93756fc1a154 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:43.594969 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcce000-0ac4-49cd-9f14-08ed8c723d0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:43.595587 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcce000-0ac4-49cd-9f14-08ed8c723d0e service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:43.595934 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcce000-0ac4-49cd-9f14-08ed8c723d0e service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:43.596225 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcce000-0ac4-49cd-9f14-08ed8c723d0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:43.606389 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcce000-0ac4-49cd-9f14-08ed8c723d0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:43.607874 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcce000-0ac4-49cd-9f14-08ed8c723d0e service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:43.617511 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1039/2067] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:43.647074 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4423087-40cd-4614-93bb-67414061456c None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:43.716022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4423087-40cd-4614-93bb-67414061456c None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:43.720625 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df696a3-3981-452a-aacc-f186ba256867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:43.721495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df696a3-3981-452a-aacc-f186ba256867 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:43.721776 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df696a3-3981-452a-aacc-f186ba256867 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:43.722049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df696a3-3981-452a-aacc-f186ba256867 admin admin] PATH_INFO: `/v3/users/7f816ed8bef242739ea32ff5086c01cb` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:43.723252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df696a3-3981-452a-aacc-f186ba256867 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f816ed8bef242739ea32ff5086c01cb)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:43.725229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df696a3-3981-452a-aacc-f186ba256867 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:43.774811 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-4df696a3-3981-452a-aacc-f186ba256867 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f816ed8bef242739ea32ff5086c01cb'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:43.783222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-4df696a3-3981-452a-aacc-f186ba256867 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f816ed8bef242739ea32ff5086c01cb'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:43.783886 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-4df696a3-3981-452a-aacc-f186ba256867 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f816ed8bef242739ea32ff5086c01cb'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:43.797984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-4df696a3-3981-452a-aacc-f186ba256867 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f816ed8bef242739ea32ff5086c01cb'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:43.802383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-4df696a3-3981-452a-aacc-f186ba256867 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f816ed8bef242739ea32ff5086c01cb'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:43.816624 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1029/2068] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:43 2022] DELETE /identity/v3/users/7f816ed8bef242739ea32ff5086c01cb => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:43.821207 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca22cac-6e35-4b0f-b1ae-e06e18bde1ec None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:43.821515 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca22cac-6e35-4b0f-b1ae-e06e18bde1ec None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:43.821810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca22cac-6e35-4b0f-b1ae-e06e18bde1ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:43.842585 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-3ca22cac-6e35-4b0f-b1ae-e06e18bde1ec None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:43.843850 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-3ca22cac-6e35-4b0f-b1ae-e06e18bde1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:43.911834 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1040/2069] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:43.921430 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df696a3-3981-452a-aacc-f186ba256867 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:43.922854 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-4df696a3-3981-452a-aacc-f186ba256867 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:43.932672 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:43.986324 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df696a3-3981-452a-aacc-f186ba256867 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:43.990275 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5719c2-458b-4a6c-aae0-4b373c601208 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:43.990928 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5719c2-458b-4a6c-aae0-4b373c601208 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:43.991214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5719c2-458b-4a6c-aae0-4b373c601208 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:43.991493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5719c2-458b-4a6c-aae0-4b373c601208 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:44.001807 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5719c2-458b-4a6c-aae0-4b373c601208 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:44.003254 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5719c2-458b-4a6c-aae0-4b373c601208 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:44.014571 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1030/2070] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:44.117842 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca22cac-6e35-4b0f-b1ae-e06e18bde1ec None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:44.120511 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-3ca22cac-6e35-4b0f-b1ae-e06e18bde1ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:44.134636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca22cac-6e35-4b0f-b1ae-e06e18bde1ec None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:44.143315 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb090b-986e-4ca2-92e9-590c8d49720f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:44.144273 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb090b-986e-4ca2-92e9-590c8d49720f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:44.144565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb090b-986e-4ca2-92e9-590c8d49720f admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:44.144844 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb090b-986e-4ca2-92e9-590c8d49720f admin admin] PATH_INFO: `/v3/users/a0b73a2fdfa64aa18a3338bbae7c3270` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:44.146112 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb090b-986e-4ca2-92e9-590c8d49720f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0b73a2fdfa64aa18a3338bbae7c3270)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:44.148108 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb090b-986e-4ca2-92e9-590c8d49720f admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:44.203543 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-70cb090b-986e-4ca2-92e9-590c8d49720f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0b73a2fdfa64aa18a3338bbae7c3270'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:44.211788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-70cb090b-986e-4ca2-92e9-590c8d49720f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0b73a2fdfa64aa18a3338bbae7c3270'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:44.212455 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-70cb090b-986e-4ca2-92e9-590c8d49720f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0b73a2fdfa64aa18a3338bbae7c3270'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:44.213086 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-70cb090b-986e-4ca2-92e9-590c8d49720f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0b73a2fdfa64aa18a3338bbae7c3270'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:44.225414 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-70cb090b-986e-4ca2-92e9-590c8d49720f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0b73a2fdfa64aa18a3338bbae7c3270'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:44.240543 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1041/2071] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:44 2022] DELETE /identity/v3/users/a0b73a2fdfa64aa18a3338bbae7c3270 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:44.245154 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5aec5-5247-4315-a35a-a2c0e280da89 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:44.245634 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5aec5-5247-4315-a35a-a2c0e280da89 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:44.245986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f5aec5-5247-4315-a35a-a2c0e280da89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:44.266757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-00f5aec5-5247-4315-a35a-a2c0e280da89 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:44.268412 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-00f5aec5-5247-4315-a35a-a2c0e280da89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:44.332350 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb090b-986e-4ca2-92e9-590c8d49720f admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:44.336173 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-70cb090b-986e-4ca2-92e9-590c8d49720f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:44.379262 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1031/2072] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:44.390063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5aec5-5247-4315-a35a-a2c0e280da89 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:44.391584 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-00f5aec5-5247-4315-a35a-a2c0e280da89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:44.426907 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:44.434108 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb090b-986e-4ca2-92e9-590c8d49720f admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:44.444477 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576cf7c6-e665-4055-85fe-0a6174a76640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:44.445372 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cf7c6-e665-4055-85fe-0a6174a76640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:44.445663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cf7c6-e665-4055-85fe-0a6174a76640 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:44.447606 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576cf7c6-e665-4055-85fe-0a6174a76640 admin admin] PATH_INFO: `/v3/projects/873acb16113140879b649861eb3be2cc` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:44.450315 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576cf7c6-e665-4055-85fe-0a6174a76640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=873acb16113140879b649861eb3be2cc)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:44.453777 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576cf7c6-e665-4055-85fe-0a6174a76640 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:44.489998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f5aec5-5247-4315-a35a-a2c0e280da89 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:44.494333 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a4f09-7421-4cac-8477-84995cfb1b88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:44.495261 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a4f09-7421-4cac-8477-84995cfb1b88 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:44.495660 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a4f09-7421-4cac-8477-84995cfb1b88 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:44.496799 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3a4f09-7421-4cac-8477-84995cfb1b88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:44.508079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a4f09-7421-4cac-8477-84995cfb1b88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:44.509724 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3a4f09-7421-4cac-8477-84995cfb1b88 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:44.521626 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1032/2073] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:27:44.560909 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-576cf7c6-e665-4055-85fe-0a6174a76640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '873acb16113140879b649861eb3be2cc', 'request_id': 'req-576cf7c6-e665-4055-85fe-0a6174a76640'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:44.571573 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-576cf7c6-e665-4055-85fe-0a6174a76640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '873acb16113140879b649861eb3be2cc', 'request_id': 'req-576cf7c6-e665-4055-85fe-0a6174a76640'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:44.580493 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-576cf7c6-e665-4055-85fe-0a6174a76640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '873acb16113140879b649861eb3be2cc', 'request_id': 'req-576cf7c6-e665-4055-85fe-0a6174a76640'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:44.613528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-576cf7c6-e665-4055-85fe-0a6174a76640 admin admin] The token cache is being invalidate because project 873acb16113140879b649861eb3be2cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:44.614091 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-576cf7c6-e665-4055-85fe-0a6174a76640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:44.615185 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-576cf7c6-e665-4055-85fe-0a6174a76640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:44.617730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1042/2074] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:44 2022] DELETE /identity/v3/projects/873acb16113140879b649861eb3be2cc => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:27:44.622252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a4f09-7421-4cac-8477-84995cfb1b88 service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:44.638391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3a4f09-7421-4cac-8477-84995cfb1b88 service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:44.732927 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:44.748572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40352b2-7495-44d4-a956-834c5dc57735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:44.752797 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40352b2-7495-44d4-a956-834c5dc57735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:44.753180 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40352b2-7495-44d4-a956-834c5dc57735 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:44.753637 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40352b2-7495-44d4-a956-834c5dc57735 admin admin] PATH_INFO: `/v3/users/d0275450625c4f5b924ef8ed96b9dea9` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:44.755058 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40352b2-7495-44d4-a956-834c5dc57735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0275450625c4f5b924ef8ed96b9dea9)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:44.757951 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40352b2-7495-44d4-a956-834c5dc57735 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:44.835060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d40352b2-7495-44d4-a956-834c5dc57735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0275450625c4f5b924ef8ed96b9dea9'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:44.845781 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d40352b2-7495-44d4-a956-834c5dc57735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0275450625c4f5b924ef8ed96b9dea9'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:44.847045 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d40352b2-7495-44d4-a956-834c5dc57735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0275450625c4f5b924ef8ed96b9dea9'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:44.886150 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d40352b2-7495-44d4-a956-834c5dc57735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0275450625c4f5b924ef8ed96b9dea9'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:44.887890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d40352b2-7495-44d4-a956-834c5dc57735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0275450625c4f5b924ef8ed96b9dea9'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:44.916925 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1033/2075] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:44 2022] DELETE /identity/v3/users/d0275450625c4f5b924ef8ed96b9dea9 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:44.954606 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576cf7c6-e665-4055-85fe-0a6174a76640 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:44.956006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-576cf7c6-e665-4055-85fe-0a6174a76640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:44.969757 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576cf7c6-e665-4055-85fe-0a6174a76640 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:45.041131 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dad80-4d46-40af-8e56-39737edb719c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:45.042047 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dad80-4d46-40af-8e56-39737edb719c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:45.042398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dad80-4d46-40af-8e56-39737edb719c admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:45.043281 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339dad80-4d46-40af-8e56-39737edb719c admin admin] PATH_INFO: `/v3/projects/78a025d31d8a44ae82b9496bf09ceb33` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:45.044576 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339dad80-4d46-40af-8e56-39737edb719c admin admin] RBAC: Authorizing `identity:delete_project(project_id=78a025d31d8a44ae82b9496bf09ceb33)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:45.046577 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339dad80-4d46-40af-8e56-39737edb719c admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:45.094349 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-339dad80-4d46-40af-8e56-39737edb719c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78a025d31d8a44ae82b9496bf09ceb33', 'request_id': 'req-339dad80-4d46-40af-8e56-39737edb719c'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:45.099911 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-339dad80-4d46-40af-8e56-39737edb719c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78a025d31d8a44ae82b9496bf09ceb33', 'request_id': 'req-339dad80-4d46-40af-8e56-39737edb719c'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:45.120651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-339dad80-4d46-40af-8e56-39737edb719c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78a025d31d8a44ae82b9496bf09ceb33', 'request_id': 'req-339dad80-4d46-40af-8e56-39737edb719c'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:45.137283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-339dad80-4d46-40af-8e56-39737edb719c admin admin] The token cache is being invalidate because project 78a025d31d8a44ae82b9496bf09ceb33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:45.137585 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-339dad80-4d46-40af-8e56-39737edb719c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:45.138277 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-339dad80-4d46-40af-8e56-39737edb719c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:45.139942 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1043/2076] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:44 2022] DELETE /identity/v3/projects/78a025d31d8a44ae82b9496bf09ceb33 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:45.144301 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40352b2-7495-44d4-a956-834c5dc57735 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:45.145859 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d40352b2-7495-44d4-a956-834c5dc57735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:45.159391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40352b2-7495-44d4-a956-834c5dc57735 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:45.219829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa4252-f80e-4f57-a714-dcf26a676ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:45.219829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa4252-f80e-4f57-a714-dcf26a676ba8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:45.220161 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa4252-f80e-4f57-a714-dcf26a676ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:45.220935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa4252-f80e-4f57-a714-dcf26a676ba8 admin admin] PATH_INFO: `/v3/users/8263e3c0a7c44915ac5b43d2973737a9` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:45.221559 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa4252-f80e-4f57-a714-dcf26a676ba8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8263e3c0a7c44915ac5b43d2973737a9)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:45.223541 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa4252-f80e-4f57-a714-dcf26a676ba8 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:45.242975 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dad80-4d46-40af-8e56-39737edb719c admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:45.244659 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-339dad80-4d46-40af-8e56-39737edb719c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:45.273115 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339dad80-4d46-40af-8e56-39737edb719c admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:45.279444 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad328c-94d4-4fb6-8b2f-eef6344e40b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:45.280715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad328c-94d4-4fb6-8b2f-eef6344e40b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:45.280874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a9fa4252-f80e-4f57-a714-dcf26a676ba8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8263e3c0a7c44915ac5b43d2973737a9'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:45.281304 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad328c-94d4-4fb6-8b2f-eef6344e40b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:45.281304 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad328c-94d4-4fb6-8b2f-eef6344e40b2 admin admin] PATH_INFO: `/v3/projects/05232c5ede984581ad7fd553cbc9facd` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:45.286092 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad328c-94d4-4fb6-8b2f-eef6344e40b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05232c5ede984581ad7fd553cbc9facd)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:45.288441 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad328c-94d4-4fb6-8b2f-eef6344e40b2 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:45.290216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a9fa4252-f80e-4f57-a714-dcf26a676ba8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8263e3c0a7c44915ac5b43d2973737a9'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:45.290921 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a9fa4252-f80e-4f57-a714-dcf26a676ba8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8263e3c0a7c44915ac5b43d2973737a9'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:45.300715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:45.304052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a9fa4252-f80e-4f57-a714-dcf26a676ba8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8263e3c0a7c44915ac5b43d2973737a9'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:45.304723 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a9fa4252-f80e-4f57-a714-dcf26a676ba8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8263e3c0a7c44915ac5b43d2973737a9'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:45.306733 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:45.321378 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1034/2077] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:45 2022] DELETE /identity/v3/users/8263e3c0a7c44915ac5b43d2973737a9 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:45.344371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-47ad328c-94d4-4fb6-8b2f-eef6344e40b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05232c5ede984581ad7fd553cbc9facd', 'request_id': 'req-47ad328c-94d4-4fb6-8b2f-eef6344e40b2'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:45.351252 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-47ad328c-94d4-4fb6-8b2f-eef6344e40b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05232c5ede984581ad7fd553cbc9facd', 'request_id': 'req-47ad328c-94d4-4fb6-8b2f-eef6344e40b2'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:45.359546 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-47ad328c-94d4-4fb6-8b2f-eef6344e40b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05232c5ede984581ad7fd553cbc9facd', 'request_id': 'req-47ad328c-94d4-4fb6-8b2f-eef6344e40b2'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:45.376420 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-47ad328c-94d4-4fb6-8b2f-eef6344e40b2 admin admin] The token cache is being invalidate because project 05232c5ede984581ad7fd553cbc9facd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:45.376722 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-47ad328c-94d4-4fb6-8b2f-eef6344e40b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:45.377384 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-47ad328c-94d4-4fb6-8b2f-eef6344e40b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:45.379064 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1044/2078] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:45 2022] DELETE /identity/v3/projects/05232c5ede984581ad7fd553cbc9facd => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:27:45.384807 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3c260-9e33-461b-ac6f-fe7438ef01ef None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:45.385103 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3c260-9e33-461b-ac6f-fe7438ef01ef None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:45.385546 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3c260-9e33-461b-ac6f-fe7438ef01ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:45.414537 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-43c3c260-9e33-461b-ac6f-fe7438ef01ef None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:45.415876 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-43c3c260-9e33-461b-ac6f-fe7438ef01ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:45.512317 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1035/2079] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:27:45.516537 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33693f3b-0b9e-426b-8724-ab70f50bc297 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:45.517106 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33693f3b-0b9e-426b-8724-ab70f50bc297 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:45.517593 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33693f3b-0b9e-426b-8724-ab70f50bc297 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:45.549465 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-33693f3b-0b9e-426b-8724-ab70f50bc297 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:45.550701 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-33693f3b-0b9e-426b-8724-ab70f50bc297 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:45.560668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1045/2080] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:45.567285 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3c260-9e33-461b-ac6f-fe7438ef01ef None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:45.579637 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3c260-9e33-461b-ac6f-fe7438ef01ef None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:45.585862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d912bf5-06ba-4784-8895-00ead144535f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:45.589201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d912bf5-06ba-4784-8895-00ead144535f admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:45.590183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d912bf5-06ba-4784-8895-00ead144535f admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:45.590598 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d912bf5-06ba-4784-8895-00ead144535f admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:45.592108 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d912bf5-06ba-4784-8895-00ead144535f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:45.592502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d912bf5-06ba-4784-8895-00ead144535f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:45.594270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d912bf5-06ba-4784-8895-00ead144535f admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:45.611646 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1036/2081] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:27:45.613597 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33693f3b-0b9e-426b-8724-ab70f50bc297 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:45.625281 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33693f3b-0b9e-426b-8724-ab70f50bc297 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:45.632665 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077779b-84d7-41fa-bb0a-49302f1d1da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:45.633586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077779b-84d7-41fa-bb0a-49302f1d1da3 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:45.634000 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077779b-84d7-41fa-bb0a-49302f1d1da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:45.634452 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1077779b-84d7-41fa-bb0a-49302f1d1da3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:45.635267 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077779b-84d7-41fa-bb0a-49302f1d1da3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:45.638238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1077779b-84d7-41fa-bb0a-49302f1d1da3 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:45.668338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1046/2082] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:45 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:45.672798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d912bf5-06ba-4784-8895-00ead144535f admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:45.685892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d912bf5-06ba-4784-8895-00ead144535f admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:45.724488 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077779b-84d7-41fa-bb0a-49302f1d1da3 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:45.734236 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-1077779b-84d7-41fa-bb0a-49302f1d1da3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:45.764181 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db8fba3-2905-4533-af14-781e710a20be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:45.764873 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8fba3-2905-4533-af14-781e710a20be admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:45.765159 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8fba3-2905-4533-af14-781e710a20be admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:45.765436 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db8fba3-2905-4533-af14-781e710a20be admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:45.766134 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db8fba3-2905-4533-af14-781e710a20be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:45.768139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db8fba3-2905-4533-af14-781e710a20be admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:45.806748 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1037/2083] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:45 2022] POST /identity/v3/users => generated 288 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:45.810739 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db8fba3-2905-4533-af14-781e710a20be admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:45.825535 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db8fba3-2905-4533-af14-781e710a20be admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:45.828163 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1077779b-84d7-41fa-bb0a-49302f1d1da3 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:45.830699 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd169d1a-ada9-413d-890a-11087e1c6c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:45.831374 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd169d1a-ada9-413d-890a-11087e1c6c26 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:45.831695 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd169d1a-ada9-413d-890a-11087e1c6c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:45.831980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd169d1a-ada9-413d-890a-11087e1c6c26 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:45.832721 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd169d1a-ada9-413d-890a-11087e1c6c26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:45.833872 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada7cab-769b-4b5c-8d1a-d069897f60bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:45.834385 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd169d1a-ada9-413d-890a-11087e1c6c26 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:45.835236 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada7cab-769b-4b5c-8d1a-d069897f60bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:45.835942 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada7cab-769b-4b5c-8d1a-d069897f60bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:45.836236 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ada7cab-769b-4b5c-8d1a-d069897f60bc admin admin] PATH_INFO: `/v3/projects/a9f8350de9a44114869486400d8709b1` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:45.837926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada7cab-769b-4b5c-8d1a-d069897f60bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9f8350de9a44114869486400d8709b1)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:45.839968 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ada7cab-769b-4b5c-8d1a-d069897f60bc admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:45.845756 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1038/2084] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:27:45.850133 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd169d1a-ada9-413d-890a-11087e1c6c26 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:45.861741 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd169d1a-ada9-413d-890a-11087e1c6c26 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:45.866927 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c31fb-0c5b-4054-b34c-72ecfdb2f85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:45.868051 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c31fb-0c5b-4054-b34c-72ecfdb2f85e admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:45.868352 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c31fb-0c5b-4054-b34c-72ecfdb2f85e admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:45.868638 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c31fb-0c5b-4054-b34c-72ecfdb2f85e admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:45.869375 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c31fb-0c5b-4054-b34c-72ecfdb2f85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:45.871620 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c31fb-0c5b-4054-b34c-72ecfdb2f85e admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:45.882948 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1039/2085] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:45.890876 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c31fb-0c5b-4054-b34c-72ecfdb2f85e admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:45.896885 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2ada7cab-769b-4b5c-8d1a-d069897f60bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9f8350de9a44114869486400d8709b1', 'request_id': 'req-2ada7cab-769b-4b5c-8d1a-d069897f60bc'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:45.901108 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c31fb-0c5b-4054-b34c-72ecfdb2f85e admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:45.903952 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2ada7cab-769b-4b5c-8d1a-d069897f60bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9f8350de9a44114869486400d8709b1', 'request_id': 'req-2ada7cab-769b-4b5c-8d1a-d069897f60bc'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:45.911234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2ada7cab-769b-4b5c-8d1a-d069897f60bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9f8350de9a44114869486400d8709b1', 'request_id': 'req-2ada7cab-769b-4b5c-8d1a-d069897f60bc'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:45.921562 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:45.926290 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2ada7cab-769b-4b5c-8d1a-d069897f60bc admin admin] The token cache is being invalidate because project a9f8350de9a44114869486400d8709b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:45.926290 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2ada7cab-769b-4b5c-8d1a-d069897f60bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:45.926986 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2ada7cab-769b-4b5c-8d1a-d069897f60bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:45.932123 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1047/2086] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:45 2022] DELETE /identity/v3/projects/a9f8350de9a44114869486400d8709b1 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:45.933952 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada7cab-769b-4b5c-8d1a-d069897f60bc admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:45.935756 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-2ada7cab-769b-4b5c-8d1a-d069897f60bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:45.952314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:45.967508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4cd1e7-a3ec-4bf8-885d-1fb9c07f18e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:45.968798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cd1e7-a3ec-4bf8-885d-1fb9c07f18e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:45.969088 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cd1e7-a3ec-4bf8-885d-1fb9c07f18e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:45.969360 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cd1e7-a3ec-4bf8-885d-1fb9c07f18e0 admin admin] PATH_INFO: `/v3/projects/0bf310a227fb43f68ff7687717a85a20/users/763b9e63658d4b36a67489a030e87848/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:45.984449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4cd1e7-a3ec-4bf8-885d-1fb9c07f18e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf310a227fb43f68ff7687717a85a20, user_id=763b9e63658d4b36a67489a030e87848, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:45.987130 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4cd1e7-a3ec-4bf8-885d-1fb9c07f18e0 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:46.001174 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1040/2087] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:45 2022] PUT /identity/v3/projects/0bf310a227fb43f68ff7687717a85a20/users/763b9e63658d4b36a67489a030e87848/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:46.008814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ada7cab-769b-4b5c-8d1a-d069897f60bc admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:46.012906 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd1a95-10f9-4fec-a257-0c0e90c05d2f None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:46.013305 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd1a95-10f9-4fec-a257-0c0e90c05d2f None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:46.013690 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd1a95-10f9-4fec-a257-0c0e90c05d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:46.046033 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-2edd1a95-10f9-4fec-a257-0c0e90c05d2f None None] MFA Rules not processed for user `763b9e63658d4b36a67489a030e87848`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:46.047279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-2edd1a95-10f9-4fec-a257-0c0e90c05d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:46.085625 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6a93f-12a5-4712-85ac-94a9674d56de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:46.086854 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6a93f-12a5-4712-85ac-94a9674d56de admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:46.087246 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6a93f-12a5-4712-85ac-94a9674d56de admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:46.087679 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b6a93f-12a5-4712-85ac-94a9674d56de admin admin] PATH_INFO: `/v3/users/b0fb321c16114da4ba07c88273cf997e` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:46.090163 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6a93f-12a5-4712-85ac-94a9674d56de admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0fb321c16114da4ba07c88273cf997e)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:46.093444 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b6a93f-12a5-4712-85ac-94a9674d56de admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:46.133526 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1041/2088] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:27:46.148377 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd1a95-10f9-4fec-a257-0c0e90c05d2f None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:46.150642 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-2edd1a95-10f9-4fec-a257-0c0e90c05d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:46.164305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-e6b6a93f-12a5-4712-85ac-94a9674d56de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0fb321c16114da4ba07c88273cf997e'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:46.173416 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-e6b6a93f-12a5-4712-85ac-94a9674d56de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0fb321c16114da4ba07c88273cf997e'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:46.174387 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-e6b6a93f-12a5-4712-85ac-94a9674d56de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0fb321c16114da4ba07c88273cf997e'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:46.175096 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-e6b6a93f-12a5-4712-85ac-94a9674d56de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0fb321c16114da4ba07c88273cf997e'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:46.196331 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-e6b6a93f-12a5-4712-85ac-94a9674d56de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0fb321c16114da4ba07c88273cf997e'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:46.210168 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1048/2089] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:45 2022] DELETE /identity/v3/users/b0fb321c16114da4ba07c88273cf997e => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:27:46.222389 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd1a95-10f9-4fec-a257-0c0e90c05d2f None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:46.285829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d71932-bcc0-4224-b677-7ba54006801d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:46.286612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d71932-bcc0-4224-b677-7ba54006801d service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:46.287145 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d71932-bcc0-4224-b677-7ba54006801d service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:46.287498 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d71932-bcc0-4224-b677-7ba54006801d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:46.289673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-76d71932-bcc0-4224-b677-7ba54006801d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:46.332311 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:46.378281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d71932-bcc0-4224-b677-7ba54006801d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:46.380014 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d71932-bcc0-4224-b677-7ba54006801d service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:46.391280 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1042/2090] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:46.779195 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6a93f-12a5-4712-85ac-94a9674d56de admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:46.780939 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-e6b6a93f-12a5-4712-85ac-94a9674d56de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:46.817974 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:46.862043 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b6a93f-12a5-4712-85ac-94a9674d56de admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:46.866881 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ce997-8acb-4569-9ebf-5ba2c1bb1a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:46.867815 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ce997-8acb-4569-9ebf-5ba2c1bb1a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:46.868364 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ce997-8acb-4569-9ebf-5ba2c1bb1a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:46.868657 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ce997-8acb-4569-9ebf-5ba2c1bb1a49 admin admin] PATH_INFO: `/v3/projects/a9a7bc91444241f3aabce340f96d8ae9` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:46.869932 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ce997-8acb-4569-9ebf-5ba2c1bb1a49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9a7bc91444241f3aabce340f96d8ae9)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:46.872664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ce997-8acb-4569-9ebf-5ba2c1bb1a49 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:46.934641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-9b6ce997-8acb-4569-9ebf-5ba2c1bb1a49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9a7bc91444241f3aabce340f96d8ae9', 'request_id': 'req-9b6ce997-8acb-4569-9ebf-5ba2c1bb1a49'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:46.942253 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-9b6ce997-8acb-4569-9ebf-5ba2c1bb1a49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9a7bc91444241f3aabce340f96d8ae9', 'request_id': 'req-9b6ce997-8acb-4569-9ebf-5ba2c1bb1a49'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:46.950416 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-9b6ce997-8acb-4569-9ebf-5ba2c1bb1a49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9a7bc91444241f3aabce340f96d8ae9', 'request_id': 'req-9b6ce997-8acb-4569-9ebf-5ba2c1bb1a49'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:46.970713 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-9b6ce997-8acb-4569-9ebf-5ba2c1bb1a49 admin admin] The token cache is being invalidate because project a9a7bc91444241f3aabce340f96d8ae9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:46.970713 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-9b6ce997-8acb-4569-9ebf-5ba2c1bb1a49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:46.971516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-9b6ce997-8acb-4569-9ebf-5ba2c1bb1a49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:46.973511 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1049/2091] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:46 2022] DELETE /identity/v3/projects/a9a7bc91444241f3aabce340f96d8ae9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:46.979022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847f16f-3139-4bad-8efd-802352b6626f None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:46.979325 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847f16f-3139-4bad-8efd-802352b6626f None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:46.979629 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3847f16f-3139-4bad-8efd-802352b6626f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:46.998858 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-3847f16f-3139-4bad-8efd-802352b6626f None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:47.000142 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-3847f16f-3139-4bad-8efd-802352b6626f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:47.084152 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1043/2092] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:47.092754 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2ec48-3c5a-44f7-acf9-66670b0b7a9a None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:47.092956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2ec48-3c5a-44f7-acf9-66670b0b7a9a None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:47.093180 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2ec48-3c5a-44f7-acf9-66670b0b7a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:47.128157 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-b6d2ec48-3c5a-44f7-acf9-66670b0b7a9a None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:47.129505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-b6d2ec48-3c5a-44f7-acf9-66670b0b7a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:47.138910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1050/2093] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:47.143858 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847f16f-3139-4bad-8efd-802352b6626f None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:47.154041 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3847f16f-3139-4bad-8efd-802352b6626f None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:47.158692 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a91e3-25f7-4c12-b330-b0c32b53a163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:47.159374 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a91e3-25f7-4c12-b330-b0c32b53a163 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:47.159694 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a91e3-25f7-4c12-b330-b0c32b53a163 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:47.159974 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a91e3-25f7-4c12-b330-b0c32b53a163 admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:47.160694 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a91e3-25f7-4c12-b330-b0c32b53a163 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:47.161002 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a91e3-25f7-4c12-b330-b0c32b53a163 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:47.162634 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a91e3-25f7-4c12-b330-b0c32b53a163 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:47.178840 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1044/2094] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:27:47.180083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2ec48-3c5a-44f7-acf9-66670b0b7a9a None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:47.206124 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d2ec48-3c5a-44f7-acf9-66670b0b7a9a None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:47.211355 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a7dbe-a9cd-4177-bb8c-360d10febab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:47.213008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a7dbe-a9cd-4177-bb8c-360d10febab6 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:47.213465 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a7dbe-a9cd-4177-bb8c-360d10febab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:47.213864 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9a7dbe-a9cd-4177-bb8c-360d10febab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:47.214669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a7dbe-a9cd-4177-bb8c-360d10febab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:47.216827 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9a7dbe-a9cd-4177-bb8c-360d10febab6 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:47.251091 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1051/2095] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:47 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:47.255356 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a91e3-25f7-4c12-b330-b0c32b53a163 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:47.269024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a91e3-25f7-4c12-b330-b0c32b53a163 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:47.367322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dea0d9-2607-4889-b9cd-9e54a51d2846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:47.368817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dea0d9-2607-4889-b9cd-9e54a51d2846 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:47.369606 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dea0d9-2607-4889-b9cd-9e54a51d2846 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:47.369899 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dea0d9-2607-4889-b9cd-9e54a51d2846 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:47.372254 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dea0d9-2607-4889-b9cd-9e54a51d2846 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:47.373672 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dea0d9-2607-4889-b9cd-9e54a51d2846 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:47.407319 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1045/2096] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:47 2022] POST /identity/v3/users => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:47.408946 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a7dbe-a9cd-4177-bb8c-360d10febab6 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:47.425094 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9a7dbe-a9cd-4177-bb8c-360d10febab6 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:47.432717 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568366c-14a3-4712-9313-f80e1b5770e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:47.433586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568366c-14a3-4712-9313-f80e1b5770e1 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:47.433878 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568366c-14a3-4712-9313-f80e1b5770e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:47.434215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568366c-14a3-4712-9313-f80e1b5770e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:47.434913 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568366c-14a3-4712-9313-f80e1b5770e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:47.436592 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c568366c-14a3-4712-9313-f80e1b5770e1 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:47.457902 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1052/2097] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:47.461226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dea0d9-2607-4889-b9cd-9e54a51d2846 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:47.486081 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dea0d9-2607-4889-b9cd-9e54a51d2846 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:47.501252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f700d-bc32-4c11-9668-3163eda981c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:47.501949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f700d-bc32-4c11-9668-3163eda981c1 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:47.502237 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f700d-bc32-4c11-9668-3163eda981c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:47.502519 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f700d-bc32-4c11-9668-3163eda981c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:47.503648 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f700d-bc32-4c11-9668-3163eda981c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:47.505435 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f700d-bc32-4c11-9668-3163eda981c1 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:47.529069 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1046/2098] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:47 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:47.532812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568366c-14a3-4712-9313-f80e1b5770e1 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:47.544548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568366c-14a3-4712-9313-f80e1b5770e1 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:47.549616 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36359d-2c1d-41f2-8bc4-93039f48745f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:47.550518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36359d-2c1d-41f2-8bc4-93039f48745f admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:47.550822 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36359d-2c1d-41f2-8bc4-93039f48745f admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:47.551181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36359d-2c1d-41f2-8bc4-93039f48745f admin admin] PATH_INFO: `/v3/projects/b01305a871c849749017572e52a744ee/users/586d60dc66a446839a0986fdde1a83bd/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:47.575926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36359d-2c1d-41f2-8bc4-93039f48745f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b01305a871c849749017572e52a744ee, user_id=586d60dc66a446839a0986fdde1a83bd, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:47.579852 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36359d-2c1d-41f2-8bc4-93039f48745f admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:47.601038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1053/2099] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:47 2022] PUT /identity/v3/projects/b01305a871c849749017572e52a744ee/users/586d60dc66a446839a0986fdde1a83bd/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:47.612590 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ea872-1179-4951-bdb2-17274c5d88b8 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:47.612959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ea872-1179-4951-bdb2-17274c5d88b8 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:47.613553 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ea872-1179-4951-bdb2-17274c5d88b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:47.652966 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-fd3ea872-1179-4951-bdb2-17274c5d88b8 None None] MFA Rules not processed for user `586d60dc66a446839a0986fdde1a83bd`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:47.654267 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-fd3ea872-1179-4951-bdb2-17274c5d88b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:47.695845 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:47.776620 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1047/2100] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:47.788610 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36359d-2c1d-41f2-8bc4-93039f48745f admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:47.791253 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-8a36359d-2c1d-41f2-8bc4-93039f48745f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:47.860341 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36359d-2c1d-41f2-8bc4-93039f48745f admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:47.864334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675536aa-1bda-4610-a79f-2577a339ed14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:47.865271 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675536aa-1bda-4610-a79f-2577a339ed14 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:47.865463 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675536aa-1bda-4610-a79f-2577a339ed14 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:47.865827 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675536aa-1bda-4610-a79f-2577a339ed14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:47.873929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:47.876802 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675536aa-1bda-4610-a79f-2577a339ed14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:47.880038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675536aa-1bda-4610-a79f-2577a339ed14 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:47.892439 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1054/2101] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:50.209793 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ea872-1179-4951-bdb2-17274c5d88b8 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:50.211342 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-fd3ea872-1179-4951-bdb2-17274c5d88b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:50.276716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ea872-1179-4951-bdb2-17274c5d88b8 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:50.281280 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876687e-6d1b-44ef-994e-9aee41cae3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:50.282146 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876687e-6d1b-44ef-994e-9aee41cae3b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:50.282432 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876687e-6d1b-44ef-994e-9aee41cae3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:50.282709 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876687e-6d1b-44ef-994e-9aee41cae3b1 admin admin] PATH_INFO: `/v3/users/129de9f58bcf4766a7c15e932d5b92ff` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:50.283920 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876687e-6d1b-44ef-994e-9aee41cae3b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=129de9f58bcf4766a7c15e932d5b92ff)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:50.285850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876687e-6d1b-44ef-994e-9aee41cae3b1 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:50.333193 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-1876687e-6d1b-44ef-994e-9aee41cae3b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '129de9f58bcf4766a7c15e932d5b92ff'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:50.340054 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-1876687e-6d1b-44ef-994e-9aee41cae3b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '129de9f58bcf4766a7c15e932d5b92ff'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:50.340688 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-1876687e-6d1b-44ef-994e-9aee41cae3b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '129de9f58bcf4766a7c15e932d5b92ff'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:50.357592 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-1876687e-6d1b-44ef-994e-9aee41cae3b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '129de9f58bcf4766a7c15e932d5b92ff'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:50.358287 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-1876687e-6d1b-44ef-994e-9aee41cae3b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '129de9f58bcf4766a7c15e932d5b92ff'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:50.370411 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1048/2102] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:50 2022] DELETE /identity/v3/users/129de9f58bcf4766a7c15e932d5b92ff => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:50.547408 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675536aa-1bda-4610-a79f-2577a339ed14 service cinder] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:50.558865 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675536aa-1bda-4610-a79f-2577a339ed14 service cinder] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:50.614387 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244f9665-984e-4f31-a391-99058c1c326d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:50.615433 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f9665-984e-4f31-a391-99058c1c326d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:50.615749 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f9665-984e-4f31-a391-99058c1c326d admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:50.616031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244f9665-984e-4f31-a391-99058c1c326d admin admin] PATH_INFO: `/v3/projects/516387296aef4322926e0ba1389aace0` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:50.617210 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f9665-984e-4f31-a391-99058c1c326d admin admin] RBAC: Authorizing `identity:delete_project(project_id=516387296aef4322926e0ba1389aace0)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:50.619116 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244f9665-984e-4f31-a391-99058c1c326d admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:50.665351 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-244f9665-984e-4f31-a391-99058c1c326d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '516387296aef4322926e0ba1389aace0', 'request_id': 'req-244f9665-984e-4f31-a391-99058c1c326d'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:50.671617 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-244f9665-984e-4f31-a391-99058c1c326d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '516387296aef4322926e0ba1389aace0', 'request_id': 'req-244f9665-984e-4f31-a391-99058c1c326d'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:50.677816 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-244f9665-984e-4f31-a391-99058c1c326d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '516387296aef4322926e0ba1389aace0', 'request_id': 'req-244f9665-984e-4f31-a391-99058c1c326d'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:50.689901 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-244f9665-984e-4f31-a391-99058c1c326d admin admin] The token cache is being invalidate because project 516387296aef4322926e0ba1389aace0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:50.690195 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-244f9665-984e-4f31-a391-99058c1c326d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:50.690851 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-244f9665-984e-4f31-a391-99058c1c326d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:50.692435 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1055/2103] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:50 2022] DELETE /identity/v3/projects/516387296aef4322926e0ba1389aace0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:50.698652 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54652f-ccf7-4c16-a0cc-0a9ddb9c1c17 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:50.698977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54652f-ccf7-4c16-a0cc-0a9ddb9c1c17 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:50.699264 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f54652f-ccf7-4c16-a0cc-0a9ddb9c1c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:50.718045 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-6f54652f-ccf7-4c16-a0cc-0a9ddb9c1c17 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:50.719323 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-6f54652f-ccf7-4c16-a0cc-0a9ddb9c1c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:50.760496 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:50.782549 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1049/2104] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:50.790119 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb08b8-2ce1-4aa3-b470-ff27aef5fad8 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:50.790444 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb08b8-2ce1-4aa3-b470-ff27aef5fad8 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:50.790644 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfb08b8-2ce1-4aa3-b470-ff27aef5fad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:50.812263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-ccfb08b8-2ce1-4aa3-b470-ff27aef5fad8 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:50.813462 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-ccfb08b8-2ce1-4aa3-b470-ff27aef5fad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:50.825380 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54652f-ccf7-4c16-a0cc-0a9ddb9c1c17 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:50.838125 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1056/2105] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:50.838539 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f54652f-ccf7-4c16-a0cc-0a9ddb9c1c17 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:50.842017 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3c5e0-da12-4c4c-a2c6-5409705c193f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:50.842721 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3c5e0-da12-4c4c-a2c6-5409705c193f admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:50.843003 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3c5e0-da12-4c4c-a2c6-5409705c193f admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:50.843284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af3c5e0-da12-4c4c-a2c6-5409705c193f admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:50.844056 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3c5e0-da12-4c4c-a2c6-5409705c193f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:50.844370 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3c5e0-da12-4c4c-a2c6-5409705c193f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:50.845982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af3c5e0-da12-4c4c-a2c6-5409705c193f admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:50.858918 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1050/2106] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:27:50.863259 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb08b8-2ce1-4aa3-b470-ff27aef5fad8 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:50.872792 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfb08b8-2ce1-4aa3-b470-ff27aef5fad8 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:50.877360 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2272a7-a424-4056-816c-dcc119e9d285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:50.878120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2272a7-a424-4056-816c-dcc119e9d285 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:50.878408 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2272a7-a424-4056-816c-dcc119e9d285 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:50.878686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2272a7-a424-4056-816c-dcc119e9d285 admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:50.879390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2272a7-a424-4056-816c-dcc119e9d285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:50.881457 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2272a7-a424-4056-816c-dcc119e9d285 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:50.910142 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1057/2107] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:50 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:50.914101 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3c5e0-da12-4c4c-a2c6-5409705c193f admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:50.924628 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af3c5e0-da12-4c4c-a2c6-5409705c193f admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:50.982989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16de5d-e39a-4879-955f-8c169d6e24fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:50.983766 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16de5d-e39a-4879-955f-8c169d6e24fe admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:50.984058 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16de5d-e39a-4879-955f-8c169d6e24fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:50.984480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab16de5d-e39a-4879-955f-8c169d6e24fe admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:50.985402 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16de5d-e39a-4879-955f-8c169d6e24fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:50.987500 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab16de5d-e39a-4879-955f-8c169d6e24fe admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:51.011312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1051/2108] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:50 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:51.015181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2272a7-a424-4056-816c-dcc119e9d285 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:51.025775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2272a7-a424-4056-816c-dcc119e9d285 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:51.030393 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387150ca-162c-4201-b0ab-b88066b463a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:51.031167 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387150ca-162c-4201-b0ab-b88066b463a9 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:51.031455 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387150ca-162c-4201-b0ab-b88066b463a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:51.031796 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387150ca-162c-4201-b0ab-b88066b463a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:51.032529 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387150ca-162c-4201-b0ab-b88066b463a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:51.034166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387150ca-162c-4201-b0ab-b88066b463a9 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:51.045759 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1058/2109] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:51.049804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16de5d-e39a-4879-955f-8c169d6e24fe admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:51.060234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab16de5d-e39a-4879-955f-8c169d6e24fe admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:51.065054 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a821bf8-10cd-4065-a6a6-c3ceb69ee390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:51.065707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a821bf8-10cd-4065-a6a6-c3ceb69ee390 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:51.065991 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a821bf8-10cd-4065-a6a6-c3ceb69ee390 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:51.066270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a821bf8-10cd-4065-a6a6-c3ceb69ee390 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:51.067002 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a821bf8-10cd-4065-a6a6-c3ceb69ee390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:51.068678 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a821bf8-10cd-4065-a6a6-c3ceb69ee390 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:51.078651 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1052/2110] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:51.082603 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387150ca-162c-4201-b0ab-b88066b463a9 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:51.092711 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387150ca-162c-4201-b0ab-b88066b463a9 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:51.097506 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae18d6e-1e51-4ded-9317-96f4aae7a9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:51.098394 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae18d6e-1e51-4ded-9317-96f4aae7a9a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:51.098676 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae18d6e-1e51-4ded-9317-96f4aae7a9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:51.098959 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae18d6e-1e51-4ded-9317-96f4aae7a9a5 admin admin] PATH_INFO: `/v3/projects/74ca7545316d4f52820eab03dc16485e/users/f5903d9cec2241aa96107bbe38d9cd92/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:51.114541 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae18d6e-1e51-4ded-9317-96f4aae7a9a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74ca7545316d4f52820eab03dc16485e, user_id=f5903d9cec2241aa96107bbe38d9cd92, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:51.117254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae18d6e-1e51-4ded-9317-96f4aae7a9a5 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:51.130457 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1059/2111] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:51 2022] PUT /identity/v3/projects/74ca7545316d4f52820eab03dc16485e/users/f5903d9cec2241aa96107bbe38d9cd92/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:51.141962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9304918-487e-43d3-b2a6-246aeac7f9b6 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:51.142279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9304918-487e-43d3-b2a6-246aeac7f9b6 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:51.142566 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9304918-487e-43d3-b2a6-246aeac7f9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:51.168880 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-d9304918-487e-43d3-b2a6-246aeac7f9b6 None None] MFA Rules not processed for user `f5903d9cec2241aa96107bbe38d9cd92`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:51.170101 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d9304918-487e-43d3-b2a6-246aeac7f9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:51.232699 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1053/2112] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:51.246700 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae18d6e-1e51-4ded-9317-96f4aae7a9a5 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:51.248482 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-aae18d6e-1e51-4ded-9317-96f4aae7a9a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:51.274556 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:51.322875 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae18d6e-1e51-4ded-9317-96f4aae7a9a5 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:51.328523 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fc56fe-c0d2-4e72-8e6b-0f5b31fef270 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:51.329166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc56fe-c0d2-4e72-8e6b-0f5b31fef270 service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:51.329452 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc56fe-c0d2-4e72-8e6b-0f5b31fef270 service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:51.329734 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fc56fe-c0d2-4e72-8e6b-0f5b31fef270 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:51.337575 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc56fe-c0d2-4e72-8e6b-0f5b31fef270 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:51.339839 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fc56fe-c0d2-4e72-8e6b-0f5b31fef270 service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:51.348449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1060/2113] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:51.574452 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9304918-487e-43d3-b2a6-246aeac7f9b6 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:51.620240 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:51.644788 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9304918-487e-43d3-b2a6-246aeac7f9b6 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:51.649276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6591b2a-16f2-4a1c-9360-6758b89ed7be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:51.650168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6591b2a-16f2-4a1c-9360-6758b89ed7be admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:51.650429 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6591b2a-16f2-4a1c-9360-6758b89ed7be admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:51.650772 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6591b2a-16f2-4a1c-9360-6758b89ed7be admin admin] PATH_INFO: `/v3/users/f5903d9cec2241aa96107bbe38d9cd92` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:51.652527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6591b2a-16f2-4a1c-9360-6758b89ed7be admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5903d9cec2241aa96107bbe38d9cd92)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:51.654459 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6591b2a-16f2-4a1c-9360-6758b89ed7be admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:51.699676 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d6591b2a-16f2-4a1c-9360-6758b89ed7be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5903d9cec2241aa96107bbe38d9cd92'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:51.706810 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d6591b2a-16f2-4a1c-9360-6758b89ed7be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5903d9cec2241aa96107bbe38d9cd92'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:51.707426 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d6591b2a-16f2-4a1c-9360-6758b89ed7be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5903d9cec2241aa96107bbe38d9cd92'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:51.720126 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d6591b2a-16f2-4a1c-9360-6758b89ed7be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5903d9cec2241aa96107bbe38d9cd92'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:51.720740 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d6591b2a-16f2-4a1c-9360-6758b89ed7be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5903d9cec2241aa96107bbe38d9cd92'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:51.734239 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1054/2114] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:27:51 2022] DELETE /identity/v3/users/f5903d9cec2241aa96107bbe38d9cd92 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:51.738833 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154f45b-9e7e-4674-9e27-e3f2f2b9a6e0 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:51.739276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154f45b-9e7e-4674-9e27-e3f2f2b9a6e0 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:51.739276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1154f45b-9e7e-4674-9e27-e3f2f2b9a6e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:51.757927 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-1154f45b-9e7e-4674-9e27-e3f2f2b9a6e0 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:51.759148 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-1154f45b-9e7e-4674-9e27-e3f2f2b9a6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:51.827342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1061/2115] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:51.837266 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6591b2a-16f2-4a1c-9360-6758b89ed7be admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:51.838754 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d6591b2a-16f2-4a1c-9360-6758b89ed7be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:51.897647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6591b2a-16f2-4a1c-9360-6758b89ed7be admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:51.901270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170bec8-5fb5-44c5-ae4b-3471bfc2aa2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:51.901916 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170bec8-5fb5-44c5-ae4b-3471bfc2aa2f service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:51.902199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170bec8-5fb5-44c5-ae4b-3471bfc2aa2f service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:51.902477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170bec8-5fb5-44c5-ae4b-3471bfc2aa2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:51.911398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170bec8-5fb5-44c5-ae4b-3471bfc2aa2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:51.912871 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170bec8-5fb5-44c5-ae4b-3471bfc2aa2f service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:51.922653 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1055/2116] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:52.255730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154f45b-9e7e-4674-9e27-e3f2f2b9a6e0 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:52.257720 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-1154f45b-9e7e-4674-9e27-e3f2f2b9a6e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:52.279961 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1154f45b-9e7e-4674-9e27-e3f2f2b9a6e0 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:52.290536 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9c8967-a4b7-402e-b310-41994f542f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:52.291875 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c8967-a4b7-402e-b310-41994f542f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:52.292218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c8967-a4b7-402e-b310-41994f542f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:52.292510 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9c8967-a4b7-402e-b310-41994f542f81 admin admin] PATH_INFO: `/v3/projects/74ca7545316d4f52820eab03dc16485e` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:52.293820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c8967-a4b7-402e-b310-41994f542f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=74ca7545316d4f52820eab03dc16485e)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:52.295797 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9c8967-a4b7-402e-b310-41994f542f81 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:52.347928 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7e9c8967-a4b7-402e-b310-41994f542f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74ca7545316d4f52820eab03dc16485e', 'request_id': 'req-7e9c8967-a4b7-402e-b310-41994f542f81'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:52.353750 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7e9c8967-a4b7-402e-b310-41994f542f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74ca7545316d4f52820eab03dc16485e', 'request_id': 'req-7e9c8967-a4b7-402e-b310-41994f542f81'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:52.360739 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7e9c8967-a4b7-402e-b310-41994f542f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74ca7545316d4f52820eab03dc16485e', 'request_id': 'req-7e9c8967-a4b7-402e-b310-41994f542f81'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:52.374381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7e9c8967-a4b7-402e-b310-41994f542f81 admin admin] The token cache is being invalidate because project 74ca7545316d4f52820eab03dc16485e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:27:52.374679 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7e9c8967-a4b7-402e-b310-41994f542f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:52.375344 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7e9c8967-a4b7-402e-b310-41994f542f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:27:52.376961 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1062/2117] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:27:52 2022] DELETE /identity/v3/projects/74ca7545316d4f52820eab03dc16485e => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:52.382821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694b7f1-25cb-452c-b3ed-8510311eec02 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:52.383292 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694b7f1-25cb-452c-b3ed-8510311eec02 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:52.383387 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694b7f1-25cb-452c-b3ed-8510311eec02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:52.401516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-3694b7f1-25cb-452c-b3ed-8510311eec02 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:52.402636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-3694b7f1-25cb-452c-b3ed-8510311eec02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:52.461036 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1056/2118] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:52.468782 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e70823-f92b-440b-a413-ca245ff12050 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:52.469082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e70823-f92b-440b-a413-ca245ff12050 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:52.469371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e70823-f92b-440b-a413-ca245ff12050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:52.488340 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-38e70823-f92b-440b-a413-ca245ff12050 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:52.489599 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-38e70823-f92b-440b-a413-ca245ff12050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:52.498506 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1063/2119] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:52.502898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694b7f1-25cb-452c-b3ed-8510311eec02 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:52.507813 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:52.514952 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694b7f1-25cb-452c-b3ed-8510311eec02 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:52.520673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f796d68-a439-4786-ac70-2ee5654cb399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:52.521352 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f796d68-a439-4786-ac70-2ee5654cb399 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:52.521642 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f796d68-a439-4786-ac70-2ee5654cb399 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:52.521919 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f796d68-a439-4786-ac70-2ee5654cb399 admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:52.522662 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f796d68-a439-4786-ac70-2ee5654cb399 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:27:52.522974 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f796d68-a439-4786-ac70-2ee5654cb399 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:52.524630 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f796d68-a439-4786-ac70-2ee5654cb399 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:52.536531 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1057/2120] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:27:52.540890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e70823-f92b-440b-a413-ca245ff12050 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:52.550779 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e70823-f92b-440b-a413-ca245ff12050 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:52.555918 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d441e0-fdbe-484d-91c8-acee60095951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:52.556590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d441e0-fdbe-484d-91c8-acee60095951 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:52.556874 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d441e0-fdbe-484d-91c8-acee60095951 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:52.557154 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d441e0-fdbe-484d-91c8-acee60095951 admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:52.558408 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d441e0-fdbe-484d-91c8-acee60095951 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:52.560374 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d441e0-fdbe-484d-91c8-acee60095951 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:52.589378 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1064/2121] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:52 2022] POST /identity/v3/projects => generated 393 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:52.593546 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f796d68-a439-4786-ac70-2ee5654cb399 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:52.603887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f796d68-a439-4786-ac70-2ee5654cb399 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:52.661563 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5294add-294b-4e5d-8d60-0c568937b73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:52.662043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5294add-294b-4e5d-8d60-0c568937b73e admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:52.662326 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5294add-294b-4e5d-8d60-0c568937b73e admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:52.662602 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5294add-294b-4e5d-8d60-0c568937b73e admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:52.663281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5294add-294b-4e5d-8d60-0c568937b73e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:52.665251 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5294add-294b-4e5d-8d60-0c568937b73e admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:52.686377 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1058/2122] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:52 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:52.690339 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d441e0-fdbe-484d-91c8-acee60095951 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:52.695844 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:52.702434 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d441e0-fdbe-484d-91c8-acee60095951 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:52.707942 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc866d-d054-4e75-b3d5-41b505dc2904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:52.708604 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc866d-d054-4e75-b3d5-41b505dc2904 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:52.708884 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc866d-d054-4e75-b3d5-41b505dc2904 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:52.709162 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cc866d-d054-4e75-b3d5-41b505dc2904 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:52.709892 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc866d-d054-4e75-b3d5-41b505dc2904 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:52.711486 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cc866d-d054-4e75-b3d5-41b505dc2904 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:52.722100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1065/2123] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:52.726335 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5294add-294b-4e5d-8d60-0c568937b73e admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:52.737015 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5294add-294b-4e5d-8d60-0c568937b73e admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:52.741794 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d95ffe-cd6d-4e6b-badd-af1f1515c6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:52.742450 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d95ffe-cd6d-4e6b-badd-af1f1515c6da admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:52.742737 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d95ffe-cd6d-4e6b-badd-af1f1515c6da admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:52.743017 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d95ffe-cd6d-4e6b-badd-af1f1515c6da admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:52.743805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d95ffe-cd6d-4e6b-badd-af1f1515c6da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:52.745978 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d95ffe-cd6d-4e6b-badd-af1f1515c6da admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:52.756419 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1059/2124] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:52.761644 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc866d-d054-4e75-b3d5-41b505dc2904 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:52.772135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cc866d-d054-4e75-b3d5-41b505dc2904 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:52.777246 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc906d-e8d0-4c4f-b845-b33dbf60a420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:52.778117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc906d-e8d0-4c4f-b845-b33dbf60a420 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:52.778407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc906d-e8d0-4c4f-b845-b33dbf60a420 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:52.778670 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fc906d-e8d0-4c4f-b845-b33dbf60a420 admin admin] PATH_INFO: `/v3/projects/de06018cf7354f01a8abdb5cda21a779/users/bd25e932c72046ceafdd621a2bc5a09e/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:52.804702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc906d-e8d0-4c4f-b845-b33dbf60a420 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de06018cf7354f01a8abdb5cda21a779, user_id=bd25e932c72046ceafdd621a2bc5a09e, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:52.805463 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fc906d-e8d0-4c4f-b845-b33dbf60a420 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:52.819911 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1066/2125] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:52 2022] PUT /identity/v3/projects/de06018cf7354f01a8abdb5cda21a779/users/bd25e932c72046ceafdd621a2bc5a09e/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:52.831502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7425b9f-b2ea-4742-935c-e11be5124e54 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:52.831819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7425b9f-b2ea-4742-935c-e11be5124e54 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:52.832104 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7425b9f-b2ea-4742-935c-e11be5124e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:52.860021 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-c7425b9f-b2ea-4742-935c-e11be5124e54 None None] MFA Rules not processed for user `bd25e932c72046ceafdd621a2bc5a09e`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:52.861227 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-c7425b9f-b2ea-4742-935c-e11be5124e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:52.924630 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1060/2126] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:52.929188 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc906d-e8d0-4c4f-b845-b33dbf60a420 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:52.989480 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fc906d-e8d0-4c4f-b845-b33dbf60a420 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:52.994056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1ac87-ec62-4abd-b9ad-b2fb82b66207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:52.994700 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1ac87-ec62-4abd-b9ad-b2fb82b66207 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:52.995062 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1ac87-ec62-4abd-b9ad-b2fb82b66207 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:52.995411 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1ac87-ec62-4abd-b9ad-b2fb82b66207 admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:52.996137 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1ac87-ec62-4abd-b9ad-b2fb82b66207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:52.998034 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1ac87-ec62-4abd-b9ad-b2fb82b66207 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:53.022213 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1067/2127] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:27:52 2022] POST /identity/v3/projects => generated 393 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:27:53.026199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7425b9f-b2ea-4742-935c-e11be5124e54 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:53.037379 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7425b9f-b2ea-4742-935c-e11be5124e54 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:53.086324 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:53.093953 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87a3d5-51b8-46b1-b1da-0d1f3fd6a0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:53.094618 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87a3d5-51b8-46b1-b1da-0d1f3fd6a0d0 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:53.094902 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87a3d5-51b8-46b1-b1da-0d1f3fd6a0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:53.095179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d87a3d5-51b8-46b1-b1da-0d1f3fd6a0d0 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:53.095887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87a3d5-51b8-46b1-b1da-0d1f3fd6a0d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:53.097868 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d87a3d5-51b8-46b1-b1da-0d1f3fd6a0d0 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:53.118069 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1061/2128] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:27:53 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:27:53.122010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1ac87-ec62-4abd-b9ad-b2fb82b66207 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:53.132609 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1ac87-ec62-4abd-b9ad-b2fb82b66207 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:53.137964 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c88626-8fcf-4005-8923-c99a6ed58baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:53.138612 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c88626-8fcf-4005-8923-c99a6ed58baa admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:53.138896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c88626-8fcf-4005-8923-c99a6ed58baa admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:53.139174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c88626-8fcf-4005-8923-c99a6ed58baa admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:53.139929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c88626-8fcf-4005-8923-c99a6ed58baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:53.141518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c88626-8fcf-4005-8923-c99a6ed58baa admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:53.155881 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1068/2129] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:27:53.157139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87a3d5-51b8-46b1-b1da-0d1f3fd6a0d0 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:53.167097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d87a3d5-51b8-46b1-b1da-0d1f3fd6a0d0 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:53.171684 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62e58a-cc41-4920-ae15-d1a75cbd7452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:53.172559 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62e58a-cc41-4920-ae15-d1a75cbd7452 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:53.172865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62e58a-cc41-4920-ae15-d1a75cbd7452 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:53.173144 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa62e58a-cc41-4920-ae15-d1a75cbd7452 admin admin] PATH_INFO: `/v3/projects/3e86adee4d194ea1a7ab096ffb9e6836/users/07d16ab998754f15a4348a188b8fee85/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:53.187972 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62e58a-cc41-4920-ae15-d1a75cbd7452 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e86adee4d194ea1a7ab096ffb9e6836, user_id=07d16ab998754f15a4348a188b8fee85, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:53.190572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa62e58a-cc41-4920-ae15-d1a75cbd7452 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:53.203887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1062/2130] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:53 2022] PUT /identity/v3/projects/3e86adee4d194ea1a7ab096ffb9e6836/users/07d16ab998754f15a4348a188b8fee85/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:27:53.207753 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c88626-8fcf-4005-8923-c99a6ed58baa admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:53.218584 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c88626-8fcf-4005-8923-c99a6ed58baa admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:53.273934 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7812321-af2d-46d4-a55d-47bc81cbf89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:53.274609 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7812321-af2d-46d4-a55d-47bc81cbf89b admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:53.274893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7812321-af2d-46d4-a55d-47bc81cbf89b admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:53.275170 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7812321-af2d-46d4-a55d-47bc81cbf89b admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:53.275928 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7812321-af2d-46d4-a55d-47bc81cbf89b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:53.278107 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7812321-af2d-46d4-a55d-47bc81cbf89b admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:53.288449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1069/2131] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:27:53 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:27:53.298584 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62e58a-cc41-4920-ae15-d1a75cbd7452 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:53.311812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa62e58a-cc41-4920-ae15-d1a75cbd7452 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:53.316531 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ded34-795a-43a6-8bcb-99d136cd85a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:53.317423 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ded34-795a-43a6-8bcb-99d136cd85a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:53.317705 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ded34-795a-43a6-8bcb-99d136cd85a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:53.317979 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ded34-795a-43a6-8bcb-99d136cd85a1 admin admin] PATH_INFO: `/v3/projects/3e86adee4d194ea1a7ab096ffb9e6836/users/07d16ab998754f15a4348a188b8fee85/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:53.320404 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ded34-795a-43a6-8bcb-99d136cd85a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e86adee4d194ea1a7ab096ffb9e6836, user_id=07d16ab998754f15a4348a188b8fee85, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:53.323940 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ded34-795a-43a6-8bcb-99d136cd85a1 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:53.339775 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1063/2132] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:27:53 2022] PUT /identity/v3/projects/3e86adee4d194ea1a7ab096ffb9e6836/users/07d16ab998754f15a4348a188b8fee85/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:27:53.348296 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fe8cf-b575-4ebf-b9e6-b833616d54f7 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:53.348606 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fe8cf-b575-4ebf-b9e6-b833616d54f7 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:53.348874 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fe8cf-b575-4ebf-b9e6-b833616d54f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:53.377603 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-266fe8cf-b575-4ebf-b9e6-b833616d54f7 None None] MFA Rules not processed for user `07d16ab998754f15a4348a188b8fee85`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:27:53.378838 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-266fe8cf-b575-4ebf-b9e6-b833616d54f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:53.410273 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:27:53.459113 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1070/2133] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:27:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:27:53.470210 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ded34-795a-43a6-8bcb-99d136cd85a1 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:53.472136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-cb8ded34-795a-43a6-8bcb-99d136cd85a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:27:53.544720 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ded34-795a-43a6-8bcb-99d136cd85a1 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:53.548395 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f46cd-7921-413e-9b86-a29ecbde682b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:53.549035 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f46cd-7921-413e-9b86-a29ecbde682b service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:53.549318 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f46cd-7921-413e-9b86-a29ecbde682b service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:53.549597 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11f46cd-7921-413e-9b86-a29ecbde682b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:53.558480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f46cd-7921-413e-9b86-a29ecbde682b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:53.559942 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11f46cd-7921-413e-9b86-a29ecbde682b service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:53.569298 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1064/2134] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:27:53.616415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fe8cf-b575-4ebf-b9e6-b833616d54f7 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:27:53.629794 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fe8cf-b575-4ebf-b9e6-b833616d54f7 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:27:53.634813 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65f5a66-d9b2-41b3-882a-d5d50e252252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:27:53.635889 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f5a66-d9b2-41b3-882a-d5d50e252252 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:27:53.636261 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f5a66-d9b2-41b3-882a-d5d50e252252 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:27:53.636609 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65f5a66-d9b2-41b3-882a-d5d50e252252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:27:53.695502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f5a66-d9b2-41b3-882a-d5d50e252252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:27:53.696978 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65f5a66-d9b2-41b3-882a-d5d50e252252 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:27:53.706033 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1071/2135] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:27:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:03.565068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=44,keystone:INSERT=5 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:03.701811 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=45 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:06.425813 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f46cd-7921-413e-9b86-a29ecbde682b service cinder] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:06.531389 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11f46cd-7921-413e-9b86-a29ecbde682b service cinder] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:06.536711 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3da7b4-c4e5-4974-b8b9-e4a850d9e047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:06.537647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3da7b4-c4e5-4974-b8b9-e4a850d9e047 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:06.537928 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3da7b4-c4e5-4974-b8b9-e4a850d9e047 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:06.538203 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3da7b4-c4e5-4974-b8b9-e4a850d9e047 admin admin] PATH_INFO: `/v3/users/bd25e932c72046ceafdd621a2bc5a09e` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:06.539398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3da7b4-c4e5-4974-b8b9-e4a850d9e047 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd25e932c72046ceafdd621a2bc5a09e)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:06.541379 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3da7b4-c4e5-4974-b8b9-e4a850d9e047 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:06.590225 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-5b3da7b4-c4e5-4974-b8b9-e4a850d9e047 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd25e932c72046ceafdd621a2bc5a09e'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:06.597815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-5b3da7b4-c4e5-4974-b8b9-e4a850d9e047 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd25e932c72046ceafdd621a2bc5a09e'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:06.598750 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-5b3da7b4-c4e5-4974-b8b9-e4a850d9e047 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd25e932c72046ceafdd621a2bc5a09e'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:06.613544 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-5b3da7b4-c4e5-4974-b8b9-e4a850d9e047 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd25e932c72046ceafdd621a2bc5a09e'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:06.614211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-5b3da7b4-c4e5-4974-b8b9-e4a850d9e047 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd25e932c72046ceafdd621a2bc5a09e'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:06.627981 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1065/2136] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:06 2022] DELETE /identity/v3/users/bd25e932c72046ceafdd621a2bc5a09e => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:06.632554 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb944b-eb70-472a-9a57-b1bccd7d1636 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:06.633031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb944b-eb70-472a-9a57-b1bccd7d1636 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:06.633184 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eb944b-eb70-472a-9a57-b1bccd7d1636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:06.650848 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-74eb944b-eb70-472a-9a57-b1bccd7d1636 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:06.652105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-74eb944b-eb70-472a-9a57-b1bccd7d1636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:06.710321 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1072/2137] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:06.720121 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3da7b4-c4e5-4974-b8b9-e4a850d9e047 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:06.721527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-5b3da7b4-c4e5-4974-b8b9-e4a850d9e047 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:06.779252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3da7b4-c4e5-4974-b8b9-e4a850d9e047 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:06.783010 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dce225-6258-4bed-8691-9eee0503740e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:06.783683 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dce225-6258-4bed-8691-9eee0503740e service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:06.783974 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dce225-6258-4bed-8691-9eee0503740e service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:06.784255 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dce225-6258-4bed-8691-9eee0503740e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:06.794033 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dce225-6258-4bed-8691-9eee0503740e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:06.795477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dce225-6258-4bed-8691-9eee0503740e service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:06.805165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1066/2138] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:07.071126 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb944b-eb70-472a-9a57-b1bccd7d1636 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:07.072738 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-74eb944b-eb70-472a-9a57-b1bccd7d1636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:07.084919 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eb944b-eb70-472a-9a57-b1bccd7d1636 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:07.089531 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2465224-3cf4-450e-85d2-b02c20c57161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:07.090967 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2465224-3cf4-450e-85d2-b02c20c57161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:07.091251 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2465224-3cf4-450e-85d2-b02c20c57161 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:07.091688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2465224-3cf4-450e-85d2-b02c20c57161 admin admin] PATH_INFO: `/v3/projects/de06018cf7354f01a8abdb5cda21a779` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:07.092902 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2465224-3cf4-450e-85d2-b02c20c57161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de06018cf7354f01a8abdb5cda21a779)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:07.094824 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2465224-3cf4-450e-85d2-b02c20c57161 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:07.144848 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-b2465224-3cf4-450e-85d2-b02c20c57161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de06018cf7354f01a8abdb5cda21a779', 'request_id': 'req-b2465224-3cf4-450e-85d2-b02c20c57161'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:07.150304 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-b2465224-3cf4-450e-85d2-b02c20c57161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de06018cf7354f01a8abdb5cda21a779', 'request_id': 'req-b2465224-3cf4-450e-85d2-b02c20c57161'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:07.156941 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-b2465224-3cf4-450e-85d2-b02c20c57161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de06018cf7354f01a8abdb5cda21a779', 'request_id': 'req-b2465224-3cf4-450e-85d2-b02c20c57161'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:07.169874 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-b2465224-3cf4-450e-85d2-b02c20c57161 admin admin] The token cache is being invalidate because project de06018cf7354f01a8abdb5cda21a779 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:07.170166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-b2465224-3cf4-450e-85d2-b02c20c57161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:07.170791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-b2465224-3cf4-450e-85d2-b02c20c57161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:07.172362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1073/2139] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:07 2022] DELETE /identity/v3/projects/de06018cf7354f01a8abdb5cda21a779 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:07.176489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dce225-6258-4bed-8691-9eee0503740e service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:07.185956 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dce225-6258-4bed-8691-9eee0503740e service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:07.203368 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:07.243780 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd97da4-a446-4fcc-b4fd-b90a081d6cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:07.244584 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd97da4-a446-4fcc-b4fd-b90a081d6cf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:07.244866 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd97da4-a446-4fcc-b4fd-b90a081d6cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:07.245144 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd97da4-a446-4fcc-b4fd-b90a081d6cf5 admin admin] PATH_INFO: `/v3/users/07d16ab998754f15a4348a188b8fee85` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:07.246388 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd97da4-a446-4fcc-b4fd-b90a081d6cf5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=07d16ab998754f15a4348a188b8fee85)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:07.248416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd97da4-a446-4fcc-b4fd-b90a081d6cf5 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:07.292897 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-3dd97da4-a446-4fcc-b4fd-b90a081d6cf5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07d16ab998754f15a4348a188b8fee85'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:07.301578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-3dd97da4-a446-4fcc-b4fd-b90a081d6cf5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07d16ab998754f15a4348a188b8fee85'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:07.302195 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-3dd97da4-a446-4fcc-b4fd-b90a081d6cf5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07d16ab998754f15a4348a188b8fee85'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:07.313835 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-3dd97da4-a446-4fcc-b4fd-b90a081d6cf5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07d16ab998754f15a4348a188b8fee85'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:07.314453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-3dd97da4-a446-4fcc-b4fd-b90a081d6cf5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07d16ab998754f15a4348a188b8fee85'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:07.326827 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1067/2140] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:07 2022] DELETE /identity/v3/users/07d16ab998754f15a4348a188b8fee85 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:07.633142 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2465224-3cf4-450e-85d2-b02c20c57161 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:07.636007 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-b2465224-3cf4-450e-85d2-b02c20c57161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:07.651853 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2465224-3cf4-450e-85d2-b02c20c57161 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:07.717266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf8c303-295e-454c-b031-1f9d19a0ec68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:07.718164 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8c303-295e-454c-b031-1f9d19a0ec68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:07.718443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8c303-295e-454c-b031-1f9d19a0ec68 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:07.718715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf8c303-295e-454c-b031-1f9d19a0ec68 admin admin] PATH_INFO: `/v3/projects/3e86adee4d194ea1a7ab096ffb9e6836` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:07.719931 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8c303-295e-454c-b031-1f9d19a0ec68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e86adee4d194ea1a7ab096ffb9e6836)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:07.721833 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf8c303-295e-454c-b031-1f9d19a0ec68 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:07.751824 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:07.769104 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2bf8c303-295e-454c-b031-1f9d19a0ec68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e86adee4d194ea1a7ab096ffb9e6836', 'request_id': 'req-2bf8c303-295e-454c-b031-1f9d19a0ec68'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:07.774355 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2bf8c303-295e-454c-b031-1f9d19a0ec68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e86adee4d194ea1a7ab096ffb9e6836', 'request_id': 'req-2bf8c303-295e-454c-b031-1f9d19a0ec68'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:07.780910 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2bf8c303-295e-454c-b031-1f9d19a0ec68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e86adee4d194ea1a7ab096ffb9e6836', 'request_id': 'req-2bf8c303-295e-454c-b031-1f9d19a0ec68'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:07.794218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2bf8c303-295e-454c-b031-1f9d19a0ec68 admin admin] The token cache is being invalidate because project 3e86adee4d194ea1a7ab096ffb9e6836 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:07.794506 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2bf8c303-295e-454c-b031-1f9d19a0ec68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:07.795126 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2bf8c303-295e-454c-b031-1f9d19a0ec68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:07.796833 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1074/2141] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:07 2022] DELETE /identity/v3/projects/3e86adee4d194ea1a7ab096ffb9e6836 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:07.802713 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd45c02-2b35-42fc-b9a5-f133bad67816 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:07.802713 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd45c02-2b35-42fc-b9a5-f133bad67816 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:07.802713 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd45c02-2b35-42fc-b9a5-f133bad67816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:07.820315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-2bd45c02-2b35-42fc-b9a5-f133bad67816 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:07.821502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-2bd45c02-2b35-42fc-b9a5-f133bad67816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:07.880568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1068/2142] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:07.888382 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa207cc8-5428-45f6-825a-bf3278a82b0c None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:07.888674 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa207cc8-5428-45f6-825a-bf3278a82b0c None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:07.888951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa207cc8-5428-45f6-825a-bf3278a82b0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:07.914661 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-aa207cc8-5428-45f6-825a-bf3278a82b0c None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:07.915928 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-aa207cc8-5428-45f6-825a-bf3278a82b0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:07.924828 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1075/2143] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:07.928897 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd45c02-2b35-42fc-b9a5-f133bad67816 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:07.939510 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd45c02-2b35-42fc-b9a5-f133bad67816 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:07.944174 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4070df1-04ca-468d-b481-6cce50917420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:07.944832 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4070df1-04ca-468d-b481-6cce50917420 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:07.945117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4070df1-04ca-468d-b481-6cce50917420 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:07.945411 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4070df1-04ca-468d-b481-6cce50917420 admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:07.946117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4070df1-04ca-468d-b481-6cce50917420 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:28:07.946433 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4070df1-04ca-468d-b481-6cce50917420 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:07.948088 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4070df1-04ca-468d-b481-6cce50917420 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:07.962943 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1069/2144] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:28:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:28:07.964022 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa207cc8-5428-45f6-825a-bf3278a82b0c None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:07.973729 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa207cc8-5428-45f6-825a-bf3278a82b0c None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:07.979383 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34227f89-3445-47e9-8265-6a9ee782671d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:07.980080 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34227f89-3445-47e9-8265-6a9ee782671d admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:07.981001 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34227f89-3445-47e9-8265-6a9ee782671d admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:07.981278 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34227f89-3445-47e9-8265-6a9ee782671d admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:07.982015 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34227f89-3445-47e9-8265-6a9ee782671d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:07.983967 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34227f89-3445-47e9-8265-6a9ee782671d admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:08.015188 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1076/2145] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:07 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:28:08.016447 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4070df1-04ca-468d-b481-6cce50917420 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:08.026881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4070df1-04ca-468d-b481-6cce50917420 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:08.055464 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:08.114228 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1620fbb-e6d4-4606-aba8-ab1eaa8237ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:08.114784 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1620fbb-e6d4-4606-aba8-ab1eaa8237ee admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:08.115157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1620fbb-e6d4-4606-aba8-ab1eaa8237ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:08.115504 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1620fbb-e6d4-4606-aba8-ab1eaa8237ee admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:08.116344 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1620fbb-e6d4-4606-aba8-ab1eaa8237ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:08.118598 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1620fbb-e6d4-4606-aba8-ab1eaa8237ee admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:08.148558 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1070/2146] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:08 2022] POST /identity/v3/users => generated 291 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:08.153950 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34227f89-3445-47e9-8265-6a9ee782671d admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:08.165510 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34227f89-3445-47e9-8265-6a9ee782671d admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:08.170800 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79708e66-692b-4384-9255-d7f16099b89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:08.172182 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79708e66-692b-4384-9255-d7f16099b89d admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:08.172475 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79708e66-692b-4384-9255-d7f16099b89d admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:08.172758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79708e66-692b-4384-9255-d7f16099b89d admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:08.175060 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79708e66-692b-4384-9255-d7f16099b89d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:08.175194 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79708e66-692b-4384-9255-d7f16099b89d admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:08.188341 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1077/2147] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:08.192372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1620fbb-e6d4-4606-aba8-ab1eaa8237ee admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:08.206314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1620fbb-e6d4-4606-aba8-ab1eaa8237ee admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:08.213654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9333e5-10f6-45c7-9004-fbf8b7b713fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:08.214416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9333e5-10f6-45c7-9004-fbf8b7b713fd admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:08.215747 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9333e5-10f6-45c7-9004-fbf8b7b713fd admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:08.215747 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9333e5-10f6-45c7-9004-fbf8b7b713fd admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:08.216519 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9333e5-10f6-45c7-9004-fbf8b7b713fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:08.218218 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9333e5-10f6-45c7-9004-fbf8b7b713fd admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:08.229532 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1071/2148] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:08.233517 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79708e66-692b-4384-9255-d7f16099b89d admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:08.243746 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79708e66-692b-4384-9255-d7f16099b89d admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:08.250485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f97493-23ba-495c-b278-f1954d97b4ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:08.251486 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f97493-23ba-495c-b278-f1954d97b4ab admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:08.251908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f97493-23ba-495c-b278-f1954d97b4ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:08.252259 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f97493-23ba-495c-b278-f1954d97b4ab admin admin] PATH_INFO: `/v3/projects/9aec2d37a9f24a69b30a3219bdc63914/users/ce2fec14094d4f0aa819c954e732b799/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:08.277882 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f97493-23ba-495c-b278-f1954d97b4ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aec2d37a9f24a69b30a3219bdc63914, user_id=ce2fec14094d4f0aa819c954e732b799, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:08.281242 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f97493-23ba-495c-b278-f1954d97b4ab admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:08.308379 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1078/2149] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:08 2022] PUT /identity/v3/projects/9aec2d37a9f24a69b30a3219bdc63914/users/ce2fec14094d4f0aa819c954e732b799/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:08.310777 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03135a41-e373-43c1-b9c5-ec8e8a9a0dc5 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:08.311192 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03135a41-e373-43c1-b9c5-ec8e8a9a0dc5 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:08.311575 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03135a41-e373-43c1-b9c5-ec8e8a9a0dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:08.360144 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-03135a41-e373-43c1-b9c5-ec8e8a9a0dc5 None None] MFA Rules not processed for user `ce2fec14094d4f0aa819c954e732b799`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:08.361830 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-03135a41-e373-43c1-b9c5-ec8e8a9a0dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:08.451094 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1072/2150] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:08.455413 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f97493-23ba-495c-b278-f1954d97b4ab admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:08.537523 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f97493-23ba-495c-b278-f1954d97b4ab admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:08.542610 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15572a3-6f0e-4e7c-aee7-fe65722a5ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:08.543808 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15572a3-6f0e-4e7c-aee7-fe65722a5ccc admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:08.544093 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15572a3-6f0e-4e7c-aee7-fe65722a5ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:08.544366 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15572a3-6f0e-4e7c-aee7-fe65722a5ccc admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:08.545061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15572a3-6f0e-4e7c-aee7-fe65722a5ccc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:08.547034 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15572a3-6f0e-4e7c-aee7-fe65722a5ccc admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:08.577685 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1079/2151] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:08 2022] POST /identity/v3/projects => generated 381 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:08.581738 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03135a41-e373-43c1-b9c5-ec8e8a9a0dc5 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:08.598602 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03135a41-e373-43c1-b9c5-ec8e8a9a0dc5 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:08.665255 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0e142-e47f-45d8-85de-cb53346f176d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:08.665934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0e142-e47f-45d8-85de-cb53346f176d admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:08.666376 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0e142-e47f-45d8-85de-cb53346f176d admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:08.666797 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c0e142-e47f-45d8-85de-cb53346f176d admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:08.668399 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0e142-e47f-45d8-85de-cb53346f176d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:08.670625 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c0e142-e47f-45d8-85de-cb53346f176d admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:08.699939 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1073/2152] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:08 2022] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:08.704597 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15572a3-6f0e-4e7c-aee7-fe65722a5ccc admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:08.732241 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15572a3-6f0e-4e7c-aee7-fe65722a5ccc admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:08.738906 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54dff9-fd48-4048-a30c-91d64d3a2e62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:08.739805 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54dff9-fd48-4048-a30c-91d64d3a2e62 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:08.740342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54dff9-fd48-4048-a30c-91d64d3a2e62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:08.740784 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f54dff9-fd48-4048-a30c-91d64d3a2e62 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:08.741724 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54dff9-fd48-4048-a30c-91d64d3a2e62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:08.744184 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f54dff9-fd48-4048-a30c-91d64d3a2e62 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:08.773083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1080/2153] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:08.776963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0e142-e47f-45d8-85de-cb53346f176d admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:08.794318 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c0e142-e47f-45d8-85de-cb53346f176d admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:08.804802 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e46648-1297-421e-a33e-237909785da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:08.805718 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e46648-1297-421e-a33e-237909785da0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:08.806000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e46648-1297-421e-a33e-237909785da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:08.806277 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e46648-1297-421e-a33e-237909785da0 admin admin] PATH_INFO: `/v3/projects/31a32685fa754805906a62a8e4e1f9ca/users/47c9223f839a465190fa9e3e03dcb045/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:08.823410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e46648-1297-421e-a33e-237909785da0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a32685fa754805906a62a8e4e1f9ca, user_id=47c9223f839a465190fa9e3e03dcb045, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:08.827055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e46648-1297-421e-a33e-237909785da0 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:08.861329 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1074/2154] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:08 2022] PUT /identity/v3/projects/31a32685fa754805906a62a8e4e1f9ca/users/47c9223f839a465190fa9e3e03dcb045/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:08.862349 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54dff9-fd48-4048-a30c-91d64d3a2e62 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:08.874453 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f54dff9-fd48-4048-a30c-91d64d3a2e62 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:08.906700 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:08.955253 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dead3fa6-e4f1-46a3-81f7-ef6def2da2e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:08.955971 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead3fa6-e4f1-46a3-81f7-ef6def2da2e7 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:08.956263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead3fa6-e4f1-46a3-81f7-ef6def2da2e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:08.956546 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dead3fa6-e4f1-46a3-81f7-ef6def2da2e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:08.957285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead3fa6-e4f1-46a3-81f7-ef6def2da2e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:08.958893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dead3fa6-e4f1-46a3-81f7-ef6def2da2e7 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:08.970264 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1081/2155] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:08 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:08.973611 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e46648-1297-421e-a33e-237909785da0 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:08.979238 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:08.985586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e46648-1297-421e-a33e-237909785da0 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:08.995359 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549c224-ad47-4b5f-a6fd-c4bb1eb152a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:08.996321 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549c224-ad47-4b5f-a6fd-c4bb1eb152a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:08.996636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549c224-ad47-4b5f-a6fd-c4bb1eb152a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:08.996915 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549c224-ad47-4b5f-a6fd-c4bb1eb152a3 admin admin] PATH_INFO: `/v3/projects/31a32685fa754805906a62a8e4e1f9ca/users/47c9223f839a465190fa9e3e03dcb045/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:08.998970 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549c224-ad47-4b5f-a6fd-c4bb1eb152a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31a32685fa754805906a62a8e4e1f9ca, user_id=47c9223f839a465190fa9e3e03dcb045, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:09.001725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549c224-ad47-4b5f-a6fd-c4bb1eb152a3 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:09.013046 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1075/2156] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:08 2022] PUT /identity/v3/projects/31a32685fa754805906a62a8e4e1f9ca/users/47c9223f839a465190fa9e3e03dcb045/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:09.024137 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a13efb-fca2-4dda-be8e-6d4774732573 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:09.024515 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a13efb-fca2-4dda-be8e-6d4774732573 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:09.024874 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a13efb-fca2-4dda-be8e-6d4774732573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:09.053613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-91a13efb-fca2-4dda-be8e-6d4774732573 None None] MFA Rules not processed for user `47c9223f839a465190fa9e3e03dcb045`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:09.054860 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-91a13efb-fca2-4dda-be8e-6d4774732573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:09.150157 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1082/2157] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:09.161158 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549c224-ad47-4b5f-a6fd-c4bb1eb152a3 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:09.162863 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-7549c224-ad47-4b5f-a6fd-c4bb1eb152a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:09.230008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549c224-ad47-4b5f-a6fd-c4bb1eb152a3 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:09.233764 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca25a219-9388-4c31-aac8-f1d8781b4020 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:09.234418 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25a219-9388-4c31-aac8-f1d8781b4020 service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:09.235028 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25a219-9388-4c31-aac8-f1d8781b4020 service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:09.235028 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca25a219-9388-4c31-aac8-f1d8781b4020 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:09.245514 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25a219-9388-4c31-aac8-f1d8781b4020 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:09.247676 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca25a219-9388-4c31-aac8-f1d8781b4020 service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:09.257621 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1076/2158] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:09.655148 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a13efb-fca2-4dda-be8e-6d4774732573 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:09.739292 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a13efb-fca2-4dda-be8e-6d4774732573 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:09.744739 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630c521-b37d-4a10-a6af-0ba76834a631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:09.745676 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630c521-b37d-4a10-a6af-0ba76834a631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:09.746552 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630c521-b37d-4a10-a6af-0ba76834a631 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:09.746835 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630c521-b37d-4a10-a6af-0ba76834a631 admin admin] PATH_INFO: `/v3/users/ce2fec14094d4f0aa819c954e732b799` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:09.748086 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630c521-b37d-4a10-a6af-0ba76834a631 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce2fec14094d4f0aa819c954e732b799)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:09.750086 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630c521-b37d-4a10-a6af-0ba76834a631 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:09.815156 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2630c521-b37d-4a10-a6af-0ba76834a631 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce2fec14094d4f0aa819c954e732b799'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:09.817605 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:09.837721 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fbb6f-cff7-4ab7-873c-e935ccc26ca1 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:09.838234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fbb6f-cff7-4ab7-873c-e935ccc26ca1 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:09.838610 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600fbb6f-cff7-4ab7-873c-e935ccc26ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:09.841272 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2630c521-b37d-4a10-a6af-0ba76834a631 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce2fec14094d4f0aa819c954e732b799'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:09.842012 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2630c521-b37d-4a10-a6af-0ba76834a631 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce2fec14094d4f0aa819c954e732b799'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:09.842691 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2630c521-b37d-4a10-a6af-0ba76834a631 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce2fec14094d4f0aa819c954e732b799'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:09.857801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2630c521-b37d-4a10-a6af-0ba76834a631 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce2fec14094d4f0aa819c954e732b799'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:09.860427 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-600fbb6f-cff7-4ab7-873c-e935ccc26ca1 None None] MFA Rules not processed for user `4cca20d97f474e52bf6581a6a8c57670`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:09.861651 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-600fbb6f-cff7-4ab7-873c-e935ccc26ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:09.872645 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1083/2159] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:09 2022] DELETE /identity/v3/users/ce2fec14094d4f0aa819c954e732b799 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:09.877050 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0061b3-8ece-4bf4-8cbc-81d180e472cd None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:09.877382 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0061b3-8ece-4bf4-8cbc-81d180e472cd None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:09.877680 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0061b3-8ece-4bf4-8cbc-81d180e472cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:09.899573 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-5b0061b3-8ece-4bf4-8cbc-81d180e472cd None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:09.901449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-5b0061b3-8ece-4bf4-8cbc-81d180e472cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:09.924096 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1077/2160] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:09.988623 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1084/2161] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:09.996222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fbb6f-cff7-4ab7-873c-e935ccc26ca1 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:09.998058 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-600fbb6f-cff7-4ab7-873c-e935ccc26ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:10.072962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600fbb6f-cff7-4ab7-873c-e935ccc26ca1 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:10.142613 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c28677-f23f-4779-b90e-b2eab25b9f1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:10.143784 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c28677-f23f-4779-b90e-b2eab25b9f1a service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:10.144071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c28677-f23f-4779-b90e-b2eab25b9f1a service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:10.144349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c28677-f23f-4779-b90e-b2eab25b9f1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:10.153138 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:10.158111 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c28677-f23f-4779-b90e-b2eab25b9f1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:10.160198 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c28677-f23f-4779-b90e-b2eab25b9f1a service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:10.173863 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1078/2162] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:10.655341 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0061b3-8ece-4bf4-8cbc-81d180e472cd None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:10.656853 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-5b0061b3-8ece-4bf4-8cbc-81d180e472cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:10.672330 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0061b3-8ece-4bf4-8cbc-81d180e472cd None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:10.680054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa39f7-3519-4ef3-9770-892f326218bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:10.682021 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa39f7-3519-4ef3-9770-892f326218bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:10.682402 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa39f7-3519-4ef3-9770-892f326218bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:10.682774 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2aa39f7-3519-4ef3-9770-892f326218bf admin admin] PATH_INFO: `/v3/projects/9aec2d37a9f24a69b30a3219bdc63914` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:10.684905 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa39f7-3519-4ef3-9770-892f326218bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aec2d37a9f24a69b30a3219bdc63914)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:10.687096 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2aa39f7-3519-4ef3-9770-892f326218bf admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:10.824989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-f2aa39f7-3519-4ef3-9770-892f326218bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aec2d37a9f24a69b30a3219bdc63914', 'request_id': 'req-f2aa39f7-3519-4ef3-9770-892f326218bf'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:10.853342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-f2aa39f7-3519-4ef3-9770-892f326218bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aec2d37a9f24a69b30a3219bdc63914', 'request_id': 'req-f2aa39f7-3519-4ef3-9770-892f326218bf'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:10.875931 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-f2aa39f7-3519-4ef3-9770-892f326218bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aec2d37a9f24a69b30a3219bdc63914', 'request_id': 'req-f2aa39f7-3519-4ef3-9770-892f326218bf'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:10.925740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-f2aa39f7-3519-4ef3-9770-892f326218bf admin admin] The token cache is being invalidate because project 9aec2d37a9f24a69b30a3219bdc63914 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:10.926219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-f2aa39f7-3519-4ef3-9770-892f326218bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:10.932086 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-f2aa39f7-3519-4ef3-9770-892f326218bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:10.934275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1085/2163] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:10 2022] DELETE /identity/v3/projects/9aec2d37a9f24a69b30a3219bdc63914 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:10.939208 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c28677-f23f-4779-b90e-b2eab25b9f1a service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:10.953633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c28677-f23f-4779-b90e-b2eab25b9f1a service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:11.065501 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d277d5f-9ad9-4b6d-ae95-aed6c31fc8c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:11.067188 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d277d5f-9ad9-4b6d-ae95-aed6c31fc8c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:11.067480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d277d5f-9ad9-4b6d-ae95-aed6c31fc8c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:11.067800 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d277d5f-9ad9-4b6d-ae95-aed6c31fc8c4 admin admin] PATH_INFO: `/v3/users/47c9223f839a465190fa9e3e03dcb045` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:11.069220 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d277d5f-9ad9-4b6d-ae95-aed6c31fc8c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47c9223f839a465190fa9e3e03dcb045)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:11.071179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d277d5f-9ad9-4b6d-ae95-aed6c31fc8c4 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:11.141249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-4d277d5f-9ad9-4b6d-ae95-aed6c31fc8c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47c9223f839a465190fa9e3e03dcb045'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:11.152347 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-4d277d5f-9ad9-4b6d-ae95-aed6c31fc8c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47c9223f839a465190fa9e3e03dcb045'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:11.153664 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-4d277d5f-9ad9-4b6d-ae95-aed6c31fc8c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47c9223f839a465190fa9e3e03dcb045'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:11.171411 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-4d277d5f-9ad9-4b6d-ae95-aed6c31fc8c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47c9223f839a465190fa9e3e03dcb045'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:11.172357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-4d277d5f-9ad9-4b6d-ae95-aed6c31fc8c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47c9223f839a465190fa9e3e03dcb045'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:11.191889 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1079/2164] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:10 2022] DELETE /identity/v3/users/47c9223f839a465190fa9e3e03dcb045 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:11.506436 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa39f7-3519-4ef3-9770-892f326218bf admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:11.508011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-f2aa39f7-3519-4ef3-9770-892f326218bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:11.522184 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2aa39f7-3519-4ef3-9770-892f326218bf admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:11.571118 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:11.584434 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a403751-c80a-45b0-a2a7-dccfe27e60db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:11.585323 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a403751-c80a-45b0-a2a7-dccfe27e60db admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:11.585607 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a403751-c80a-45b0-a2a7-dccfe27e60db admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:11.585887 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a403751-c80a-45b0-a2a7-dccfe27e60db admin admin] PATH_INFO: `/v3/projects/31a32685fa754805906a62a8e4e1f9ca` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:11.587075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a403751-c80a-45b0-a2a7-dccfe27e60db admin admin] RBAC: Authorizing `identity:delete_project(project_id=31a32685fa754805906a62a8e4e1f9ca)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:11.589168 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a403751-c80a-45b0-a2a7-dccfe27e60db admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:11.635370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4a403751-c80a-45b0-a2a7-dccfe27e60db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31a32685fa754805906a62a8e4e1f9ca', 'request_id': 'req-4a403751-c80a-45b0-a2a7-dccfe27e60db'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:11.640802 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4a403751-c80a-45b0-a2a7-dccfe27e60db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31a32685fa754805906a62a8e4e1f9ca', 'request_id': 'req-4a403751-c80a-45b0-a2a7-dccfe27e60db'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:11.647168 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4a403751-c80a-45b0-a2a7-dccfe27e60db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31a32685fa754805906a62a8e4e1f9ca', 'request_id': 'req-4a403751-c80a-45b0-a2a7-dccfe27e60db'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:11.660166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4a403751-c80a-45b0-a2a7-dccfe27e60db admin admin] The token cache is being invalidate because project 31a32685fa754805906a62a8e4e1f9ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:11.660452 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4a403751-c80a-45b0-a2a7-dccfe27e60db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:11.661067 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4a403751-c80a-45b0-a2a7-dccfe27e60db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:11.662616 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1086/2165] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:11 2022] DELETE /identity/v3/projects/31a32685fa754805906a62a8e4e1f9ca => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:11.667494 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c49333-a1c6-48af-815b-c496f0022e51 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:11.668422 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c49333-a1c6-48af-815b-c496f0022e51 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:11.668704 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c49333-a1c6-48af-815b-c496f0022e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:11.686918 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-e8c49333-a1c6-48af-815b-c496f0022e51 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:11.688141 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e8c49333-a1c6-48af-815b-c496f0022e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:11.745847 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1080/2166] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:11.753336 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dae514-b354-4d0b-ae6d-2b9b1689c3ac None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:11.753639 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dae514-b354-4d0b-ae6d-2b9b1689c3ac None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:11.753919 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dae514-b354-4d0b-ae6d-2b9b1689c3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:11.772334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-24dae514-b354-4d0b-ae6d-2b9b1689c3ac None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:11.773529 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-24dae514-b354-4d0b-ae6d-2b9b1689c3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:11.782078 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1087/2167] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:11.786085 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c49333-a1c6-48af-815b-c496f0022e51 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:11.799782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c49333-a1c6-48af-815b-c496f0022e51 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:11.805216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab722d3f-06d9-46ab-912d-30f0e017e8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:11.805887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab722d3f-06d9-46ab-912d-30f0e017e8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:11.806172 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab722d3f-06d9-46ab-912d-30f0e017e8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:11.806449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab722d3f-06d9-46ab-912d-30f0e017e8a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:11.807182 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab722d3f-06d9-46ab-912d-30f0e017e8a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:28:11.807494 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab722d3f-06d9-46ab-912d-30f0e017e8a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:11.809190 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab722d3f-06d9-46ab-912d-30f0e017e8a2 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:11.822581 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1081/2168] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:28:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:28:11.827447 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dae514-b354-4d0b-ae6d-2b9b1689c3ac None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:11.836975 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dae514-b354-4d0b-ae6d-2b9b1689c3ac None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:11.842344 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604096a-8a2c-4f21-b978-fcc081f36525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:11.842997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604096a-8a2c-4f21-b978-fcc081f36525 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:11.843285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604096a-8a2c-4f21-b978-fcc081f36525 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:11.843566 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3604096a-8a2c-4f21-b978-fcc081f36525 admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:11.844296 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604096a-8a2c-4f21-b978-fcc081f36525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:11.846202 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3604096a-8a2c-4f21-b978-fcc081f36525 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:11.882618 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1088/2169] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:11 2022] POST /identity/v3/projects => generated 359 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:28:11.883823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab722d3f-06d9-46ab-912d-30f0e017e8a2 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:11.890459 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:11.895846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab722d3f-06d9-46ab-912d-30f0e017e8a2 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:11.967490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc843f-46ec-478c-bc09-78e3d85f5441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:11.968874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc843f-46ec-478c-bc09-78e3d85f5441 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:11.969229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc843f-46ec-478c-bc09-78e3d85f5441 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:11.969576 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc843f-46ec-478c-bc09-78e3d85f5441 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:11.970342 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc843f-46ec-478c-bc09-78e3d85f5441 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:11.972391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc843f-46ec-478c-bc09-78e3d85f5441 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:12.008248 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1082/2170] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:11 2022] POST /identity/v3/users => generated 280 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:28:12.012825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604096a-8a2c-4f21-b978-fcc081f36525 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:12.023401 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3604096a-8a2c-4f21-b978-fcc081f36525 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:12.029932 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b611eb0-eee2-40bb-9b4c-6037c2eaf0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:12.030461 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b611eb0-eee2-40bb-9b4c-6037c2eaf0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:12.031048 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b611eb0-eee2-40bb-9b4c-6037c2eaf0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:12.031048 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b611eb0-eee2-40bb-9b4c-6037c2eaf0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:12.031758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b611eb0-eee2-40bb-9b4c-6037c2eaf0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:12.033385 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b611eb0-eee2-40bb-9b4c-6037c2eaf0b9 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:12.046098 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1089/2171] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:12.050344 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc843f-46ec-478c-bc09-78e3d85f5441 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:12.061185 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc843f-46ec-478c-bc09-78e3d85f5441 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:12.071871 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8888cf9-3827-4a55-9939-888afcb0b90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:12.072638 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8888cf9-3827-4a55-9939-888afcb0b90b admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:12.073039 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8888cf9-3827-4a55-9939-888afcb0b90b admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:12.073386 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8888cf9-3827-4a55-9939-888afcb0b90b admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:12.077572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8888cf9-3827-4a55-9939-888afcb0b90b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:12.077572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8888cf9-3827-4a55-9939-888afcb0b90b admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:12.087915 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1083/2172] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:12.092777 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b611eb0-eee2-40bb-9b4c-6037c2eaf0b9 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:12.108731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b611eb0-eee2-40bb-9b4c-6037c2eaf0b9 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:12.113557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879efa82-80eb-475c-b01d-f4ab298687cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:12.114445 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879efa82-80eb-475c-b01d-f4ab298687cb admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:12.114726 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879efa82-80eb-475c-b01d-f4ab298687cb admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:12.115014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879efa82-80eb-475c-b01d-f4ab298687cb admin admin] PATH_INFO: `/v3/projects/9b1798706e8f4d2a9319e7e98e663b48/users/974da51c09264a8293503cc7d5207ceb/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:12.130648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879efa82-80eb-475c-b01d-f4ab298687cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b1798706e8f4d2a9319e7e98e663b48, user_id=974da51c09264a8293503cc7d5207ceb, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:12.133654 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879efa82-80eb-475c-b01d-f4ab298687cb admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:12.149450 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1090/2173] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:12 2022] PUT /identity/v3/projects/9b1798706e8f4d2a9319e7e98e663b48/users/974da51c09264a8293503cc7d5207ceb/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:12.161759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979e767-7f38-4fa6-806b-709dd22a6ca1 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:12.162058 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979e767-7f38-4fa6-806b-709dd22a6ca1 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:12.162367 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f979e767-7f38-4fa6-806b-709dd22a6ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:12.190124 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-f979e767-7f38-4fa6-806b-709dd22a6ca1 None None] MFA Rules not processed for user `974da51c09264a8293503cc7d5207ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:12.191358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-f979e767-7f38-4fa6-806b-709dd22a6ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:12.257876 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1084/2174] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:12 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:12.288734 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879efa82-80eb-475c-b01d-f4ab298687cb admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:12.290434 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-879efa82-80eb-475c-b01d-f4ab298687cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:12.346534 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879efa82-80eb-475c-b01d-f4ab298687cb admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:12.350245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5077b61-71fb-48bc-a431-13b6ec5e2bb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:12.350897 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5077b61-71fb-48bc-a431-13b6ec5e2bb7 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:12.351185 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5077b61-71fb-48bc-a431-13b6ec5e2bb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:12.351467 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5077b61-71fb-48bc-a431-13b6ec5e2bb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:12.360480 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5077b61-71fb-48bc-a431-13b6ec5e2bb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:12.361922 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5077b61-71fb-48bc-a431-13b6ec5e2bb7 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:12.371186 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1091/2175] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:12 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:12.385407 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979e767-7f38-4fa6-806b-709dd22a6ca1 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:12.446550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f979e767-7f38-4fa6-806b-709dd22a6ca1 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:12.451548 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628b694-d8a3-4fa1-b7bd-dd1f56b8a6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:12.452440 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628b694-d8a3-4fa1-b7bd-dd1f56b8a6b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:12.452752 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628b694-d8a3-4fa1-b7bd-dd1f56b8a6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:12.453026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d628b694-d8a3-4fa1-b7bd-dd1f56b8a6b5 admin admin] PATH_INFO: `/v3/users/974da51c09264a8293503cc7d5207ceb` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:12.454210 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628b694-d8a3-4fa1-b7bd-dd1f56b8a6b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=974da51c09264a8293503cc7d5207ceb)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:12.456159 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d628b694-d8a3-4fa1-b7bd-dd1f56b8a6b5 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:12.468092 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:12.501776 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d628b694-d8a3-4fa1-b7bd-dd1f56b8a6b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '974da51c09264a8293503cc7d5207ceb'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:12.508708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d628b694-d8a3-4fa1-b7bd-dd1f56b8a6b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '974da51c09264a8293503cc7d5207ceb'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:12.509335 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d628b694-d8a3-4fa1-b7bd-dd1f56b8a6b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '974da51c09264a8293503cc7d5207ceb'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:12.521898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d628b694-d8a3-4fa1-b7bd-dd1f56b8a6b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '974da51c09264a8293503cc7d5207ceb'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:12.522539 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d628b694-d8a3-4fa1-b7bd-dd1f56b8a6b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '974da51c09264a8293503cc7d5207ceb'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:12.534444 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1085/2176] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:12 2022] DELETE /identity/v3/users/974da51c09264a8293503cc7d5207ceb => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:12.538902 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f79dd9-d11a-4424-aa1c-d5e430d38542 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:12.539198 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f79dd9-d11a-4424-aa1c-d5e430d38542 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:12.539480 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f79dd9-d11a-4424-aa1c-d5e430d38542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:12.556091 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-49f79dd9-d11a-4424-aa1c-d5e430d38542 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:12.557312 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-49f79dd9-d11a-4424-aa1c-d5e430d38542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:12.569324 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:12.619907 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1092/2177] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:12.631693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628b694-d8a3-4fa1-b7bd-dd1f56b8a6b5 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:12.633155 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d628b694-d8a3-4fa1-b7bd-dd1f56b8a6b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:12.691170 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d628b694-d8a3-4fa1-b7bd-dd1f56b8a6b5 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:12.694871 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1971b23d-4a14-4b2b-8c26-e3f081cec72c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:12.695511 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971b23d-4a14-4b2b-8c26-e3f081cec72c service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:12.695835 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971b23d-4a14-4b2b-8c26-e3f081cec72c service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:12.696118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1971b23d-4a14-4b2b-8c26-e3f081cec72c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:12.705252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971b23d-4a14-4b2b-8c26-e3f081cec72c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:12.706649 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1971b23d-4a14-4b2b-8c26-e3f081cec72c service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:12.716072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1086/2178] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:12.986387 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f79dd9-d11a-4424-aa1c-d5e430d38542 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:12.988025 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-49f79dd9-d11a-4424-aa1c-d5e430d38542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:13.007750 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f79dd9-d11a-4424-aa1c-d5e430d38542 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:13.013222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99e3a5-c678-483e-9eb4-a25cec44671a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:13.014129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99e3a5-c678-483e-9eb4-a25cec44671a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:13.014415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99e3a5-c678-483e-9eb4-a25cec44671a admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:13.014832 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99e3a5-c678-483e-9eb4-a25cec44671a admin admin] PATH_INFO: `/v3/projects/9b1798706e8f4d2a9319e7e98e663b48` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:13.015935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99e3a5-c678-483e-9eb4-a25cec44671a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b1798706e8f4d2a9319e7e98e663b48)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:13.017845 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99e3a5-c678-483e-9eb4-a25cec44671a admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:13.065614 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-bd99e3a5-c678-483e-9eb4-a25cec44671a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b1798706e8f4d2a9319e7e98e663b48', 'request_id': 'req-bd99e3a5-c678-483e-9eb4-a25cec44671a'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:13.071728 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-bd99e3a5-c678-483e-9eb4-a25cec44671a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b1798706e8f4d2a9319e7e98e663b48', 'request_id': 'req-bd99e3a5-c678-483e-9eb4-a25cec44671a'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:13.078760 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-bd99e3a5-c678-483e-9eb4-a25cec44671a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b1798706e8f4d2a9319e7e98e663b48', 'request_id': 'req-bd99e3a5-c678-483e-9eb4-a25cec44671a'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:13.093710 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-bd99e3a5-c678-483e-9eb4-a25cec44671a admin admin] The token cache is being invalidate because project 9b1798706e8f4d2a9319e7e98e663b48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:13.094019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-bd99e3a5-c678-483e-9eb4-a25cec44671a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:13.094642 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-bd99e3a5-c678-483e-9eb4-a25cec44671a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:13.096297 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1093/2179] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:12 2022] DELETE /identity/v3/projects/9b1798706e8f4d2a9319e7e98e663b48 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:13.102014 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65896d2b-035d-4fb7-9d9e-353d7c805f18 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:13.102508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65896d2b-035d-4fb7-9d9e-353d7c805f18 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:13.102685 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65896d2b-035d-4fb7-9d9e-353d7c805f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:13.121599 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-65896d2b-035d-4fb7-9d9e-353d7c805f18 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:13.122788 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-65896d2b-035d-4fb7-9d9e-353d7c805f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:13.189467 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1087/2180] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:13.197160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957e48c-e500-4de6-aae3-dad325d7bc15 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:13.197467 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957e48c-e500-4de6-aae3-dad325d7bc15 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:13.197727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5957e48c-e500-4de6-aae3-dad325d7bc15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:13.221335 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-5957e48c-e500-4de6-aae3-dad325d7bc15 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:13.223024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-5957e48c-e500-4de6-aae3-dad325d7bc15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:13.233030 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1094/2181] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:13.237196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65896d2b-035d-4fb7-9d9e-353d7c805f18 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:13.248314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65896d2b-035d-4fb7-9d9e-353d7c805f18 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:13.253520 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf7ce0-4f5e-4e43-9311-cd8d5db0014e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:13.254230 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf7ce0-4f5e-4e43-9311-cd8d5db0014e admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:13.254519 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf7ce0-4f5e-4e43-9311-cd8d5db0014e admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:13.254805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cf7ce0-4f5e-4e43-9311-cd8d5db0014e admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:13.255580 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf7ce0-4f5e-4e43-9311-cd8d5db0014e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:28:13.255943 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf7ce0-4f5e-4e43-9311-cd8d5db0014e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:13.257570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04cf7ce0-4f5e-4e43-9311-cd8d5db0014e admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:13.271655 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1088/2182] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:28:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:28:13.274357 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957e48c-e500-4de6-aae3-dad325d7bc15 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:13.284324 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5957e48c-e500-4de6-aae3-dad325d7bc15 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:13.288999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264d98f-b309-45d0-b82d-85ed2b2c040d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:13.289662 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264d98f-b309-45d0-b82d-85ed2b2c040d admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:13.289945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264d98f-b309-45d0-b82d-85ed2b2c040d admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:13.290221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264d98f-b309-45d0-b82d-85ed2b2c040d admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:13.290914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264d98f-b309-45d0-b82d-85ed2b2c040d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:13.293447 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264d98f-b309-45d0-b82d-85ed2b2c040d admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:13.320156 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1095/2183] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:13 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:13.324935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf7ce0-4f5e-4e43-9311-cd8d5db0014e admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:13.335899 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04cf7ce0-4f5e-4e43-9311-cd8d5db0014e admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:13.355420 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:13.400726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb904c-f126-4159-ac49-cbe87f34fcd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:13.401415 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb904c-f126-4159-ac49-cbe87f34fcd8 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:13.401710 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb904c-f126-4159-ac49-cbe87f34fcd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:13.402536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb904c-f126-4159-ac49-cbe87f34fcd8 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:13.403240 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb904c-f126-4159-ac49-cbe87f34fcd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:13.405233 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cb904c-f126-4159-ac49-cbe87f34fcd8 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:13.425290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1089/2184] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:13 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:13.429568 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264d98f-b309-45d0-b82d-85ed2b2c040d admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:13.441397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264d98f-b309-45d0-b82d-85ed2b2c040d admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:13.446259 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680635f-1aea-4237-a3a6-58b76233beb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:13.446914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680635f-1aea-4237-a3a6-58b76233beb5 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:13.447198 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680635f-1aea-4237-a3a6-58b76233beb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:13.447506 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6680635f-1aea-4237-a3a6-58b76233beb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:13.448265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680635f-1aea-4237-a3a6-58b76233beb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:13.450401 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6680635f-1aea-4237-a3a6-58b76233beb5 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:13.461480 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1096/2185] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:13.466028 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb904c-f126-4159-ac49-cbe87f34fcd8 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:13.475911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb904c-f126-4159-ac49-cbe87f34fcd8 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:13.480669 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d84a44-3d57-4033-bac5-b5c0674b8823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:13.481257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d84a44-3d57-4033-bac5-b5c0674b8823 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:13.481544 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d84a44-3d57-4033-bac5-b5c0674b8823 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:13.481825 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d84a44-3d57-4033-bac5-b5c0674b8823 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:13.482546 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d84a44-3d57-4033-bac5-b5c0674b8823 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:13.484189 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d84a44-3d57-4033-bac5-b5c0674b8823 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:13.493964 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1090/2186] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:13 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:13.498302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680635f-1aea-4237-a3a6-58b76233beb5 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:13.509368 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6680635f-1aea-4237-a3a6-58b76233beb5 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:13.514790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf47cce-18f0-4f1f-bf32-17d8dace3f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:13.515688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf47cce-18f0-4f1f-bf32-17d8dace3f6d admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:13.515972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf47cce-18f0-4f1f-bf32-17d8dace3f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:13.516248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf47cce-18f0-4f1f-bf32-17d8dace3f6d admin admin] PATH_INFO: `/v3/projects/411cef94cd204e5b88169c364738401f/users/39b6d526c1ea44ca80461de0768fd961/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:13.531198 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf47cce-18f0-4f1f-bf32-17d8dace3f6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=411cef94cd204e5b88169c364738401f, user_id=39b6d526c1ea44ca80461de0768fd961, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:13.533940 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf47cce-18f0-4f1f-bf32-17d8dace3f6d admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:13.548198 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1097/2187] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:13 2022] PUT /identity/v3/projects/411cef94cd204e5b88169c364738401f/users/39b6d526c1ea44ca80461de0768fd961/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:13.558162 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5feed-9e6e-42d1-8c87-b2f3f0238ef5 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:13.558488 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5feed-9e6e-42d1-8c87-b2f3f0238ef5 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:13.558765 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d5feed-9e6e-42d1-8c87-b2f3f0238ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:13.584862 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-97d5feed-9e6e-42d1-8c87-b2f3f0238ef5 None None] MFA Rules not processed for user `39b6d526c1ea44ca80461de0768fd961`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:13.586079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-97d5feed-9e6e-42d1-8c87-b2f3f0238ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:13.651463 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1091/2188] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:13.663511 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf47cce-18f0-4f1f-bf32-17d8dace3f6d admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:13.665254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-4bf47cce-18f0-4f1f-bf32-17d8dace3f6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:13.706683 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:13.723233 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf47cce-18f0-4f1f-bf32-17d8dace3f6d admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:13.726895 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ce708-702f-4577-8e73-dcf27b09bffd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:13.727540 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ce708-702f-4577-8e73-dcf27b09bffd service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:13.727856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ce708-702f-4577-8e73-dcf27b09bffd service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:13.728139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2ce708-702f-4577-8e73-dcf27b09bffd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:13.736686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ce708-702f-4577-8e73-dcf27b09bffd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:13.738056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2ce708-702f-4577-8e73-dcf27b09bffd service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:13.747152 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1098/2189] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:19.430206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5feed-9e6e-42d1-8c87-b2f3f0238ef5 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:19.495473 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d5feed-9e6e-42d1-8c87-b2f3f0238ef5 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:19.501242 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11091387-291c-46dd-8127-5dd031752397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:19.502410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11091387-291c-46dd-8127-5dd031752397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:19.502648 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11091387-291c-46dd-8127-5dd031752397 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:19.503006 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11091387-291c-46dd-8127-5dd031752397 admin admin] PATH_INFO: `/v3/users/39b6d526c1ea44ca80461de0768fd961` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:19.504232 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11091387-291c-46dd-8127-5dd031752397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39b6d526c1ea44ca80461de0768fd961)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:19.506227 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11091387-291c-46dd-8127-5dd031752397 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:19.541273 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:19.573734 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-11091387-291c-46dd-8127-5dd031752397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39b6d526c1ea44ca80461de0768fd961'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:19.583110 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ce708-702f-4577-8e73-dcf27b09bffd service cinder] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:19.584677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-1a2ce708-702f-4577-8e73-dcf27b09bffd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:19.587041 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-11091387-291c-46dd-8127-5dd031752397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39b6d526c1ea44ca80461de0768fd961'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:19.587987 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-11091387-291c-46dd-8127-5dd031752397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39b6d526c1ea44ca80461de0768fd961'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:19.604853 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2ce708-702f-4577-8e73-dcf27b09bffd service cinder] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:19.605052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-11091387-291c-46dd-8127-5dd031752397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39b6d526c1ea44ca80461de0768fd961'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:19.605724 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-11091387-291c-46dd-8127-5dd031752397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39b6d526c1ea44ca80461de0768fd961'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:19.609678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77ddb58-e84b-4845-a352-df924adadcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:19.610569 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ddb58-e84b-4845-a352-df924adadcc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:19.610853 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ddb58-e84b-4845-a352-df924adadcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:19.611130 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77ddb58-e84b-4845-a352-df924adadcc0 admin admin] PATH_INFO: `/v3/users/586d60dc66a446839a0986fdde1a83bd` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:19.612329 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ddb58-e84b-4845-a352-df924adadcc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=586d60dc66a446839a0986fdde1a83bd)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:19.614257 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77ddb58-e84b-4845-a352-df924adadcc0 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:19.618716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1092/2190] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:19 2022] DELETE /identity/v3/users/39b6d526c1ea44ca80461de0768fd961 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:19.623877 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3584d3-e165-4d16-b93a-81dff13cc207 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:19.624170 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3584d3-e165-4d16-b93a-81dff13cc207 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:19.624454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3584d3-e165-4d16-b93a-81dff13cc207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:19.643317 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-8a3584d3-e165-4d16-b93a-81dff13cc207 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:19.644617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-8a3584d3-e165-4d16-b93a-81dff13cc207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:19.663509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-e77ddb58-e84b-4845-a352-df924adadcc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '586d60dc66a446839a0986fdde1a83bd'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:19.671656 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-e77ddb58-e84b-4845-a352-df924adadcc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '586d60dc66a446839a0986fdde1a83bd'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:19.672279 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-e77ddb58-e84b-4845-a352-df924adadcc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '586d60dc66a446839a0986fdde1a83bd'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:19.672889 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-e77ddb58-e84b-4845-a352-df924adadcc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '586d60dc66a446839a0986fdde1a83bd'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:19.690694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-e77ddb58-e84b-4845-a352-df924adadcc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '586d60dc66a446839a0986fdde1a83bd'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:19.707100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1099/2191] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:19 2022] DELETE /identity/v3/users/586d60dc66a446839a0986fdde1a83bd => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:19.711346 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7d90c-04e0-4e90-82c0-884bd8b92491 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:19.711559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7d90c-04e0-4e90-82c0-884bd8b92491 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:19.711891 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7d90c-04e0-4e90-82c0-884bd8b92491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:19.712687 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1093/2192] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:19.725078 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3584d3-e165-4d16-b93a-81dff13cc207 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:19.726721 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-8a3584d3-e165-4d16-b93a-81dff13cc207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:19.731681 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-a5c7d90c-04e0-4e90-82c0-884bd8b92491 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:19.733056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-a5c7d90c-04e0-4e90-82c0-884bd8b92491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:19.807214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3584d3-e165-4d16-b93a-81dff13cc207 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:19.814986 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1100/2193] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:19.821499 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7d90c-04e0-4e90-82c0-884bd8b92491 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:19.880207 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7124ecd-3ffd-47ff-b65b-aa9a22ab749b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:19.880981 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7124ecd-3ffd-47ff-b65b-aa9a22ab749b service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:19.881519 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7124ecd-3ffd-47ff-b65b-aa9a22ab749b service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:19.881987 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7124ecd-3ffd-47ff-b65b-aa9a22ab749b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:19.895065 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7d90c-04e0-4e90-82c0-884bd8b92491 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:19.895510 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7124ecd-3ffd-47ff-b65b-aa9a22ab749b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:19.897139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7124ecd-3ffd-47ff-b65b-aa9a22ab749b service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:19.898992 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ead9087-5ca2-4061-8b1f-22e7562f965e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:19.899841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead9087-5ca2-4061-8b1f-22e7562f965e service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:19.900126 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead9087-5ca2-4061-8b1f-22e7562f965e service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:19.900419 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ead9087-5ca2-4061-8b1f-22e7562f965e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:19.910403 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:19.912251 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1094/2194] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:19.915393 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead9087-5ca2-4061-8b1f-22e7562f965e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:19.918345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ead9087-5ca2-4061-8b1f-22e7562f965e service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:19.938053 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1101/2195] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:20.706404 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7124ecd-3ffd-47ff-b65b-aa9a22ab749b service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:20.708100 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a7124ecd-3ffd-47ff-b65b-aa9a22ab749b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:20.741677 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7124ecd-3ffd-47ff-b65b-aa9a22ab749b service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:20.751311 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbf0f9-0a82-4483-976b-9ca26572d79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:20.752319 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbf0f9-0a82-4483-976b-9ca26572d79a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:20.752747 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbf0f9-0a82-4483-976b-9ca26572d79a admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:20.753208 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abbf0f9-0a82-4483-976b-9ca26572d79a admin admin] PATH_INFO: `/v3/projects/b01305a871c849749017572e52a744ee` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:20.754700 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbf0f9-0a82-4483-976b-9ca26572d79a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b01305a871c849749017572e52a744ee)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:20.756805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abbf0f9-0a82-4483-976b-9ca26572d79a admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:20.758978 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:20.844911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2abbf0f9-0a82-4483-976b-9ca26572d79a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b01305a871c849749017572e52a744ee', 'request_id': 'req-2abbf0f9-0a82-4483-976b-9ca26572d79a'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:20.852776 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2abbf0f9-0a82-4483-976b-9ca26572d79a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b01305a871c849749017572e52a744ee', 'request_id': 'req-2abbf0f9-0a82-4483-976b-9ca26572d79a'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:20.860571 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2abbf0f9-0a82-4483-976b-9ca26572d79a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b01305a871c849749017572e52a744ee', 'request_id': 'req-2abbf0f9-0a82-4483-976b-9ca26572d79a'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:20.874323 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2abbf0f9-0a82-4483-976b-9ca26572d79a admin admin] The token cache is being invalidate because project b01305a871c849749017572e52a744ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:20.874616 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2abbf0f9-0a82-4483-976b-9ca26572d79a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:20.875581 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2abbf0f9-0a82-4483-976b-9ca26572d79a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:20.877172 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1095/2196] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:20 2022] DELETE /identity/v3/projects/b01305a871c849749017572e52a744ee => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:20.882251 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b428f-772e-47a7-8166-4e7cd90adf37 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:20.882724 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b428f-772e-47a7-8166-4e7cd90adf37 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:20.882841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b428f-772e-47a7-8166-4e7cd90adf37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:20.904672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-ba6b428f-772e-47a7-8166-4e7cd90adf37 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:20.905971 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-ba6b428f-772e-47a7-8166-4e7cd90adf37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:20.931663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbf0f9-0a82-4483-976b-9ca26572d79a admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:20.934639 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-2abbf0f9-0a82-4483-976b-9ca26572d79a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:21.068365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abbf0f9-0a82-4483-976b-9ca26572d79a admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:21.074601 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67497a08-6cc3-43a1-8aa0-87a8251de3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:21.076049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67497a08-6cc3-43a1-8aa0-87a8251de3bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.076417 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67497a08-6cc3-43a1-8aa0-87a8251de3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:21.076768 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67497a08-6cc3-43a1-8aa0-87a8251de3bd admin admin] PATH_INFO: `/v3/projects/411cef94cd204e5b88169c364738401f` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:21.079166 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67497a08-6cc3-43a1-8aa0-87a8251de3bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=411cef94cd204e5b88169c364738401f)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:21.081236 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67497a08-6cc3-43a1-8aa0-87a8251de3bd admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:21.088782 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1102/2197] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:21.099304 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5350a5d-74f9-4e85-a78a-c77401dd1d1d None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.099737 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5350a5d-74f9-4e85-a78a-c77401dd1d1d None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:21.100022 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5350a5d-74f9-4e85-a78a-c77401dd1d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:21.154355 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-b5350a5d-74f9-4e85-a78a-c77401dd1d1d None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:21.155668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-b5350a5d-74f9-4e85-a78a-c77401dd1d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:21.170530 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1103/2198] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:21.171435 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5350a5d-74f9-4e85-a78a-c77401dd1d1d None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:21.173384 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-b5350a5d-74f9-4e85-a78a-c77401dd1d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:21.186721 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5350a5d-74f9-4e85-a78a-c77401dd1d1d None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:21.187929 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-67497a08-6cc3-43a1-8aa0-87a8251de3bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '411cef94cd204e5b88169c364738401f', 'request_id': 'req-67497a08-6cc3-43a1-8aa0-87a8251de3bd'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:21.194700 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-67497a08-6cc3-43a1-8aa0-87a8251de3bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '411cef94cd204e5b88169c364738401f', 'request_id': 'req-67497a08-6cc3-43a1-8aa0-87a8251de3bd'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:21.201634 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-67497a08-6cc3-43a1-8aa0-87a8251de3bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '411cef94cd204e5b88169c364738401f', 'request_id': 'req-67497a08-6cc3-43a1-8aa0-87a8251de3bd'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:21.214952 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-67497a08-6cc3-43a1-8aa0-87a8251de3bd admin admin] The token cache is being invalidate because project 411cef94cd204e5b88169c364738401f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:21.215173 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-67497a08-6cc3-43a1-8aa0-87a8251de3bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:21.215890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-67497a08-6cc3-43a1-8aa0-87a8251de3bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:21.217697 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1096/2199] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:20 2022] DELETE /identity/v3/projects/411cef94cd204e5b88169c364738401f => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:21.218485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67497a08-6cc3-43a1-8aa0-87a8251de3bd admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:21.219840 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-67497a08-6cc3-43a1-8aa0-87a8251de3bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:21.247839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:21.263837 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2edad3e-a215-443a-afe7-c43f9d3f7689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:21.265320 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edad3e-a215-443a-afe7-c43f9d3f7689 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.265613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edad3e-a215-443a-afe7-c43f9d3f7689 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:21.265892 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2edad3e-a215-443a-afe7-c43f9d3f7689 admin admin] PATH_INFO: `/v3/users/763b9e63658d4b36a67489a030e87848` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:21.267790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edad3e-a215-443a-afe7-c43f9d3f7689 admin admin] RBAC: Authorizing `identity:delete_user(user_id=763b9e63658d4b36a67489a030e87848)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:21.270724 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2edad3e-a215-443a-afe7-c43f9d3f7689 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:21.300579 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67497a08-6cc3-43a1-8aa0-87a8251de3bd admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:21.306119 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974c34d4-6b07-4835-8362-77b7c81d5e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:21.307018 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c34d4-6b07-4835-8362-77b7c81d5e32 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.307416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c34d4-6b07-4835-8362-77b7c81d5e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:21.308110 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974c34d4-6b07-4835-8362-77b7c81d5e32 admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:21.308929 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c34d4-6b07-4835-8362-77b7c81d5e32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:28:21.309369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c34d4-6b07-4835-8362-77b7c81d5e32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:21.311143 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974c34d4-6b07-4835-8362-77b7c81d5e32 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:21.328029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1097/2200] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:28:21.328029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540137b-2976-4e87-8a56-af97189aca72 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.328029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540137b-2976-4e87-8a56-af97189aca72 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:21.328029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540137b-2976-4e87-8a56-af97189aca72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:21.346734 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-f540137b-2976-4e87-8a56-af97189aca72 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:21.348058 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-f540137b-2976-4e87-8a56-af97189aca72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:21.349147 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c2edad3e-a215-443a-afe7-c43f9d3f7689 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '763b9e63658d4b36a67489a030e87848'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:21.357593 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1098/2201] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:21.358842 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540137b-2976-4e87-8a56-af97189aca72 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:21.359418 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c2edad3e-a215-443a-afe7-c43f9d3f7689 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '763b9e63658d4b36a67489a030e87848'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:21.360201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c2edad3e-a215-443a-afe7-c43f9d3f7689 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '763b9e63658d4b36a67489a030e87848'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:21.361017 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c2edad3e-a215-443a-afe7-c43f9d3f7689 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '763b9e63658d4b36a67489a030e87848'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:21.371292 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540137b-2976-4e87-8a56-af97189aca72 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:21.378931 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99465fa-ff27-4bcb-8ae7-24a3eeaadb90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:21.379552 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99465fa-ff27-4bcb-8ae7-24a3eeaadb90 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.379952 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99465fa-ff27-4bcb-8ae7-24a3eeaadb90 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:21.380308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99465fa-ff27-4bcb-8ae7-24a3eeaadb90 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:21.381117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99465fa-ff27-4bcb-8ae7-24a3eeaadb90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:21.383383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99465fa-ff27-4bcb-8ae7-24a3eeaadb90 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:21.386503 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c2edad3e-a215-443a-afe7-c43f9d3f7689 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '763b9e63658d4b36a67489a030e87848'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:21.407532 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1104/2202] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:21 2022] DELETE /identity/v3/users/763b9e63658d4b36a67489a030e87848 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:21.409155 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04d7fe-5f81-4ff1-a0ae-ed093fb7877b None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.409515 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04d7fe-5f81-4ff1-a0ae-ed093fb7877b None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:21.409858 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04d7fe-5f81-4ff1-a0ae-ed093fb7877b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:21.414617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1099/2203] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:21 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:21.415826 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7699fb-0e9d-40a6-a48f-7ad349cd4de4 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.417372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7699fb-0e9d-40a6-a48f-7ad349cd4de4 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:21.417657 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7699fb-0e9d-40a6-a48f-7ad349cd4de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:21.430820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-7a04d7fe-5f81-4ff1-a0ae-ed093fb7877b None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:21.432148 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-7a04d7fe-5f81-4ff1-a0ae-ed093fb7877b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:21.438120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:21.442338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-8a7699fb-0e9d-40a6-a48f-7ad349cd4de4 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:21.443662 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-8a7699fb-0e9d-40a6-a48f-7ad349cd4de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:21.512944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1105/2204] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:21.513994 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04d7fe-5f81-4ff1-a0ae-ed093fb7877b None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:21.515578 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-7a04d7fe-5f81-4ff1-a0ae-ed093fb7877b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:21.518918 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1100/2205] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:21.522131 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7699fb-0e9d-40a6-a48f-7ad349cd4de4 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:21.529321 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04d7fe-5f81-4ff1-a0ae-ed093fb7877b None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:21.529958 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7699fb-0e9d-40a6-a48f-7ad349cd4de4 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:21.534483 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a8df6-a2da-402e-a14e-8b2bda2cc832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:21.534705 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9505e-3089-47fc-99e2-18e71b769587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:21.535301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a8df6-a2da-402e-a14e-8b2bda2cc832 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.535423 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9505e-3089-47fc-99e2-18e71b769587 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.535642 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9505e-3089-47fc-99e2-18e71b769587 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:21.535841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a8df6-a2da-402e-a14e-8b2bda2cc832 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:21.535919 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd9505e-3089-47fc-99e2-18e71b769587 admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:21.536236 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36a8df6-a2da-402e-a14e-8b2bda2cc832 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:21.536637 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9505e-3089-47fc-99e2-18e71b769587 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:28:21.537032 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a8df6-a2da-402e-a14e-8b2bda2cc832 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:21.537133 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9505e-3089-47fc-99e2-18e71b769587 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:21.538691 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd9505e-3089-47fc-99e2-18e71b769587 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:21.539128 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36a8df6-a2da-402e-a14e-8b2bda2cc832 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:21.551999 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1101/2206] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:28:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:28:21.552816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9505e-3089-47fc-99e2-18e71b769587 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:21.555021 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-dbd9505e-3089-47fc-99e2-18e71b769587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:21.561604 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1106/2207] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:21 2022] POST /identity/v3/users => generated 292 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:21.562529 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a8df6-a2da-402e-a14e-8b2bda2cc832 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:21.572100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36a8df6-a2da-402e-a14e-8b2bda2cc832 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:21.577916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2c875-83ef-4876-a676-e66ea647710c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:21.578845 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2c875-83ef-4876-a676-e66ea647710c admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.579136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2c875-83ef-4876-a676-e66ea647710c admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:21.579412 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f2c875-83ef-4876-a676-e66ea647710c admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:21.580190 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2c875-83ef-4876-a676-e66ea647710c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:21.582528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f2c875-83ef-4876-a676-e66ea647710c admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:21.614957 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1107/2208] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:21 2022] POST /identity/v3/projects => generated 397 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:21.614957 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2c875-83ef-4876-a676-e66ea647710c admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:21.615679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd9505e-3089-47fc-99e2-18e71b769587 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:21.645179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:21.671341 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccc58b-6aef-44f3-8930-e555ee38646d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:21.672037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccc58b-6aef-44f3-8930-e555ee38646d service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.672328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccc58b-6aef-44f3-8930-e555ee38646d service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:21.672613 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ccc58b-6aef-44f3-8930-e555ee38646d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:21.678723 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f2c875-83ef-4876-a676-e66ea647710c admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:21.683774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ccc58b-6aef-44f3-8930-e555ee38646d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:21.684587 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528f9e9-f6b6-43aa-a648-c6f3956f26a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:21.685254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528f9e9-f6b6-43aa-a648-c6f3956f26a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.685555 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528f9e9-f6b6-43aa-a648-c6f3956f26a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:21.685841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4528f9e9-f6b6-43aa-a648-c6f3956f26a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:21.686348 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ccc58b-6aef-44f3-8930-e555ee38646d service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:21.686647 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528f9e9-f6b6-43aa-a648-c6f3956f26a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:21.688334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4528f9e9-f6b6-43aa-a648-c6f3956f26a5 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:21.698112 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1102/2209] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:21.699272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccc58b-6aef-44f3-8930-e555ee38646d service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:21.709145 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1108/2210] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:21.709499 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ccc58b-6aef-44f3-8930-e555ee38646d service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:21.713121 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528f9e9-f6b6-43aa-a648-c6f3956f26a5 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:21.714606 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e276aa-ca0a-4da8-a35c-9f676a6f0001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:21.715283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e276aa-ca0a-4da8-a35c-9f676a6f0001 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.715573 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e276aa-ca0a-4da8-a35c-9f676a6f0001 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:21.716005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e276aa-ca0a-4da8-a35c-9f676a6f0001 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:21.716705 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e276aa-ca0a-4da8-a35c-9f676a6f0001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:21.718651 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e276aa-ca0a-4da8-a35c-9f676a6f0001 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:21.727004 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4528f9e9-f6b6-43aa-a648-c6f3956f26a5 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:21.733705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ccda4-45bb-4727-a231-16bf289b70e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:21.734732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ccda4-45bb-4727-a231-16bf289b70e2 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.735279 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ccda4-45bb-4727-a231-16bf289b70e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:21.735758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9ccda4-45bb-4727-a231-16bf289b70e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:21.736661 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ccda4-45bb-4727-a231-16bf289b70e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:21.738735 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9ccda4-45bb-4727-a231-16bf289b70e2 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:21.745859 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1103/2211] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:21 2022] POST /identity/v3/users => generated 299 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:21.749935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e276aa-ca0a-4da8-a35c-9f676a6f0001 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:21.753499 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1109/2212] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:21.757343 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ccda4-45bb-4727-a231-16bf289b70e2 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:21.768810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9ccda4-45bb-4727-a231-16bf289b70e2 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:21.774706 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0883d708-bbb7-4ea1-92c2-38c71d3fcdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:21.776376 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883d708-bbb7-4ea1-92c2-38c71d3fcdee admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.777015 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883d708-bbb7-4ea1-92c2-38c71d3fcdee admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:21.777511 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0883d708-bbb7-4ea1-92c2-38c71d3fcdee admin admin] PATH_INFO: `/v3/projects/4b5ec212032a46aab16a55fde900c916/users/ac127f66bf2b4432acd34132911d7c0c/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:21.782185 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e276aa-ca0a-4da8-a35c-9f676a6f0001 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:21.803234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883d708-bbb7-4ea1-92c2-38c71d3fcdee admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5ec212032a46aab16a55fde900c916, user_id=ac127f66bf2b4432acd34132911d7c0c, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:21.804371 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180c35f-33e5-4055-94d2-b1e99d71b719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:21.805065 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180c35f-33e5-4055-94d2-b1e99d71b719 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.805353 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180c35f-33e5-4055-94d2-b1e99d71b719 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:21.805630 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c180c35f-33e5-4055-94d2-b1e99d71b719 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:21.806373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180c35f-33e5-4055-94d2-b1e99d71b719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:21.806487 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0883d708-bbb7-4ea1-92c2-38c71d3fcdee admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:21.808588 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c180c35f-33e5-4055-94d2-b1e99d71b719 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:21.823875 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1104/2213] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:28:21.824786 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180c35f-33e5-4055-94d2-b1e99d71b719 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:21.826724 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1110/2214] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:21 2022] PUT /identity/v3/projects/4b5ec212032a46aab16a55fde900c916/users/ac127f66bf2b4432acd34132911d7c0c/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:21.832909 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4829c81-7703-47cf-95fe-7efc3a28c594 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.833526 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4829c81-7703-47cf-95fe-7efc3a28c594 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:21.834988 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4829c81-7703-47cf-95fe-7efc3a28c594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:21.839731 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c180c35f-33e5-4055-94d2-b1e99d71b719 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:21.862705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-e4829c81-7703-47cf-95fe-7efc3a28c594 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:21.867746 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-e4829c81-7703-47cf-95fe-7efc3a28c594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:21.907120 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46f790-8f59-4ba8-87be-001af10959f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:21.907870 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46f790-8f59-4ba8-87be-001af10959f8 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.908202 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46f790-8f59-4ba8-87be-001af10959f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:21.908497 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e46f790-8f59-4ba8-87be-001af10959f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:21.909326 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46f790-8f59-4ba8-87be-001af10959f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:21.911099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e46f790-8f59-4ba8-87be-001af10959f8 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:21.922697 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1105/2215] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:21 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:21.927168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46f790-8f59-4ba8-87be-001af10959f8 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:21.937862 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:21.940272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e46f790-8f59-4ba8-87be-001af10959f8 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:21.947540 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca5834-ad7a-410d-906e-f6e8514c8f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:21.948510 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca5834-ad7a-410d-906e-f6e8514c8f2f admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.948884 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca5834-ad7a-410d-906e-f6e8514c8f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:21.949099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca5834-ad7a-410d-906e-f6e8514c8f2f admin admin] PATH_INFO: `/v3/projects/c4e625c0d59642829a38ac2e4e6acf07/users/2d420af661654431947b616a9d3ba75c/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:21.969348 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca5834-ad7a-410d-906e-f6e8514c8f2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4e625c0d59642829a38ac2e4e6acf07, user_id=2d420af661654431947b616a9d3ba75c, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:21.972299 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca5834-ad7a-410d-906e-f6e8514c8f2f admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:21.989689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1106/2216] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:21 2022] PUT /identity/v3/projects/c4e625c0d59642829a38ac2e4e6acf07/users/2d420af661654431947b616a9d3ba75c/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:21.999593 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ad5d6-f7ab-466f-80e1-a8c80890fd96 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:21.999909 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ad5d6-f7ab-466f-80e1-a8c80890fd96 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:22.000188 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ad5d6-f7ab-466f-80e1-a8c80890fd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:22.014606 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1111/2217] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:22.028719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4829c81-7703-47cf-95fe-7efc3a28c594 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:22.030273 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-e4829c81-7703-47cf-95fe-7efc3a28c594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:22.037085 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-af0ad5d6-f7ab-466f-80e1-a8c80890fd96 None None] MFA Rules not processed for user `2d420af661654431947b616a9d3ba75c`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:22.039008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-af0ad5d6-f7ab-466f-80e1-a8c80890fd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:22.117745 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4829c81-7703-47cf-95fe-7efc3a28c594 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:22.124603 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1107/2218] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:22.138727 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ad5d6-f7ab-466f-80e1-a8c80890fd96 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:22.140401 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-af0ad5d6-f7ab-466f-80e1-a8c80890fd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:22.151368 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:22.248880 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea876478-43bb-4f40-bdb3-94a1cc9510bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:22.248880 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea876478-43bb-4f40-bdb3-94a1cc9510bd service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:22.248880 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea876478-43bb-4f40-bdb3-94a1cc9510bd service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:22.248880 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea876478-43bb-4f40-bdb3-94a1cc9510bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:22.268715 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ad5d6-f7ab-466f-80e1-a8c80890fd96 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:22.275191 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f6267-e2aa-4b80-b540-d6d36afc65ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:22.277401 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f6267-e2aa-4b80-b540-d6d36afc65ae service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:22.277846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f6267-e2aa-4b80-b540-d6d36afc65ae service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:22.278286 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196f6267-e2aa-4b80-b540-d6d36afc65ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:22.292974 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f6267-e2aa-4b80-b540-d6d36afc65ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:22.294901 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196f6267-e2aa-4b80-b540-d6d36afc65ae service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:22.311831 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1108/2219] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:22 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:28:22.355159 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea876478-43bb-4f40-bdb3-94a1cc9510bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:22.357326 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea876478-43bb-4f40-bdb3-94a1cc9510bd service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:22.381750 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1112/2220] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:28:22.506822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f6267-e2aa-4b80-b540-d6d36afc65ae service cinder] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:22.508751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-196f6267-e2aa-4b80-b540-d6d36afc65ae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:22.555111 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196f6267-e2aa-4b80-b540-d6d36afc65ae service cinder] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:22.570720 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979d0ba-8de2-44f7-bba6-c1a0b98c01b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:22.572222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979d0ba-8de2-44f7-bba6-c1a0b98c01b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:22.572605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979d0ba-8de2-44f7-bba6-c1a0b98c01b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:22.573011 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979d0ba-8de2-44f7-bba6-c1a0b98c01b6 admin admin] PATH_INFO: `/v3/projects/0bf310a227fb43f68ff7687717a85a20` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:22.577608 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979d0ba-8de2-44f7-bba6-c1a0b98c01b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bf310a227fb43f68ff7687717a85a20)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:22.579923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979d0ba-8de2-44f7-bba6-c1a0b98c01b6 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:22.656386 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-5979d0ba-8de2-44f7-bba6-c1a0b98c01b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bf310a227fb43f68ff7687717a85a20', 'request_id': 'req-5979d0ba-8de2-44f7-bba6-c1a0b98c01b6'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:22.663392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-5979d0ba-8de2-44f7-bba6-c1a0b98c01b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bf310a227fb43f68ff7687717a85a20', 'request_id': 'req-5979d0ba-8de2-44f7-bba6-c1a0b98c01b6'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:22.671369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-5979d0ba-8de2-44f7-bba6-c1a0b98c01b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bf310a227fb43f68ff7687717a85a20', 'request_id': 'req-5979d0ba-8de2-44f7-bba6-c1a0b98c01b6'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:22.709710 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-5979d0ba-8de2-44f7-bba6-c1a0b98c01b6 admin admin] The token cache is being invalidate because project 0bf310a227fb43f68ff7687717a85a20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:22.711550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-5979d0ba-8de2-44f7-bba6-c1a0b98c01b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:22.712754 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-5979d0ba-8de2-44f7-bba6-c1a0b98c01b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:22.722274 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1109/2221] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:22 2022] DELETE /identity/v3/projects/0bf310a227fb43f68ff7687717a85a20 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:22.724046 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab45bd9-4a8b-4b5b-9bd5-c2e8e2417e97 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:22.724443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab45bd9-4a8b-4b5b-9bd5-c2e8e2417e97 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:22.724729 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab45bd9-4a8b-4b5b-9bd5-c2e8e2417e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:22.753599 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-aab45bd9-4a8b-4b5b-9bd5-c2e8e2417e97 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:22.755651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-aab45bd9-4a8b-4b5b-9bd5-c2e8e2417e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:22.810062 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:22.850418 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1113/2222] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:22.860217 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706ad9d-0833-4eae-9ca6-fd35ce45b08a None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:22.860498 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706ad9d-0833-4eae-9ca6-fd35ce45b08a None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:22.860781 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706ad9d-0833-4eae-9ca6-fd35ce45b08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:22.885063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-5706ad9d-0833-4eae-9ca6-fd35ce45b08a None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:22.886566 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-5706ad9d-0833-4eae-9ca6-fd35ce45b08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:22.900769 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab45bd9-4a8b-4b5b-9bd5-c2e8e2417e97 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:22.902326 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1110/2223] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:22.913279 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab45bd9-4a8b-4b5b-9bd5-c2e8e2417e97 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:22.943980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf5ac7-d104-44ba-b060-362bc18545bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:22.945374 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf5ac7-d104-44ba-b060-362bc18545bc admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:22.945374 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf5ac7-d104-44ba-b060-362bc18545bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:22.945781 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaf5ac7-d104-44ba-b060-362bc18545bc admin admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:22.947200 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf5ac7-d104-44ba-b060-362bc18545bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:28:22.947823 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf5ac7-d104-44ba-b060-362bc18545bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:22.950342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaf5ac7-d104-44ba-b060-362bc18545bc admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:23.004043 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1114/2224] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:28:23.008763 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706ad9d-0833-4eae-9ca6-fd35ce45b08a None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:23.024162 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5706ad9d-0833-4eae-9ca6-fd35ce45b08a None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:23.038490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82afe8-8e9b-4409-8d4f-01a9bd87a99a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:23.039176 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82afe8-8e9b-4409-8d4f-01a9bd87a99a admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:23.041283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82afe8-8e9b-4409-8d4f-01a9bd87a99a admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:23.041600 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da82afe8-8e9b-4409-8d4f-01a9bd87a99a admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:23.045519 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82afe8-8e9b-4409-8d4f-01a9bd87a99a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:23.060856 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da82afe8-8e9b-4409-8d4f-01a9bd87a99a admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:23.095646 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1111/2225] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:23 2022] POST /identity/v3/projects => generated 377 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:23.099858 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf5ac7-d104-44ba-b060-362bc18545bc admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:23.112175 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaf5ac7-d104-44ba-b060-362bc18545bc admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:23.182147 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e64359-967f-4ae5-bed8-c0b7d5e594ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:23.182923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e64359-967f-4ae5-bed8-c0b7d5e594ed admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:23.183280 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e64359-967f-4ae5-bed8-c0b7d5e594ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:23.183572 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e64359-967f-4ae5-bed8-c0b7d5e594ed admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:23.184667 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e64359-967f-4ae5-bed8-c0b7d5e594ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:23.187147 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e64359-967f-4ae5-bed8-c0b7d5e594ed admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:23.212043 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1115/2226] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:23 2022] POST /identity/v3/users => generated 289 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:23.216628 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82afe8-8e9b-4409-8d4f-01a9bd87a99a admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:23.227286 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da82afe8-8e9b-4409-8d4f-01a9bd87a99a admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:23.232471 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f6cf4-84fd-4d1f-a61f-598eb60ac7a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:23.233356 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f6cf4-84fd-4d1f-a61f-598eb60ac7a5 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:23.233643 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f6cf4-84fd-4d1f-a61f-598eb60ac7a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:23.233923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6f6cf4-84fd-4d1f-a61f-598eb60ac7a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:23.234654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f6cf4-84fd-4d1f-a61f-598eb60ac7a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:23.236356 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6f6cf4-84fd-4d1f-a61f-598eb60ac7a5 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:23.249306 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1112/2227] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:28:23.253156 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e64359-967f-4ae5-bed8-c0b7d5e594ed admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:23.264159 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e64359-967f-4ae5-bed8-c0b7d5e594ed admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:23.269543 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac79082-feaa-4416-82d5-d5600ab699eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:23.270209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac79082-feaa-4416-82d5-d5600ab699eb admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:23.270490 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac79082-feaa-4416-82d5-d5600ab699eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:23.270765 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac79082-feaa-4416-82d5-d5600ab699eb admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:23.271504 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac79082-feaa-4416-82d5-d5600ab699eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:23.273256 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac79082-feaa-4416-82d5-d5600ab699eb admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:23.284749 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1116/2228] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:23.288640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f6cf4-84fd-4d1f-a61f-598eb60ac7a5 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:23.298949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6f6cf4-84fd-4d1f-a61f-598eb60ac7a5 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:23.303753 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da58ba-9421-4ea7-b864-086b6d1f466b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:23.304642 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da58ba-9421-4ea7-b864-086b6d1f466b admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:23.304930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da58ba-9421-4ea7-b864-086b6d1f466b admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:23.305210 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da58ba-9421-4ea7-b864-086b6d1f466b admin admin] PATH_INFO: `/v3/projects/3a7a44c59db24e36a4b19c7ea6f9b7a0/users/d276ac3e9f024259998d60cff871bd2c/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:23.321430 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da58ba-9421-4ea7-b864-086b6d1f466b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a7a44c59db24e36a4b19c7ea6f9b7a0, user_id=d276ac3e9f024259998d60cff871bd2c, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:23.324749 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da58ba-9421-4ea7-b864-086b6d1f466b admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:23.339267 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1113/2229] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:23 2022] PUT /identity/v3/projects/3a7a44c59db24e36a4b19c7ea6f9b7a0/users/d276ac3e9f024259998d60cff871bd2c/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:23.349392 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468cd3a-22ab-49f4-8038-8d1cf01ae61f None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:23.349687 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468cd3a-22ab-49f4-8038-8d1cf01ae61f None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:23.349975 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9468cd3a-22ab-49f4-8038-8d1cf01ae61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:23.380241 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-9468cd3a-22ab-49f4-8038-8d1cf01ae61f None None] MFA Rules not processed for user `d276ac3e9f024259998d60cff871bd2c`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:23.381521 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-9468cd3a-22ab-49f4-8038-8d1cf01ae61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:23.454749 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1117/2230] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:23 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:23.459095 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da58ba-9421-4ea7-b864-086b6d1f466b admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:23.490263 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:23.530994 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da58ba-9421-4ea7-b864-086b6d1f466b admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:23.538237 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c3b9d-a3d5-47c9-8b7c-e41d1047c84a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:23.538237 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c3b9d-a3d5-47c9-8b7c-e41d1047c84a admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:23.538237 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c3b9d-a3d5-47c9-8b7c-e41d1047c84a admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:23.538237 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c3b9d-a3d5-47c9-8b7c-e41d1047c84a admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:23.538840 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c3b9d-a3d5-47c9-8b7c-e41d1047c84a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:23.540744 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25c3b9d-a3d5-47c9-8b7c-e41d1047c84a admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:23.573765 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1114/2231] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:23 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:23.578027 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468cd3a-22ab-49f4-8038-8d1cf01ae61f None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:23.589626 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9468cd3a-22ab-49f4-8038-8d1cf01ae61f None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:23.624710 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:23.656692 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78b397-a3da-4852-979b-4aec35007ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:23.657400 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78b397-a3da-4852-979b-4aec35007ca7 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:23.657693 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78b397-a3da-4852-979b-4aec35007ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:23.658106 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f78b397-a3da-4852-979b-4aec35007ca7 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:23.658788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78b397-a3da-4852-979b-4aec35007ca7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:23.661142 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f78b397-a3da-4852-979b-4aec35007ca7 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:23.681646 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1118/2232] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:23 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:23.686121 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c3b9d-a3d5-47c9-8b7c-e41d1047c84a admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:23.697138 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c3b9d-a3d5-47c9-8b7c-e41d1047c84a admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:23.702975 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df836a33-2c24-4fac-bdda-4750b9729a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:23.704025 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df836a33-2c24-4fac-bdda-4750b9729a1c admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:23.704338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df836a33-2c24-4fac-bdda-4750b9729a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:23.704603 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df836a33-2c24-4fac-bdda-4750b9729a1c admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:23.705341 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df836a33-2c24-4fac-bdda-4750b9729a1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:23.707056 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df836a33-2c24-4fac-bdda-4750b9729a1c admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:23.718378 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1115/2233] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:28:23.722586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78b397-a3da-4852-979b-4aec35007ca7 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:23.733166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f78b397-a3da-4852-979b-4aec35007ca7 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:23.738238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16465ee-d971-4960-8824-4d9a115ed9d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:23.738918 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16465ee-d971-4960-8824-4d9a115ed9d1 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:23.739220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16465ee-d971-4960-8824-4d9a115ed9d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:23.739527 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16465ee-d971-4960-8824-4d9a115ed9d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:23.740313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16465ee-d971-4960-8824-4d9a115ed9d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:23.742000 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16465ee-d971-4960-8824-4d9a115ed9d1 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:23.753356 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1119/2234] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:28:23.757495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df836a33-2c24-4fac-bdda-4750b9729a1c admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:23.769308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df836a33-2c24-4fac-bdda-4750b9729a1c admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:23.774749 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46066f9f-0f31-4f71-92f4-c7f88e221c8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:23.775579 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46066f9f-0f31-4f71-92f4-c7f88e221c8d admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:23.775893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46066f9f-0f31-4f71-92f4-c7f88e221c8d admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:23.776170 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46066f9f-0f31-4f71-92f4-c7f88e221c8d admin admin] PATH_INFO: `/v3/projects/f3727b32640b42a2b10d3714891b733c/users/753677d3a6df423b9e61fd3849c2ebd8/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:23.793085 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46066f9f-0f31-4f71-92f4-c7f88e221c8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3727b32640b42a2b10d3714891b733c, user_id=753677d3a6df423b9e61fd3849c2ebd8, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:23.798547 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46066f9f-0f31-4f71-92f4-c7f88e221c8d admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:23.814383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1116/2235] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:23 2022] PUT /identity/v3/projects/f3727b32640b42a2b10d3714891b733c/users/753677d3a6df423b9e61fd3849c2ebd8/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:23.829600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b864c05-5654-44e5-8900-4a414f1d509f None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:23.829971 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b864c05-5654-44e5-8900-4a414f1d509f None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:23.830335 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b864c05-5654-44e5-8900-4a414f1d509f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:23.872763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-0b864c05-5654-44e5-8900-4a414f1d509f None None] MFA Rules not processed for user `753677d3a6df423b9e61fd3849c2ebd8`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:23.875161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-0b864c05-5654-44e5-8900-4a414f1d509f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:23.962861 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1120/2236] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:23.967138 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46066f9f-0f31-4f71-92f4-c7f88e221c8d admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:24.061015 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46066f9f-0f31-4f71-92f4-c7f88e221c8d admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:24.070837 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c517aec-d532-455c-8fc6-256db8191aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:24.071554 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c517aec-d532-455c-8fc6-256db8191aeb admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:24.071829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c517aec-d532-455c-8fc6-256db8191aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:24.072106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c517aec-d532-455c-8fc6-256db8191aeb admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:24.072823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c517aec-d532-455c-8fc6-256db8191aeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:24.074809 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c517aec-d532-455c-8fc6-256db8191aeb admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:24.124511 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1117/2237] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:23 2022] POST /identity/v3/projects => generated 377 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:24.128637 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b864c05-5654-44e5-8900-4a414f1d509f None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:24.147871 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b864c05-5654-44e5-8900-4a414f1d509f None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:24.247554 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b8e0e-55d3-45db-9510-78ac738a9d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:24.249440 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b8e0e-55d3-45db-9510-78ac738a9d4c admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:24.249955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b8e0e-55d3-45db-9510-78ac738a9d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:24.250550 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b8e0e-55d3-45db-9510-78ac738a9d4c admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:24.251625 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b8e0e-55d3-45db-9510-78ac738a9d4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:24.255014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b8e0e-55d3-45db-9510-78ac738a9d4c admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:24.283561 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1121/2238] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:24 2022] POST /identity/v3/users => generated 295 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:24.289597 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c517aec-d532-455c-8fc6-256db8191aeb admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:24.310411 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c517aec-d532-455c-8fc6-256db8191aeb admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:24.318911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee8666d-557e-4b3d-a4d3-4d2db6740e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:24.320635 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8666d-557e-4b3d-a4d3-4d2db6740e5f admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:24.321152 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8666d-557e-4b3d-a4d3-4d2db6740e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:24.321500 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee8666d-557e-4b3d-a4d3-4d2db6740e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:24.322478 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8666d-557e-4b3d-a4d3-4d2db6740e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:24.324926 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee8666d-557e-4b3d-a4d3-4d2db6740e5f admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:24.340475 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1118/2239] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:28:24.344772 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b8e0e-55d3-45db-9510-78ac738a9d4c admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:24.370287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b8e0e-55d3-45db-9510-78ac738a9d4c admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:24.384067 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054053bc-f76f-4aa5-a804-a7bf8f3515ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:24.386507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054053bc-f76f-4aa5-a804-a7bf8f3515ce admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:24.387058 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054053bc-f76f-4aa5-a804-a7bf8f3515ce admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:24.387884 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054053bc-f76f-4aa5-a804-a7bf8f3515ce admin admin] PATH_INFO: `/v3/projects/194ecad73eba4ab4a6bea6fd53599072/users/e2cdf6f80e0942ca9488c21ae1280309/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:24.409465 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94ddb5-38c7-41ad-9595-8f9ea3e250f1 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:24.409780 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94ddb5-38c7-41ad-9595-8f9ea3e250f1 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:24.410127 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94ddb5-38c7-41ad-9595-8f9ea3e250f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:24.419154 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054053bc-f76f-4aa5-a804-a7bf8f3515ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=194ecad73eba4ab4a6bea6fd53599072, user_id=e2cdf6f80e0942ca9488c21ae1280309, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:24.424901 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054053bc-f76f-4aa5-a804-a7bf8f3515ce admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:24.443231 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-1a94ddb5-38c7-41ad-9595-8f9ea3e250f1 None None] MFA Rules not processed for user `8a57c3f4e4d7479c9f301195cd9764cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:24.444514 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-1a94ddb5-38c7-41ad-9595-8f9ea3e250f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:24.445628 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1122/2240] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:24 2022] PUT /identity/v3/projects/194ecad73eba4ab4a6bea6fd53599072/users/e2cdf6f80e0942ca9488c21ae1280309/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:24.450087 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054053bc-f76f-4aa5-a804-a7bf8f3515ce admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:24.467202 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:24.512438 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:24.528593 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1119/2241] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:24.560655 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054053bc-f76f-4aa5-a804-a7bf8f3515ce admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:24.568493 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f2c619-8299-4c3d-8a3c-f2c4b2713f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:24.569739 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2c619-8299-4c3d-8a3c-f2c4b2713f57 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:24.570023 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2c619-8299-4c3d-8a3c-f2c4b2713f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:24.570270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2c619-8299-4c3d-8a3c-f2c4b2713f57 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:24.571025 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2c619-8299-4c3d-8a3c-f2c4b2713f57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:24.574073 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f2c619-8299-4c3d-8a3c-f2c4b2713f57 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:24.593713 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1123/2242] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:24 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:28:24.594711 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94ddb5-38c7-41ad-9595-8f9ea3e250f1 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:24.607685 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a94ddb5-38c7-41ad-9595-8f9ea3e250f1 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:24.619005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3c373-3c10-4f08-9cb1-0c0b23d7d111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:24.620381 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3c373-3c10-4f08-9cb1-0c0b23d7d111 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:24.620629 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3c373-3c10-4f08-9cb1-0c0b23d7d111 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:24.621176 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3c373-3c10-4f08-9cb1-0c0b23d7d111 admin admin] PATH_INFO: `/v3/projects/194ecad73eba4ab4a6bea6fd53599072/users/e2cdf6f80e0942ca9488c21ae1280309/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:24.623745 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3c373-3c10-4f08-9cb1-0c0b23d7d111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=194ecad73eba4ab4a6bea6fd53599072, user_id=e2cdf6f80e0942ca9488c21ae1280309, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:24.627177 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3c373-3c10-4f08-9cb1-0c0b23d7d111 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:24.659649 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1120/2243] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:24 2022] PUT /identity/v3/projects/194ecad73eba4ab4a6bea6fd53599072/users/e2cdf6f80e0942ca9488c21ae1280309/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:24.664885 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551d1b4-71a0-410d-908b-742867dcaaf1 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:24.665178 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551d1b4-71a0-410d-908b-742867dcaaf1 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:24.665460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a551d1b4-71a0-410d-908b-742867dcaaf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:24.706467 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-a551d1b4-71a0-410d-908b-742867dcaaf1 None None] MFA Rules not processed for user `e2cdf6f80e0942ca9488c21ae1280309`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:24.707888 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-a551d1b4-71a0-410d-908b-742867dcaaf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:24.829879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3c373-3c10-4f08-9cb1-0c0b23d7d111 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:24.832301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1124/2244] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:24 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:24.832539 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-10c3c373-3c10-4f08-9cb1-0c0b23d7d111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:24.974457 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3c373-3c10-4f08-9cb1-0c0b23d7d111 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:24.979067 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc67e3-14cd-4fa2-a35d-d5cebdb8c99d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:24.980725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc67e3-14cd-4fa2-a35d-d5cebdb8c99d service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:24.981625 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc67e3-14cd-4fa2-a35d-d5cebdb8c99d service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:24.986714 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc67e3-14cd-4fa2-a35d-d5cebdb8c99d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:25.079952 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc67e3-14cd-4fa2-a35d-d5cebdb8c99d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:25.081900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc67e3-14cd-4fa2-a35d-d5cebdb8c99d service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:25.095690 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1121/2245] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:28:28.205459 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf50c9-0e28-4b34-9953-e12f2b62cf3b None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:28.205963 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf50c9-0e28-4b34-9953-e12f2b62cf3b None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:28.206071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daf50c9-0e28-4b34-9953-e12f2b62cf3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:28.251491 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-0daf50c9-0e28-4b34-9953-e12f2b62cf3b None None] MFA Rules not processed for user `ac127f66bf2b4432acd34132911d7c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:28.253101 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-0daf50c9-0e28-4b34-9953-e12f2b62cf3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:28.360174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1125/2246] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:28.366092 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc67e3-14cd-4fa2-a35d-d5cebdb8c99d service cinder] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:28.367635 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-6cfc67e3-14cd-4fa2-a35d-d5cebdb8c99d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:28.444057 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc67e3-14cd-4fa2-a35d-d5cebdb8c99d service cinder] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:28.449655 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c75703-fcd2-4acc-894e-39b19efdb9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:28.450335 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c75703-fcd2-4acc-894e-39b19efdb9dc admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:28.450621 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c75703-fcd2-4acc-894e-39b19efdb9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:28.450899 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c75703-fcd2-4acc-894e-39b19efdb9dc admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:28.451606 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c75703-fcd2-4acc-894e-39b19efdb9dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:28.458033 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c75703-fcd2-4acc-894e-39b19efdb9dc admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:28.515935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1122/2247] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:28 2022] POST /identity/v3/projects => generated 383 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:28.520054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf50c9-0e28-4b34-9953-e12f2b62cf3b None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:28.536741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daf50c9-0e28-4b34-9953-e12f2b62cf3b None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:28.551034 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:28.602580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3eb4ba-46df-4908-9906-b6e703ab86a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:28.603384 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3eb4ba-46df-4908-9906-b6e703ab86a2 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:28.603796 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3eb4ba-46df-4908-9906-b6e703ab86a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:28.604177 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3eb4ba-46df-4908-9906-b6e703ab86a2 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:28.605023 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3eb4ba-46df-4908-9906-b6e703ab86a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:28.607070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3eb4ba-46df-4908-9906-b6e703ab86a2 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:28.630527 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1126/2248] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:28 2022] POST /identity/v3/users => generated 298 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:28.635143 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c75703-fcd2-4acc-894e-39b19efdb9dc admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:28.646936 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c75703-fcd2-4acc-894e-39b19efdb9dc admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:28.652408 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9000a0-6de2-4e99-9670-cbed49e4c986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:28.653316 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9000a0-6de2-4e99-9670-cbed49e4c986 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:28.653729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9000a0-6de2-4e99-9670-cbed49e4c986 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:28.654135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9000a0-6de2-4e99-9670-cbed49e4c986 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:28.655222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9000a0-6de2-4e99-9670-cbed49e4c986 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:28.657694 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9000a0-6de2-4e99-9670-cbed49e4c986 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:28.669009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1123/2249] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:28.673194 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3eb4ba-46df-4908-9906-b6e703ab86a2 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:28.683992 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3eb4ba-46df-4908-9906-b6e703ab86a2 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:28.689150 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b8b26-9a95-499a-91e7-3913b87c6fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:28.690064 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b8b26-9a95-499a-91e7-3913b87c6fc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:28.690355 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b8b26-9a95-499a-91e7-3913b87c6fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:28.690635 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24b8b26-9a95-499a-91e7-3913b87c6fc3 admin admin] PATH_INFO: `/v3/projects/bbf7faf77203437c9bc678c26ed86bfd/users/6b20754b73d0438a87b592b6db537a01/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:28.708767 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b8b26-9a95-499a-91e7-3913b87c6fc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbf7faf77203437c9bc678c26ed86bfd, user_id=6b20754b73d0438a87b592b6db537a01, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:28.711470 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24b8b26-9a95-499a-91e7-3913b87c6fc3 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:28.726453 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1127/2250] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:28 2022] PUT /identity/v3/projects/bbf7faf77203437c9bc678c26ed86bfd/users/6b20754b73d0438a87b592b6db537a01/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:28.730927 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9000a0-6de2-4e99-9670-cbed49e4c986 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:28.741068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9000a0-6de2-4e99-9670-cbed49e4c986 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:28.749364 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:28.805074 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53024262-9c7d-4e6d-b26c-fe097cf2fa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:28.805757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53024262-9c7d-4e6d-b26c-fe097cf2fa70 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:28.806044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53024262-9c7d-4e6d-b26c-fe097cf2fa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:28.806323 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53024262-9c7d-4e6d-b26c-fe097cf2fa70 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:28.807068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53024262-9c7d-4e6d-b26c-fe097cf2fa70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:28.809266 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53024262-9c7d-4e6d-b26c-fe097cf2fa70 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:28.819701 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1124/2251] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:28 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:28.824455 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b8b26-9a95-499a-91e7-3913b87c6fc3 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:28.836441 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24b8b26-9a95-499a-91e7-3913b87c6fc3 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:28.841932 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a67bb-6192-4abe-8f48-5a2cab9ecc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:28.842901 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a67bb-6192-4abe-8f48-5a2cab9ecc5a admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:28.843207 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a67bb-6192-4abe-8f48-5a2cab9ecc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:28.843567 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a67bb-6192-4abe-8f48-5a2cab9ecc5a admin admin] PATH_INFO: `/v3/projects/bbf7faf77203437c9bc678c26ed86bfd/users/6b20754b73d0438a87b592b6db537a01/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:28.845658 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a67bb-6192-4abe-8f48-5a2cab9ecc5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbf7faf77203437c9bc678c26ed86bfd, user_id=6b20754b73d0438a87b592b6db537a01, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:28.848474 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a67bb-6192-4abe-8f48-5a2cab9ecc5a admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:28.858613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1128/2252] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:28 2022] PUT /identity/v3/projects/bbf7faf77203437c9bc678c26ed86bfd/users/6b20754b73d0438a87b592b6db537a01/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:31.265517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53024262-9c7d-4e6d-b26c-fe097cf2fa70 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:31.270362 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-53024262-9c7d-4e6d-b26c-fe097cf2fa70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:31.346679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53024262-9c7d-4e6d-b26c-fe097cf2fa70 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:31.448306 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ba8f4-6cc3-40d0-89df-49f4648947a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:31.449272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ba8f4-6cc3-40d0-89df-49f4648947a6 service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:31.449791 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ba8f4-6cc3-40d0-89df-49f4648947a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:31.450620 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ba8f4-6cc3-40d0-89df-49f4648947a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:31.534765 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ba8f4-6cc3-40d0-89df-49f4648947a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:31.536847 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81ba8f4-6cc3-40d0-89df-49f4648947a6 service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:31.549379 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1125/2253] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:32.427186 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a67bb-6192-4abe-8f48-5a2cab9ecc5a admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:32.439083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a67bb-6192-4abe-8f48-5a2cab9ecc5a admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:32.443097 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010d8b7-1918-4766-8918-bb6d023fbe5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:32.443981 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010d8b7-1918-4766-8918-bb6d023fbe5b service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:32.444369 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010d8b7-1918-4766-8918-bb6d023fbe5b service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:32.444751 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c010d8b7-1918-4766-8918-bb6d023fbe5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:32.555254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c010d8b7-1918-4766-8918-bb6d023fbe5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:32.557319 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c010d8b7-1918-4766-8918-bb6d023fbe5b service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:32.593215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1129/2254] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:34.119307 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55992dc-978d-4fa1-b282-f34d813fb4f3 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:34.119820 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55992dc-978d-4fa1-b282-f34d813fb4f3 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:34.119930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55992dc-978d-4fa1-b282-f34d813fb4f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:34.146838 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-d55992dc-978d-4fa1-b282-f34d813fb4f3 None None] MFA Rules not processed for user `6b20754b73d0438a87b592b6db537a01`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:34.148205 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d55992dc-978d-4fa1-b282-f34d813fb4f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:34.154804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:34.226937 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1126/2255] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:34.236205 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010d8b7-1918-4766-8918-bb6d023fbe5b service cinder] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:34.237659 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-c010d8b7-1918-4766-8918-bb6d023fbe5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:34.297186 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c010d8b7-1918-4766-8918-bb6d023fbe5b service cinder] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:34.300850 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09a42c-627c-4472-b175-3d2ece3b2da0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faaab5440b7041faa5a6f9ea18c188c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:34.301498 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09a42c-627c-4472-b175-3d2ece3b2da0 service glance] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:34.301941 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09a42c-627c-4472-b175-3d2ece3b2da0 service glance] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:34.302230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e09a42c-627c-4472-b175-3d2ece3b2da0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:34.319273 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:34.363439 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09a42c-627c-4472-b175-3d2ece3b2da0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:34.365069 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e09a42c-627c-4472-b175-3d2ece3b2da0 service glance] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:34.375363 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1130/2256] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:34 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:28:34.499917 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a8a7c-4a7b-44c2-a8e6-8431b55cdc6e None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:34.500435 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a8a7c-4a7b-44c2-a8e6-8431b55cdc6e None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:34.500786 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a8a7c-4a7b-44c2-a8e6-8431b55cdc6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:34.520269 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-8d8a8a7c-4a7b-44c2-a8e6-8431b55cdc6e None None] MFA Rules not processed for user `39bbc5ff02d24f40b796bd2245a7431a`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:34.521769 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-8d8a8a7c-4a7b-44c2-a8e6-8431b55cdc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:34.596314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1127/2257] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 00:28:34 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:34.671302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09a42c-627c-4472-b175-3d2ece3b2da0 service glance] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:34.672928 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-7e09a42c-627c-4472-b175-3d2ece3b2da0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:34.751513 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e09a42c-627c-4472-b175-3d2ece3b2da0 service glance] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:34.756775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f2fc71-06fa-4d99-b1fe-775c9019a877 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918c4a8c6a64812b61fc235ab8e7bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:34.757435 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2fc71-06fa-4d99-b1fe-775c9019a877 service swift] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:34.757716 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2fc71-06fa-4d99-b1fe-775c9019a877 service swift] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:34.757988 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f2fc71-06fa-4d99-b1fe-775c9019a877 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:34.768117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2fc71-06fa-4d99-b1fe-775c9019a877 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:34.769721 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f2fc71-06fa-4d99-b1fe-775c9019a877 service swift] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:34.778287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1131/2258] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 00:28:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:28:42.166547 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a8a7c-4a7b-44c2-a8e6-8431b55cdc6e None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:42.169236 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-8d8a8a7c-4a7b-44c2-a8e6-8431b55cdc6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:42.256842 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a8a7c-4a7b-44c2-a8e6-8431b55cdc6e None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:42.261942 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91794228-f1de-4555-8371-3d44f7194069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:42.262878 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91794228-f1de-4555-8371-3d44f7194069 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:42.263165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91794228-f1de-4555-8371-3d44f7194069 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:42.263489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91794228-f1de-4555-8371-3d44f7194069 admin admin] PATH_INFO: `/v3/users/2d420af661654431947b616a9d3ba75c` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:42.265042 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91794228-f1de-4555-8371-3d44f7194069 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d420af661654431947b616a9d3ba75c)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:42.267416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91794228-f1de-4555-8371-3d44f7194069 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:42.335278 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-91794228-f1de-4555-8371-3d44f7194069 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d420af661654431947b616a9d3ba75c'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:42.338866 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:42.347888 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-91794228-f1de-4555-8371-3d44f7194069 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d420af661654431947b616a9d3ba75c'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:42.348966 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-91794228-f1de-4555-8371-3d44f7194069 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d420af661654431947b616a9d3ba75c'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:42.367833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-91794228-f1de-4555-8371-3d44f7194069 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d420af661654431947b616a9d3ba75c'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:42.368984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-91794228-f1de-4555-8371-3d44f7194069 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d420af661654431947b616a9d3ba75c'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:42.406837 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1128/2259] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:42 2022] DELETE /identity/v3/users/2d420af661654431947b616a9d3ba75c => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:42.411372 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a80fd4-12d7-4ab9-8420-c55a2a90a32c None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:42.411974 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a80fd4-12d7-4ab9-8420-c55a2a90a32c None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:42.412374 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a80fd4-12d7-4ab9-8420-c55a2a90a32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:42.432356 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-47a80fd4-12d7-4ab9-8420-c55a2a90a32c None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:42.435214 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-47a80fd4-12d7-4ab9-8420-c55a2a90a32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:42.521538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1132/2260] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:42.529096 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91794228-f1de-4555-8371-3d44f7194069 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:42.535281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-91794228-f1de-4555-8371-3d44f7194069 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:42.769827 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91794228-f1de-4555-8371-3d44f7194069 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:42.774987 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610dc0b-73e2-4c4f-8984-56cd97539010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:42.775871 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610dc0b-73e2-4c4f-8984-56cd97539010 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:42.776161 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610dc0b-73e2-4c4f-8984-56cd97539010 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:42.776439 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e610dc0b-73e2-4c4f-8984-56cd97539010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:42.804849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610dc0b-73e2-4c4f-8984-56cd97539010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:42.806490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e610dc0b-73e2-4c4f-8984-56cd97539010 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:42.819036 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1129/2261] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:43.152972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a80fd4-12d7-4ab9-8420-c55a2a90a32c None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:43.154506 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-47a80fd4-12d7-4ab9-8420-c55a2a90a32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:43.230545 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:43.265333 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a80fd4-12d7-4ab9-8420-c55a2a90a32c None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:43.270627 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5470a3f-d883-47eb-bee7-fe7fc036dc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:43.274113 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5470a3f-d883-47eb-bee7-fe7fc036dc93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:43.274427 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610dc0b-73e2-4c4f-8984-56cd97539010 service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:43.274926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5470a3f-d883-47eb-bee7-fe7fc036dc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:43.274926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5470a3f-d883-47eb-bee7-fe7fc036dc93 admin admin] PATH_INFO: `/v3/users/d276ac3e9f024259998d60cff871bd2c` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:43.275999 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e610dc0b-73e2-4c4f-8984-56cd97539010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:43.276218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5470a3f-d883-47eb-bee7-fe7fc036dc93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d276ac3e9f024259998d60cff871bd2c)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:43.278686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5470a3f-d883-47eb-bee7-fe7fc036dc93 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:43.357567 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e610dc0b-73e2-4c4f-8984-56cd97539010 service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:43.363263 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c0b8d-cee6-49df-996c-fa1bbbbc5bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:43.364315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c0b8d-cee6-49df-996c-fa1bbbbc5bbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:43.364585 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-d5470a3f-d883-47eb-bee7-fe7fc036dc93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd276ac3e9f024259998d60cff871bd2c'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:43.364701 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c0b8d-cee6-49df-996c-fa1bbbbc5bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:43.364877 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c0b8d-cee6-49df-996c-fa1bbbbc5bbc admin admin] PATH_INFO: `/v3/projects/c4e625c0d59642829a38ac2e4e6acf07` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:43.366447 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c0b8d-cee6-49df-996c-fa1bbbbc5bbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4e625c0d59642829a38ac2e4e6acf07)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:43.368457 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464c0b8d-cee6-49df-996c-fa1bbbbc5bbc admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:43.379646 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-d5470a3f-d883-47eb-bee7-fe7fc036dc93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd276ac3e9f024259998d60cff871bd2c'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:43.380441 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-d5470a3f-d883-47eb-bee7-fe7fc036dc93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd276ac3e9f024259998d60cff871bd2c'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:43.381160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-d5470a3f-d883-47eb-bee7-fe7fc036dc93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd276ac3e9f024259998d60cff871bd2c'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:43.401201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-d5470a3f-d883-47eb-bee7-fe7fc036dc93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd276ac3e9f024259998d60cff871bd2c'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:43.422542 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1133/2262] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:43 2022] DELETE /identity/v3/users/d276ac3e9f024259998d60cff871bd2c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:43.427772 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f10300-ff1d-4c31-9686-d495d5b14e59 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:43.428369 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f10300-ff1d-4c31-9686-d495d5b14e59 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:43.429521 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f10300-ff1d-4c31-9686-d495d5b14e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:43.433127 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-464c0b8d-cee6-49df-996c-fa1bbbbc5bbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4e625c0d59642829a38ac2e4e6acf07', 'request_id': 'req-464c0b8d-cee6-49df-996c-fa1bbbbc5bbc'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:43.440764 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-464c0b8d-cee6-49df-996c-fa1bbbbc5bbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4e625c0d59642829a38ac2e4e6acf07', 'request_id': 'req-464c0b8d-cee6-49df-996c-fa1bbbbc5bbc'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:43.448057 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-464c0b8d-cee6-49df-996c-fa1bbbbc5bbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4e625c0d59642829a38ac2e4e6acf07', 'request_id': 'req-464c0b8d-cee6-49df-996c-fa1bbbbc5bbc'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:43.466082 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-464c0b8d-cee6-49df-996c-fa1bbbbc5bbc admin admin] The token cache is being invalidate because project c4e625c0d59642829a38ac2e4e6acf07 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:43.466375 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-464c0b8d-cee6-49df-996c-fa1bbbbc5bbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:43.467035 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-464c0b8d-cee6-49df-996c-fa1bbbbc5bbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:43.468744 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1130/2263] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:43 2022] DELETE /identity/v3/projects/c4e625c0d59642829a38ac2e4e6acf07 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:43.481639 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-c3f10300-ff1d-4c31-9686-d495d5b14e59 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:43.483157 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-c3f10300-ff1d-4c31-9686-d495d5b14e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:43.599769 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1134/2264] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:43.614350 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c0b8d-cee6-49df-996c-fa1bbbbc5bbc admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:43.616069 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-464c0b8d-cee6-49df-996c-fa1bbbbc5bbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:43.674357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:43.772678 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464c0b8d-cee6-49df-996c-fa1bbbbc5bbc admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:43.840699 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08092f-6838-437f-928d-9e8b4aeb3357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:43.841392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08092f-6838-437f-928d-9e8b4aeb3357 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:43.841682 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08092f-6838-437f-928d-9e8b4aeb3357 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:43.841962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08092f-6838-437f-928d-9e8b4aeb3357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:43.853270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08092f-6838-437f-928d-9e8b4aeb3357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:43.854742 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08092f-6838-437f-928d-9e8b4aeb3357 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:43.865752 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1131/2265] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:44.190029 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f10300-ff1d-4c31-9686-d495d5b14e59 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:44.192129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-c3f10300-ff1d-4c31-9686-d495d5b14e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:44.210046 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f10300-ff1d-4c31-9686-d495d5b14e59 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:44.238257 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a9bd5-98e8-4a82-b54a-71c3715d98ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:44.239244 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a9bd5-98e8-4a82-b54a-71c3715d98ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:44.239708 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a9bd5-98e8-4a82-b54a-71c3715d98ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:44.239983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547a9bd5-98e8-4a82-b54a-71c3715d98ba admin admin] PATH_INFO: `/v3/projects/3a7a44c59db24e36a4b19c7ea6f9b7a0` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:44.241382 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a9bd5-98e8-4a82-b54a-71c3715d98ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a7a44c59db24e36a4b19c7ea6f9b7a0)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:44.244322 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547a9bd5-98e8-4a82-b54a-71c3715d98ba admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:44.321480 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:44.323783 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-547a9bd5-98e8-4a82-b54a-71c3715d98ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a7a44c59db24e36a4b19c7ea6f9b7a0', 'request_id': 'req-547a9bd5-98e8-4a82-b54a-71c3715d98ba'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:44.335878 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-547a9bd5-98e8-4a82-b54a-71c3715d98ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a7a44c59db24e36a4b19c7ea6f9b7a0', 'request_id': 'req-547a9bd5-98e8-4a82-b54a-71c3715d98ba'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:44.343526 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-547a9bd5-98e8-4a82-b54a-71c3715d98ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a7a44c59db24e36a4b19c7ea6f9b7a0', 'request_id': 'req-547a9bd5-98e8-4a82-b54a-71c3715d98ba'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:44.359790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-547a9bd5-98e8-4a82-b54a-71c3715d98ba admin admin] The token cache is being invalidate because project 3a7a44c59db24e36a4b19c7ea6f9b7a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:44.360092 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-547a9bd5-98e8-4a82-b54a-71c3715d98ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:44.360724 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-547a9bd5-98e8-4a82-b54a-71c3715d98ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:44.362454 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1135/2266] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:44 2022] DELETE /identity/v3/projects/3a7a44c59db24e36a4b19c7ea6f9b7a0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:44.366442 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08092f-6838-437f-928d-9e8b4aeb3357 service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:44.377161 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08092f-6838-437f-928d-9e8b4aeb3357 service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:44.456084 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6ea5f-3bb0-4417-ae04-8c3124d19b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:44.457104 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6ea5f-3bb0-4417-ae04-8c3124d19b67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:44.457391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6ea5f-3bb0-4417-ae04-8c3124d19b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:44.457726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6ea5f-3bb0-4417-ae04-8c3124d19b67 admin admin] PATH_INFO: `/v3/users/753677d3a6df423b9e61fd3849c2ebd8` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:44.458915 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c6ea5f-3bb0-4417-ae04-8c3124d19b67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=753677d3a6df423b9e61fd3849c2ebd8)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:44.461250 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c6ea5f-3bb0-4417-ae04-8c3124d19b67 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:44.518667 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:44.520362 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d1c6ea5f-3bb0-4417-ae04-8c3124d19b67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '753677d3a6df423b9e61fd3849c2ebd8'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:44.531056 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d1c6ea5f-3bb0-4417-ae04-8c3124d19b67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '753677d3a6df423b9e61fd3849c2ebd8'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:44.531697 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d1c6ea5f-3bb0-4417-ae04-8c3124d19b67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '753677d3a6df423b9e61fd3849c2ebd8'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:44.545605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d1c6ea5f-3bb0-4417-ae04-8c3124d19b67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '753677d3a6df423b9e61fd3849c2ebd8'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:44.546445 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d1c6ea5f-3bb0-4417-ae04-8c3124d19b67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '753677d3a6df423b9e61fd3849c2ebd8'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:44.561342 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1132/2267] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:44 2022] DELETE /identity/v3/users/753677d3a6df423b9e61fd3849c2ebd8 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:44.876052 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a9bd5-98e8-4a82-b54a-71c3715d98ba admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:44.877610 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-547a9bd5-98e8-4a82-b54a-71c3715d98ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:44.908284 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547a9bd5-98e8-4a82-b54a-71c3715d98ba admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:44.972337 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e2f5d-4032-46fa-a0db-3543012f3449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:44.973473 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e2f5d-4032-46fa-a0db-3543012f3449 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:44.973942 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e2f5d-4032-46fa-a0db-3543012f3449 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:44.974216 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e2f5d-4032-46fa-a0db-3543012f3449 admin admin] PATH_INFO: `/v3/projects/f3727b32640b42a2b10d3714891b733c` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:44.975541 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e2f5d-4032-46fa-a0db-3543012f3449 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3727b32640b42a2b10d3714891b733c)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:44.977505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e2f5d-4032-46fa-a0db-3543012f3449 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:45.032871 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-ac0e2f5d-4032-46fa-a0db-3543012f3449 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3727b32640b42a2b10d3714891b733c', 'request_id': 'req-ac0e2f5d-4032-46fa-a0db-3543012f3449'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:45.041445 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-ac0e2f5d-4032-46fa-a0db-3543012f3449 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3727b32640b42a2b10d3714891b733c', 'request_id': 'req-ac0e2f5d-4032-46fa-a0db-3543012f3449'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:45.048803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-ac0e2f5d-4032-46fa-a0db-3543012f3449 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3727b32640b42a2b10d3714891b733c', 'request_id': 'req-ac0e2f5d-4032-46fa-a0db-3543012f3449'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:45.063319 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-ac0e2f5d-4032-46fa-a0db-3543012f3449 admin admin] The token cache is being invalidate because project f3727b32640b42a2b10d3714891b733c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:45.063648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-ac0e2f5d-4032-46fa-a0db-3543012f3449 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:45.064863 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-ac0e2f5d-4032-46fa-a0db-3543012f3449 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:45.066808 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1136/2268] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:44 2022] DELETE /identity/v3/projects/f3727b32640b42a2b10d3714891b733c => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:45.070539 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6ea5f-3bb0-4417-ae04-8c3124d19b67 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:45.072145 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d1c6ea5f-3bb0-4417-ae04-8c3124d19b67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:45.088618 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6ea5f-3bb0-4417-ae04-8c3124d19b67 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:45.162601 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536854c-ed00-49b8-847d-1a3d39d34ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:45.163600 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536854c-ed00-49b8-847d-1a3d39d34ae0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:45.163600 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536854c-ed00-49b8-847d-1a3d39d34ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:45.163600 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536854c-ed00-49b8-847d-1a3d39d34ae0 admin admin] PATH_INFO: `/v3/users/e2cdf6f80e0942ca9488c21ae1280309` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:45.165703 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536854c-ed00-49b8-847d-1a3d39d34ae0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2cdf6f80e0942ca9488c21ae1280309)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:45.168333 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536854c-ed00-49b8-847d-1a3d39d34ae0 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:45.244158 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d536854c-ed00-49b8-847d-1a3d39d34ae0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2cdf6f80e0942ca9488c21ae1280309'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:45.256699 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d536854c-ed00-49b8-847d-1a3d39d34ae0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2cdf6f80e0942ca9488c21ae1280309'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:45.258094 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d536854c-ed00-49b8-847d-1a3d39d34ae0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2cdf6f80e0942ca9488c21ae1280309'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:45.276385 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d536854c-ed00-49b8-847d-1a3d39d34ae0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2cdf6f80e0942ca9488c21ae1280309'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:45.278123 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d536854c-ed00-49b8-847d-1a3d39d34ae0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2cdf6f80e0942ca9488c21ae1280309'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:45.305898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1133/2269] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:45 2022] DELETE /identity/v3/users/e2cdf6f80e0942ca9488c21ae1280309 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:45.763429 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e2f5d-4032-46fa-a0db-3543012f3449 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:45.764957 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-ac0e2f5d-4032-46fa-a0db-3543012f3449 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:45.784932 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e2f5d-4032-46fa-a0db-3543012f3449 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:45.890872 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908a9b37-493a-4066-a969-5109d4b56a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:45.891818 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a9b37-493a-4066-a969-5109d4b56a7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:45.892137 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a9b37-493a-4066-a969-5109d4b56a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:45.892418 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908a9b37-493a-4066-a969-5109d4b56a7e admin admin] PATH_INFO: `/v3/projects/194ecad73eba4ab4a6bea6fd53599072` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:45.893716 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a9b37-493a-4066-a969-5109d4b56a7e admin admin] RBAC: Authorizing `identity:delete_project(project_id=194ecad73eba4ab4a6bea6fd53599072)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:45.895742 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908a9b37-493a-4066-a969-5109d4b56a7e admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:45.910143 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:45.958755 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-908a9b37-493a-4066-a969-5109d4b56a7e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '194ecad73eba4ab4a6bea6fd53599072', 'request_id': 'req-908a9b37-493a-4066-a969-5109d4b56a7e'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:45.965926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-908a9b37-493a-4066-a969-5109d4b56a7e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '194ecad73eba4ab4a6bea6fd53599072', 'request_id': 'req-908a9b37-493a-4066-a969-5109d4b56a7e'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:45.975155 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-908a9b37-493a-4066-a969-5109d4b56a7e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '194ecad73eba4ab4a6bea6fd53599072', 'request_id': 'req-908a9b37-493a-4066-a969-5109d4b56a7e'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:45.992033 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-908a9b37-493a-4066-a969-5109d4b56a7e admin admin] The token cache is being invalidate because project 194ecad73eba4ab4a6bea6fd53599072 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:45.992329 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-908a9b37-493a-4066-a969-5109d4b56a7e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:45.993416 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-908a9b37-493a-4066-a969-5109d4b56a7e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:45.995216 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1137/2270] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:45 2022] DELETE /identity/v3/projects/194ecad73eba4ab4a6bea6fd53599072 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:46.000501 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae356078-ae91-4c43-aa8b-043e0c4fceec None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:46.001023 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae356078-ae91-4c43-aa8b-043e0c4fceec None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:46.001514 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae356078-ae91-4c43-aa8b-043e0c4fceec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:46.045380 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-ae356078-ae91-4c43-aa8b-043e0c4fceec None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:46.046279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-ae356078-ae91-4c43-aa8b-043e0c4fceec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:46.070797 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:46.114233 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1134/2271] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:46.122596 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc1494-c30b-4bab-955d-f683f4d666a0 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:46.123227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc1494-c30b-4bab-955d-f683f4d666a0 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:46.123941 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffc1494-c30b-4bab-955d-f683f4d666a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:46.145365 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-bffc1494-c30b-4bab-955d-f683f4d666a0 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:46.147173 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-bffc1494-c30b-4bab-955d-f683f4d666a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:46.160562 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1138/2272] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:46.161622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae356078-ae91-4c43-aa8b-043e0c4fceec None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:46.171863 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae356078-ae91-4c43-aa8b-043e0c4fceec None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:46.176551 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c13fc5-8ab4-4efe-8ce2-310a2a16b174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:46.177247 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c13fc5-8ab4-4efe-8ce2-310a2a16b174 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:46.177534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c13fc5-8ab4-4efe-8ce2-310a2a16b174 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:46.177821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c13fc5-8ab4-4efe-8ce2-310a2a16b174 admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:46.178634 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c13fc5-8ab4-4efe-8ce2-310a2a16b174 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:28:46.178954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c13fc5-8ab4-4efe-8ce2-310a2a16b174 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:46.180767 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c13fc5-8ab4-4efe-8ce2-310a2a16b174 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:46.194923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1135/2273] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:28:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:28:46.199824 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc1494-c30b-4bab-955d-f683f4d666a0 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:46.209743 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffc1494-c30b-4bab-955d-f683f4d666a0 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:46.214584 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34239cb5-5346-4b45-b489-4bd49764519f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:46.215328 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34239cb5-5346-4b45-b489-4bd49764519f admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:46.215741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34239cb5-5346-4b45-b489-4bd49764519f admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:46.216121 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34239cb5-5346-4b45-b489-4bd49764519f admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:46.216931 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34239cb5-5346-4b45-b489-4bd49764519f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:46.219431 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34239cb5-5346-4b45-b489-4bd49764519f admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:46.251640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1139/2274] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:46 2022] POST /identity/v3/projects => generated 369 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:46.253263 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c13fc5-8ab4-4efe-8ce2-310a2a16b174 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:46.264382 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c13fc5-8ab4-4efe-8ce2-310a2a16b174 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:46.327322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3d60b-bd3c-45c9-8c49-0e7e05d9b52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:46.328042 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3d60b-bd3c-45c9-8c49-0e7e05d9b52d admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:46.328331 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3d60b-bd3c-45c9-8c49-0e7e05d9b52d admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:46.328614 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c3d60b-bd3c-45c9-8c49-0e7e05d9b52d admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:46.329371 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3d60b-bd3c-45c9-8c49-0e7e05d9b52d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:46.331286 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c3d60b-bd3c-45c9-8c49-0e7e05d9b52d admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:46.351178 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1136/2275] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:46 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:46.355649 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34239cb5-5346-4b45-b489-4bd49764519f admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:46.366071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34239cb5-5346-4b45-b489-4bd49764519f admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:46.370816 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b9fbb8-cf15-476a-97c7-b63c3a90f5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:46.371476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9fbb8-cf15-476a-97c7-b63c3a90f5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:46.371794 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9fbb8-cf15-476a-97c7-b63c3a90f5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:46.372075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b9fbb8-cf15-476a-97c7-b63c3a90f5e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:46.372810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9fbb8-cf15-476a-97c7-b63c3a90f5e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:46.374405 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b9fbb8-cf15-476a-97c7-b63c3a90f5e4 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:46.387653 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1140/2276] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:46.390198 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3d60b-bd3c-45c9-8c49-0e7e05d9b52d admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:46.401396 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c3d60b-bd3c-45c9-8c49-0e7e05d9b52d admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:46.402624 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636a034-364a-493f-8208-34e0ee24dd0e None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:46.402928 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636a034-364a-493f-8208-34e0ee24dd0e None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:46.403209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7636a034-364a-493f-8208-34e0ee24dd0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:46.406430 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c8d1f-6eca-462e-9326-6c7d67f4a15a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:46.407091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c8d1f-6eca-462e-9326-6c7d67f4a15a admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:46.407378 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c8d1f-6eca-462e-9326-6c7d67f4a15a admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:46.407688 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c8d1f-6eca-462e-9326-6c7d67f4a15a admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:46.408429 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c8d1f-6eca-462e-9326-6c7d67f4a15a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:46.410046 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c8d1f-6eca-462e-9326-6c7d67f4a15a admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:46.420499 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-7636a034-364a-493f-8208-34e0ee24dd0e None None] MFA Rules not processed for user `ac127f66bf2b4432acd34132911d7c0c`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:46.423847 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1137/2277] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:46.423997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-7636a034-364a-493f-8208-34e0ee24dd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:46.424792 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c8d1f-6eca-462e-9326-6c7d67f4a15a admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:46.435010 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c8d1f-6eca-462e-9326-6c7d67f4a15a admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:46.439760 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8f3e9b-13a8-4eea-bc0d-b7967b537e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:46.440629 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f3e9b-13a8-4eea-bc0d-b7967b537e2f admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:46.440918 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f3e9b-13a8-4eea-bc0d-b7967b537e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:46.441196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8f3e9b-13a8-4eea-bc0d-b7967b537e2f admin admin] PATH_INFO: `/v3/projects/090da9dca94046758b603599f60681bc/users/712da8e50d454b10929c268420b76314/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:46.456631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f3e9b-13a8-4eea-bc0d-b7967b537e2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=090da9dca94046758b603599f60681bc, user_id=712da8e50d454b10929c268420b76314, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:46.459323 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8f3e9b-13a8-4eea-bc0d-b7967b537e2f admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:46.473545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1138/2278] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:46 2022] PUT /identity/v3/projects/090da9dca94046758b603599f60681bc/users/712da8e50d454b10929c268420b76314/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:28:46.479698 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1141/2279] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:28:46.485162 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ca07a-7a48-4761-91be-56d1e191d198 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:46.485454 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ca07a-7a48-4761-91be-56d1e191d198 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:46.485729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9ca07a-7a48-4761-91be-56d1e191d198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:46.512522 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-3f9ca07a-7a48-4761-91be-56d1e191d198 None None] MFA Rules not processed for user `712da8e50d454b10929c268420b76314`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:46.513724 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-3f9ca07a-7a48-4761-91be-56d1e191d198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:46.585559 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:46.592010 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1139/2280] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:46 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:46.605611 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636a034-364a-493f-8208-34e0ee24dd0e None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:46.607573 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-7636a034-364a-493f-8208-34e0ee24dd0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:46.671951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7636a034-364a-493f-8208-34e0ee24dd0e None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:46.684978 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:46.728347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471759a0-7797-4117-9807-e3c8503e23f1 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faaab5440b7041faa5a6f9ea18c188c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:46.728893 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471759a0-7797-4117-9807-e3c8503e23f1 service glance] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:46.729182 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471759a0-7797-4117-9807-e3c8503e23f1 service glance] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:46.729458 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471759a0-7797-4117-9807-e3c8503e23f1 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:46.738497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471759a0-7797-4117-9807-e3c8503e23f1 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:46.740308 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471759a0-7797-4117-9807-e3c8503e23f1 service glance] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:46.750516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1142/2281] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:46 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:28:50.651539 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2effaa8-d0a3-426e-b56d-20d5e38632fe None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:50.652776 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2effaa8-d0a3-426e-b56d-20d5e38632fe None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:50.652776 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2effaa8-d0a3-426e-b56d-20d5e38632fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:50.670602 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-f2effaa8-d0a3-426e-b56d-20d5e38632fe None None] MFA Rules not processed for user `39bbc5ff02d24f40b796bd2245a7431a`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:50.672127 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-f2effaa8-d0a3-426e-b56d-20d5e38632fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:50.746490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1140/2282] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 00:28:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:50.758523 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471759a0-7797-4117-9807-e3c8503e23f1 service glance] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:50.760343 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-471759a0-7797-4117-9807-e3c8503e23f1 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:50.835012 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471759a0-7797-4117-9807-e3c8503e23f1 service glance] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:50.840039 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d7bde-32ee-4497-97eb-18344709347e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918c4a8c6a64812b61fc235ab8e7bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:50.840701 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d7bde-32ee-4497-97eb-18344709347e service swift] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:50.840992 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d7bde-32ee-4497-97eb-18344709347e service swift] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:50.841274 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d7bde-32ee-4497-97eb-18344709347e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:50.849866 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d7bde-32ee-4497-97eb-18344709347e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:50.851474 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d7bde-32ee-4497-97eb-18344709347e service swift] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:50.861362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1143/2283] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 00:28:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:28:54.830954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2effaa8-d0a3-426e-b56d-20d5e38632fe None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:54.832470 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-f2effaa8-d0a3-426e-b56d-20d5e38632fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:54.903530 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2effaa8-d0a3-426e-b56d-20d5e38632fe None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:54.908453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8dad3a-d973-4919-9b4b-00af09a4129d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:54.909474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dad3a-d973-4919-9b4b-00af09a4129d admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:54.909837 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dad3a-d973-4919-9b4b-00af09a4129d admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:54.910191 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8dad3a-d973-4919-9b4b-00af09a4129d admin admin] PATH_INFO: `/v3/users/2a089ba1f0fb462ab5a939f54eae6e51` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:54.911452 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8dad3a-d973-4919-9b4b-00af09a4129d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a089ba1f0fb462ab5a939f54eae6e51)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:54.913527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8dad3a-d973-4919-9b4b-00af09a4129d admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:54.965971 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-6e8dad3a-d973-4919-9b4b-00af09a4129d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a089ba1f0fb462ab5a939f54eae6e51'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:54.975565 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-6e8dad3a-d973-4919-9b4b-00af09a4129d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a089ba1f0fb462ab5a939f54eae6e51'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:54.976479 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-6e8dad3a-d973-4919-9b4b-00af09a4129d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a089ba1f0fb462ab5a939f54eae6e51'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:54.994414 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-6e8dad3a-d973-4919-9b4b-00af09a4129d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a089ba1f0fb462ab5a939f54eae6e51'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:54.995257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-6e8dad3a-d973-4919-9b4b-00af09a4129d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a089ba1f0fb462ab5a939f54eae6e51'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:55.008446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1141/2284] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:28:54 2022] DELETE /identity/v3/users/2a089ba1f0fb462ab5a939f54eae6e51 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:55.013739 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016aea20-8a27-42af-9a03-d961eaca6626 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:55.014224 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016aea20-8a27-42af-9a03-d961eaca6626 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:55.014316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016aea20-8a27-42af-9a03-d961eaca6626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:55.032752 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-016aea20-8a27-42af-9a03-d961eaca6626 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:55.033987 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-016aea20-8a27-42af-9a03-d961eaca6626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:55.102407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1144/2285] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:55.114315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8dad3a-d973-4919-9b4b-00af09a4129d admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:55.115972 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-6e8dad3a-d973-4919-9b4b-00af09a4129d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:55.145533 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:55.184744 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8dad3a-d973-4919-9b4b-00af09a4129d admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:55.189803 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c34d04a-51a2-47e9-a1d0-27fc3f40b069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:55.190553 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34d04a-51a2-47e9-a1d0-27fc3f40b069 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:55.190838 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34d04a-51a2-47e9-a1d0-27fc3f40b069 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:55.191116 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c34d04a-51a2-47e9-a1d0-27fc3f40b069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:55.201582 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34d04a-51a2-47e9-a1d0-27fc3f40b069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:55.203036 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c34d04a-51a2-47e9-a1d0-27fc3f40b069 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:55.212834 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1142/2286] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:28:55.700870 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016aea20-8a27-42af-9a03-d961eaca6626 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:55.703153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-016aea20-8a27-42af-9a03-d961eaca6626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:55.745574 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016aea20-8a27-42af-9a03-d961eaca6626 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:55.757495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8033f69c-dbdc-4d9a-ab89-cef88d9c4eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:55.758377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033f69c-dbdc-4d9a-ab89-cef88d9c4eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:55.758660 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033f69c-dbdc-4d9a-ab89-cef88d9c4eba admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:55.758937 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8033f69c-dbdc-4d9a-ab89-cef88d9c4eba admin admin] PATH_INFO: `/v3/projects/796816aee4fe49bdb69879ae2e9b6744` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:55.768795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033f69c-dbdc-4d9a-ab89-cef88d9c4eba admin admin] RBAC: Authorizing `identity:delete_project(project_id=796816aee4fe49bdb69879ae2e9b6744)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:55.771054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8033f69c-dbdc-4d9a-ab89-cef88d9c4eba admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:55.845378 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:55.850749 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-8033f69c-dbdc-4d9a-ab89-cef88d9c4eba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '796816aee4fe49bdb69879ae2e9b6744', 'request_id': 'req-8033f69c-dbdc-4d9a-ab89-cef88d9c4eba'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:55.858634 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-8033f69c-dbdc-4d9a-ab89-cef88d9c4eba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '796816aee4fe49bdb69879ae2e9b6744', 'request_id': 'req-8033f69c-dbdc-4d9a-ab89-cef88d9c4eba'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:55.865457 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-8033f69c-dbdc-4d9a-ab89-cef88d9c4eba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '796816aee4fe49bdb69879ae2e9b6744', 'request_id': 'req-8033f69c-dbdc-4d9a-ab89-cef88d9c4eba'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:55.881750 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-8033f69c-dbdc-4d9a-ab89-cef88d9c4eba admin admin] The token cache is being invalidate because project 796816aee4fe49bdb69879ae2e9b6744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:28:55.882154 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-8033f69c-dbdc-4d9a-ab89-cef88d9c4eba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:55.883065 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-8033f69c-dbdc-4d9a-ab89-cef88d9c4eba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:28:55.885364 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1145/2287] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:28:55 2022] DELETE /identity/v3/projects/796816aee4fe49bdb69879ae2e9b6744 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:55.890383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4daef-4bb3-4f13-9fea-eb90905298a7 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:55.891427 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4daef-4bb3-4f13-9fea-eb90905298a7 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:55.892093 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f4daef-4bb3-4f13-9fea-eb90905298a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:56.007430 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-c3f4daef-4bb3-4f13-9fea-eb90905298a7 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:56.009631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-c3f4daef-4bb3-4f13-9fea-eb90905298a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:56.118904 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1143/2288] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:56.126249 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d355b4-0451-49fb-a1d9-d3cfc3394721 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:56.126871 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d355b4-0451-49fb-a1d9-d3cfc3394721 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:56.126871 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d355b4-0451-49fb-a1d9-d3cfc3394721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:56.149192 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-b6d355b4-0451-49fb-a1d9-d3cfc3394721 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:56.150919 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-b6d355b4-0451-49fb-a1d9-d3cfc3394721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:56.162743 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1146/2289] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:56.168011 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4daef-4bb3-4f13-9fea-eb90905298a7 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:56.190228 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f4daef-4bb3-4f13-9fea-eb90905298a7 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:56.195340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbd541-f525-4f45-8528-208f26c5ded8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:56.196214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbd541-f525-4f45-8528-208f26c5ded8 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:56.196601 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbd541-f525-4f45-8528-208f26c5ded8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:56.197423 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbd541-f525-4f45-8528-208f26c5ded8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:56.198463 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbd541-f525-4f45-8528-208f26c5ded8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:28:56.198877 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbd541-f525-4f45-8528-208f26c5ded8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:56.201191 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffbd541-f525-4f45-8528-208f26c5ded8 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:56.215424 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1144/2290] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:28:56.220588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d355b4-0451-49fb-a1d9-d3cfc3394721 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:56.229918 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d355b4-0451-49fb-a1d9-d3cfc3394721 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:56.235484 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49c3c2-df87-47fd-99b2-8020bf85fa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:56.236296 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49c3c2-df87-47fd-99b2-8020bf85fa52 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:56.236644 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49c3c2-df87-47fd-99b2-8020bf85fa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:56.236987 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba49c3c2-df87-47fd-99b2-8020bf85fa52 admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:56.237775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49c3c2-df87-47fd-99b2-8020bf85fa52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:56.239851 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba49c3c2-df87-47fd-99b2-8020bf85fa52 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:56.274383 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1147/2291] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:28:56 2022] POST /identity/v3/projects => generated 365 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:56.278459 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbd541-f525-4f45-8528-208f26c5ded8 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:56.290198 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffbd541-f525-4f45-8528-208f26c5ded8 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:56.414973 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f040b-2d34-4965-b634-7f9391925f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:56.415715 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f040b-2d34-4965-b634-7f9391925f55 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:56.416017 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f040b-2d34-4965-b634-7f9391925f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:56.416295 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697f040b-2d34-4965-b634-7f9391925f55 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:56.417030 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f040b-2d34-4965-b634-7f9391925f55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:56.419023 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697f040b-2d34-4965-b634-7f9391925f55 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:56.440441 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1145/2292] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:28:56 2022] POST /identity/v3/users => generated 283 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:28:56.445030 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49c3c2-df87-47fd-99b2-8020bf85fa52 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:56.456634 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba49c3c2-df87-47fd-99b2-8020bf85fa52 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:56.461588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679a0dd-b208-4c16-abc6-a9030b1ff53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:56.462495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679a0dd-b208-4c16-abc6-a9030b1ff53a admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:56.462860 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679a0dd-b208-4c16-abc6-a9030b1ff53a admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:56.463217 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1679a0dd-b208-4c16-abc6-a9030b1ff53a admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:56.464060 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679a0dd-b208-4c16-abc6-a9030b1ff53a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:56.465826 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1679a0dd-b208-4c16-abc6-a9030b1ff53a admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:56.481374 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1148/2293] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:56.482608 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f040b-2d34-4965-b634-7f9391925f55 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:56.493523 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697f040b-2d34-4965-b634-7f9391925f55 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:56.499069 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c482aef-303a-4c70-b3f1-ef0bb92748b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:56.499789 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c482aef-303a-4c70-b3f1-ef0bb92748b5 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:56.500073 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c482aef-303a-4c70-b3f1-ef0bb92748b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:56.500350 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c482aef-303a-4c70-b3f1-ef0bb92748b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:56.501335 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c482aef-303a-4c70-b3f1-ef0bb92748b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:56.502947 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c482aef-303a-4c70-b3f1-ef0bb92748b5 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:56.514038 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1146/2294] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:28:56.518567 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679a0dd-b208-4c16-abc6-a9030b1ff53a admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:56.528453 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1679a0dd-b208-4c16-abc6-a9030b1ff53a admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:56.533144 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f94171-c367-4070-91cd-2525d6987029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:56.537606 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f94171-c367-4070-91cd-2525d6987029 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:56.538219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f94171-c367-4070-91cd-2525d6987029 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:56.538511 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f94171-c367-4070-91cd-2525d6987029 admin admin] PATH_INFO: `/v3/projects/7de4a15836cf4757b2dda2b5eda39289/users/4a469a9e4478483297bb1f8d64f7b894/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:56.556756 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f94171-c367-4070-91cd-2525d6987029 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7de4a15836cf4757b2dda2b5eda39289, user_id=4a469a9e4478483297bb1f8d64f7b894, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:56.560731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f94171-c367-4070-91cd-2525d6987029 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:56.578211 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1149/2295] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:28:56 2022] PUT /identity/v3/projects/7de4a15836cf4757b2dda2b5eda39289/users/4a469a9e4478483297bb1f8d64f7b894/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:28:56.588829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049dcde-d4b8-4620-ab5c-b5e02165bb45 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:56.589144 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049dcde-d4b8-4620-ab5c-b5e02165bb45 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:56.589440 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a049dcde-d4b8-4620-ab5c-b5e02165bb45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:56.617718 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-a049dcde-d4b8-4620-ab5c-b5e02165bb45 None None] MFA Rules not processed for user `4a469a9e4478483297bb1f8d64f7b894`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:28:56.619173 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a049dcde-d4b8-4620-ab5c-b5e02165bb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:56.633028 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:28:56.706024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1147/2296] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:28:56 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:28:56.715209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f94171-c367-4070-91cd-2525d6987029 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:28:56.719122 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-a1f94171-c367-4070-91cd-2525d6987029 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:28:56.846004 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f94171-c367-4070-91cd-2525d6987029 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:28:56.850443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763fb16d-ae71-4948-b302-0cac6040ed00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:28:56.851402 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fb16d-ae71-4948-b302-0cac6040ed00 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:28:56.851722 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fb16d-ae71-4948-b302-0cac6040ed00 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:28:56.852917 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763fb16d-ae71-4948-b302-0cac6040ed00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:28:56.864258 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763fb16d-ae71-4948-b302-0cac6040ed00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:28:56.865715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763fb16d-ae71-4948-b302-0cac6040ed00 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:28:56.875334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1150/2297] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:28:56 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:29:06.698281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=22 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:06.870532 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:DELETE=4,keystone:SELECT=60,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:20.409003 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049dcde-d4b8-4620-ab5c-b5e02165bb45 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:20.410637 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a049dcde-d4b8-4620-ab5c-b5e02165bb45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:20.536334 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a049dcde-d4b8-4620-ab5c-b5e02165bb45 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:20.541502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a850d-f52d-493a-ba30-7a09ea42dd70 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9164f14fe6894daba1a9f2d8f1f4929c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:20.542233 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a850d-f52d-493a-ba30-7a09ea42dd70 service placement] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:20.542611 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a850d-f52d-493a-ba30-7a09ea42dd70 service placement] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:20.542964 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362a850d-f52d-493a-ba30-7a09ea42dd70 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:20.544870 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-362a850d-f52d-493a-ba30-7a09ea42dd70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:20.556942 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a850d-f52d-493a-ba30-7a09ea42dd70 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:20.558434 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362a850d-f52d-493a-ba30-7a09ea42dd70 service placement] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:20.569641 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1148/2298] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:20 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:29:30.565128 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=41 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:47.722083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abcac2-a8a5-4da5-aa20-efe88634d18f None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:47.722666 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abcac2-a8a5-4da5-aa20-efe88634d18f None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:47.722771 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19abcac2-a8a5-4da5-aa20-efe88634d18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:47.782224 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-19abcac2-a8a5-4da5-aa20-efe88634d18f None None] MFA Rules not processed for user `39bbc5ff02d24f40b796bd2245a7431a`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:47.783448 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-19abcac2-a8a5-4da5-aa20-efe88634d18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:47.866303 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1151/2299] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 00:29:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:29:47.895571 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a850d-f52d-493a-ba30-7a09ea42dd70 service placement] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:47.897021 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-362a850d-f52d-493a-ba30-7a09ea42dd70 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:47.988365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362a850d-f52d-493a-ba30-7a09ea42dd70 service placement] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:47.994047 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6d52fb-99d5-4a75-8921-ae4fe5d6f2ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918c4a8c6a64812b61fc235ab8e7bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:47.994706 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d52fb-99d5-4a75-8921-ae4fe5d6f2ba service swift] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:47.995391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d52fb-99d5-4a75-8921-ae4fe5d6f2ba service swift] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:47.995391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6d52fb-99d5-4a75-8921-ae4fe5d6f2ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:48.004471 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d52fb-99d5-4a75-8921-ae4fe5d6f2ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:48.006109 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6d52fb-99d5-4a75-8921-ae4fe5d6f2ba service swift] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:48.014479 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1149/2300] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 00:29:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:29:51.417033 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abcac2-a8a5-4da5-aa20-efe88634d18f None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:51.423274 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-19abcac2-a8a5-4da5-aa20-efe88634d18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:51.548297 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19abcac2-a8a5-4da5-aa20-efe88634d18f None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:51.553029 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a91a72-eeed-4f78-9bff-81c725e52e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:51.553915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a91a72-eeed-4f78-9bff-81c725e52e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:51.554347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a91a72-eeed-4f78-9bff-81c725e52e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:51.554623 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a91a72-eeed-4f78-9bff-81c725e52e8c admin admin] PATH_INFO: `/v3/users/712da8e50d454b10929c268420b76314` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:51.555888 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a91a72-eeed-4f78-9bff-81c725e52e8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=712da8e50d454b10929c268420b76314)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:51.557844 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a91a72-eeed-4f78-9bff-81c725e52e8c admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:51.609531 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-b8a91a72-eeed-4f78-9bff-81c725e52e8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '712da8e50d454b10929c268420b76314'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:51.617472 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-b8a91a72-eeed-4f78-9bff-81c725e52e8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '712da8e50d454b10929c268420b76314'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:51.618298 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-b8a91a72-eeed-4f78-9bff-81c725e52e8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '712da8e50d454b10929c268420b76314'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:51.618922 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-b8a91a72-eeed-4f78-9bff-81c725e52e8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '712da8e50d454b10929c268420b76314'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:51.623678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:51.634479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-b8a91a72-eeed-4f78-9bff-81c725e52e8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '712da8e50d454b10929c268420b76314'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:51.647333 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1152/2301] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:29:51 2022] DELETE /identity/v3/users/712da8e50d454b10929c268420b76314 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:51.652151 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70491c-d1f7-4fbd-8256-d29d9da0b946 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:51.652654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70491c-d1f7-4fbd-8256-d29d9da0b946 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:51.652769 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70491c-d1f7-4fbd-8256-d29d9da0b946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:51.671175 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-1f70491c-d1f7-4fbd-8256-d29d9da0b946 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:51.672447 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-1f70491c-d1f7-4fbd-8256-d29d9da0b946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:51.742479 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1150/2302] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:29:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:51.752507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a91a72-eeed-4f78-9bff-81c725e52e8c admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:51.753943 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-b8a91a72-eeed-4f78-9bff-81c725e52e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:51.824549 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a91a72-eeed-4f78-9bff-81c725e52e8c admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:51.828457 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b57224-0be6-43e0-ae98-283df86c622c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:51.829111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b57224-0be6-43e0-ae98-283df86c622c service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:51.829400 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b57224-0be6-43e0-ae98-283df86c622c service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:51.829680 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b57224-0be6-43e0-ae98-283df86c622c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:51.839172 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b57224-0be6-43e0-ae98-283df86c622c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:51.840669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b57224-0be6-43e0-ae98-283df86c622c service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:51.850407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1153/2303] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:29:52.143288 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70491c-d1f7-4fbd-8256-d29d9da0b946 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:52.144962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-1f70491c-d1f7-4fbd-8256-d29d9da0b946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:52.164628 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70491c-d1f7-4fbd-8256-d29d9da0b946 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:52.171041 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561226f5-8858-419a-9726-66fa1a7ff617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:52.172009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561226f5-8858-419a-9726-66fa1a7ff617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:52.172309 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561226f5-8858-419a-9726-66fa1a7ff617 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:52.172575 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561226f5-8858-419a-9726-66fa1a7ff617 admin admin] PATH_INFO: `/v3/projects/090da9dca94046758b603599f60681bc` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:52.174280 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561226f5-8858-419a-9726-66fa1a7ff617 admin admin] RBAC: Authorizing `identity:delete_project(project_id=090da9dca94046758b603599f60681bc)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:52.177353 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561226f5-8858-419a-9726-66fa1a7ff617 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:52.238898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-561226f5-8858-419a-9726-66fa1a7ff617 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '090da9dca94046758b603599f60681bc', 'request_id': 'req-561226f5-8858-419a-9726-66fa1a7ff617'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:52.245439 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-561226f5-8858-419a-9726-66fa1a7ff617 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '090da9dca94046758b603599f60681bc', 'request_id': 'req-561226f5-8858-419a-9726-66fa1a7ff617'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:52.253379 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-561226f5-8858-419a-9726-66fa1a7ff617 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '090da9dca94046758b603599f60681bc', 'request_id': 'req-561226f5-8858-419a-9726-66fa1a7ff617'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:52.257125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:52.285837 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-561226f5-8858-419a-9726-66fa1a7ff617 admin admin] The token cache is being invalidate because project 090da9dca94046758b603599f60681bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:29:52.286131 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-561226f5-8858-419a-9726-66fa1a7ff617 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:52.289513 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-561226f5-8858-419a-9726-66fa1a7ff617 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:29:52.297381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d48604-59a1-4dbd-99aa-fdfe99a284d1 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:52.298824 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d48604-59a1-4dbd-99aa-fdfe99a284d1 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:52.299285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d48604-59a1-4dbd-99aa-fdfe99a284d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:52.300976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1151/2304] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:29:52 2022] DELETE /identity/v3/projects/090da9dca94046758b603599f60681bc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:52.339663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-e2d48604-59a1-4dbd-99aa-fdfe99a284d1 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:52.339663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-e2d48604-59a1-4dbd-99aa-fdfe99a284d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:52.458708 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1154/2305] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:52.471535 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed84701-db69-45eb-966b-89da29f18252 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:52.471918 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed84701-db69-45eb-966b-89da29f18252 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:52.472245 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed84701-db69-45eb-966b-89da29f18252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:52.492163 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-bed84701-db69-45eb-966b-89da29f18252 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:52.493382 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-bed84701-db69-45eb-966b-89da29f18252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:52.503328 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1152/2306] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:52.507536 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d48604-59a1-4dbd-99aa-fdfe99a284d1 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:52.518047 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d48604-59a1-4dbd-99aa-fdfe99a284d1 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:52.523008 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc4489-ef92-4235-82ce-fee4b54ff25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:52.523897 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc4489-ef92-4235-82ce-fee4b54ff25c admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:52.524249 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc4489-ef92-4235-82ce-fee4b54ff25c admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:52.525020 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bc4489-ef92-4235-82ce-fee4b54ff25c admin admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:52.525334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc4489-ef92-4235-82ce-fee4b54ff25c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:29:52.525648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc4489-ef92-4235-82ce-fee4b54ff25c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:52.527265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bc4489-ef92-4235-82ce-fee4b54ff25c admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:52.543490 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1155/2307] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:29:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:29:52.544622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed84701-db69-45eb-966b-89da29f18252 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:52.556405 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed84701-db69-45eb-966b-89da29f18252 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:52.562156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01b1d8-5219-400f-98ca-f47dfd1ab46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:52.562960 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01b1d8-5219-400f-98ca-f47dfd1ab46e admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:52.563353 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01b1d8-5219-400f-98ca-f47dfd1ab46e admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:52.563778 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e01b1d8-5219-400f-98ca-f47dfd1ab46e admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:52.564751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01b1d8-5219-400f-98ca-f47dfd1ab46e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:52.566989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e01b1d8-5219-400f-98ca-f47dfd1ab46e admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:52.605822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1153/2308] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:29:52 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:29:52.606896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc4489-ef92-4235-82ce-fee4b54ff25c admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:52.620586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bc4489-ef92-4235-82ce-fee4b54ff25c admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:52.702832 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425309a-5e8d-4fd8-b64a-f4e39eae19e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:52.703729 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425309a-5e8d-4fd8-b64a-f4e39eae19e9 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:52.704132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425309a-5e8d-4fd8-b64a-f4e39eae19e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:52.704504 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1425309a-5e8d-4fd8-b64a-f4e39eae19e9 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:52.705345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425309a-5e8d-4fd8-b64a-f4e39eae19e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:52.707434 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1425309a-5e8d-4fd8-b64a-f4e39eae19e9 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:52.723329 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:52.739646 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1156/2309] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:29:52 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:29:52.744825 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01b1d8-5219-400f-98ca-f47dfd1ab46e admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:52.759178 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e01b1d8-5219-400f-98ca-f47dfd1ab46e admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:52.766212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e447d-8023-4d44-ad59-30eaf6c74dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:52.766975 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e447d-8023-4d44-ad59-30eaf6c74dfb admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:52.767342 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e447d-8023-4d44-ad59-30eaf6c74dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:52.767734 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487e447d-8023-4d44-ad59-30eaf6c74dfb admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:52.768551 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e447d-8023-4d44-ad59-30eaf6c74dfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:52.770272 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487e447d-8023-4d44-ad59-30eaf6c74dfb admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:52.786403 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1154/2310] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:52.790429 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425309a-5e8d-4fd8-b64a-f4e39eae19e9 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:52.807271 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1425309a-5e8d-4fd8-b64a-f4e39eae19e9 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:52.813648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda0f0ec-e100-47b0-9d16-f0f1e371938a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:52.814399 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0f0ec-e100-47b0-9d16-f0f1e371938a admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:52.814769 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0f0ec-e100-47b0-9d16-f0f1e371938a admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:52.815160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda0f0ec-e100-47b0-9d16-f0f1e371938a admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:52.819177 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0f0ec-e100-47b0-9d16-f0f1e371938a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:52.819177 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda0f0ec-e100-47b0-9d16-f0f1e371938a admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:52.831291 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1157/2311] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:52 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:52.835365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e447d-8023-4d44-ad59-30eaf6c74dfb admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:52.852734 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487e447d-8023-4d44-ad59-30eaf6c74dfb admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:52.860793 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4668837-a9a1-40b5-bd3b-fbbe3f63acdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:52.862053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4668837-a9a1-40b5-bd3b-fbbe3f63acdf admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:52.862350 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4668837-a9a1-40b5-bd3b-fbbe3f63acdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:52.862764 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4668837-a9a1-40b5-bd3b-fbbe3f63acdf admin admin] PATH_INFO: `/v3/projects/c645f5673fe144de9432ba22b7d5ae87/users/cff74fa58ac342228f9f5235347bf6bb/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:52.885460 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4668837-a9a1-40b5-bd3b-fbbe3f63acdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=c645f5673fe144de9432ba22b7d5ae87, user_id=cff74fa58ac342228f9f5235347bf6bb, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:52.888251 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4668837-a9a1-40b5-bd3b-fbbe3f63acdf admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:52.907177 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1155/2312] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:29:52 2022] PUT /identity/v3/projects/c645f5673fe144de9432ba22b7d5ae87/users/cff74fa58ac342228f9f5235347bf6bb/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:52.912254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae14029-dfd8-4ed1-81c9-9088ea747c32 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:52.912550 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae14029-dfd8-4ed1-81c9-9088ea747c32 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:52.912856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae14029-dfd8-4ed1-81c9-9088ea747c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:52.931829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-0ae14029-dfd8-4ed1-81c9-9088ea747c32 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:52.935422 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-0ae14029-dfd8-4ed1-81c9-9088ea747c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:53.007861 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1158/2313] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:53.014239 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4668837-a9a1-40b5-bd3b-fbbe3f63acdf admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:53.016729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d4668837-a9a1-40b5-bd3b-fbbe3f63acdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:53.092613 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4668837-a9a1-40b5-bd3b-fbbe3f63acdf admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:53.097585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76014d11-c7f8-4fcd-aa81-ac523757abfb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:53.098545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76014d11-c7f8-4fcd-aa81-ac523757abfb service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:53.098833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76014d11-c7f8-4fcd-aa81-ac523757abfb service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:53.099117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76014d11-c7f8-4fcd-aa81-ac523757abfb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:53.109852 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76014d11-c7f8-4fcd-aa81-ac523757abfb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:53.111739 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76014d11-c7f8-4fcd-aa81-ac523757abfb service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:53.122636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1156/2314] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:29:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:29:58.368674 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf8319-22fd-424e-b6a5-b2fe302dc3d1 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:58.369312 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf8319-22fd-424e-b6a5-b2fe302dc3d1 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:58.369312 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf8319-22fd-424e-b6a5-b2fe302dc3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:58.413429 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-74cf8319-22fd-424e-b6a5-b2fe302dc3d1 None None] MFA Rules not processed for user `cff74fa58ac342228f9f5235347bf6bb`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:29:58.415954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-74cf8319-22fd-424e-b6a5-b2fe302dc3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:29:58.525207 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1159/2315] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:29:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:29:58.530925 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76014d11-c7f8-4fcd-aa81-ac523757abfb service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:58.568848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76014d11-c7f8-4fcd-aa81-ac523757abfb service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:58.589872 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a794962-bbdf-448c-b0cd-f80fb1afc21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:58.590541 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a794962-bbdf-448c-b0cd-f80fb1afc21b admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:58.591089 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a794962-bbdf-448c-b0cd-f80fb1afc21b admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:58.591374 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a794962-bbdf-448c-b0cd-f80fb1afc21b admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:58.592124 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a794962-bbdf-448c-b0cd-f80fb1afc21b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:58.597433 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a794962-bbdf-448c-b0cd-f80fb1afc21b admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:58.652197 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1157/2316] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:29:58 2022] POST /identity/v3/projects => generated 369 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:29:58.653606 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf8319-22fd-424e-b6a5-b2fe302dc3d1 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:58.668506 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cf8319-22fd-424e-b6a5-b2fe302dc3d1 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:58.793774 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26104420-9957-415f-a679-79af346fda0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:58.798350 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26104420-9957-415f-a679-79af346fda0c admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:58.799886 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26104420-9957-415f-a679-79af346fda0c admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:58.800283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26104420-9957-415f-a679-79af346fda0c admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:58.803245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26104420-9957-415f-a679-79af346fda0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:58.808657 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26104420-9957-415f-a679-79af346fda0c admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:58.864246 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1160/2317] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:29:58 2022] POST /identity/v3/users => generated 291 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:29:58.865674 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a794962-bbdf-448c-b0cd-f80fb1afc21b admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:58.878505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a794962-bbdf-448c-b0cd-f80fb1afc21b admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:58.883711 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfffe1d-e001-462b-9ac2-aced18a9a603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:58.884386 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfffe1d-e001-462b-9ac2-aced18a9a603 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:58.884671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfffe1d-e001-462b-9ac2-aced18a9a603 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:58.884950 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfffe1d-e001-462b-9ac2-aced18a9a603 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:58.885830 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfffe1d-e001-462b-9ac2-aced18a9a603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:58.888710 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfffe1d-e001-462b-9ac2-aced18a9a603 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:58.908759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1158/2318] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:58.912605 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26104420-9957-415f-a679-79af346fda0c admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:58.940089 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:58.943973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26104420-9957-415f-a679-79af346fda0c admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:58.954728 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993addd-0b75-443a-8ddb-54edad4a5b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:58.955838 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993addd-0b75-443a-8ddb-54edad4a5b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:58.956677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993addd-0b75-443a-8ddb-54edad4a5b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:58.957077 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7993addd-0b75-443a-8ddb-54edad4a5b80 admin admin] PATH_INFO: `/v3/projects/e2820d95b7c14841a71444c5f3890d0d/users/264967946cd04a869b83f112622ec140/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:58.977032 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993addd-0b75-443a-8ddb-54edad4a5b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2820d95b7c14841a71444c5f3890d0d, user_id=264967946cd04a869b83f112622ec140, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:58.980790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7993addd-0b75-443a-8ddb-54edad4a5b80 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:59.012197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1161/2319] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:29:58 2022] PUT /identity/v3/projects/e2820d95b7c14841a71444c5f3890d0d/users/264967946cd04a869b83f112622ec140/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:29:59.016885 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfffe1d-e001-462b-9ac2-aced18a9a603 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:59.028628 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfffe1d-e001-462b-9ac2-aced18a9a603 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:59.098400 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad67ab7-9982-4be3-a2f3-6b56e821d070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:59.099092 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad67ab7-9982-4be3-a2f3-6b56e821d070 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:59.099384 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad67ab7-9982-4be3-a2f3-6b56e821d070 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:59.099751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad67ab7-9982-4be3-a2f3-6b56e821d070 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:59.100676 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad67ab7-9982-4be3-a2f3-6b56e821d070 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:59.102649 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad67ab7-9982-4be3-a2f3-6b56e821d070 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:59.109867 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:29:59.117439 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1159/2320] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:29:59 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:29:59.120900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993addd-0b75-443a-8ddb-54edad4a5b80 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:29:59.134900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7993addd-0b75-443a-8ddb-54edad4a5b80 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:29:59.145993 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fec8b2-6414-43d8-9a5b-c169508ca007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:29:59.147049 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fec8b2-6414-43d8-9a5b-c169508ca007 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:29:59.147345 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fec8b2-6414-43d8-9a5b-c169508ca007 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:29:59.147660 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fec8b2-6414-43d8-9a5b-c169508ca007 admin admin] PATH_INFO: `/v3/projects/e2820d95b7c14841a71444c5f3890d0d/users/264967946cd04a869b83f112622ec140/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:29:59.149720 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fec8b2-6414-43d8-9a5b-c169508ca007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2820d95b7c14841a71444c5f3890d0d, user_id=264967946cd04a869b83f112622ec140, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:29:59.152527 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fec8b2-6414-43d8-9a5b-c169508ca007 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:29:59.166752 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1162/2321] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:29:59 2022] PUT /identity/v3/projects/e2820d95b7c14841a71444c5f3890d0d/users/264967946cd04a869b83f112622ec140/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:00.533610 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad67ab7-9982-4be3-a2f3-6b56e821d070 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:00.535876 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-0ad67ab7-9982-4be3-a2f3-6b56e821d070 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:00.620852 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad67ab7-9982-4be3-a2f3-6b56e821d070 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:00.746435 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c8234-444d-44e3-82fc-b44260a61080 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:00.747188 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c8234-444d-44e3-82fc-b44260a61080 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:00.747678 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c8234-444d-44e3-82fc-b44260a61080 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:00.748234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c8234-444d-44e3-82fc-b44260a61080 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:00.752788 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-ee7c8234-444d-44e3-82fc-b44260a61080 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:00.937464 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c8234-444d-44e3-82fc-b44260a61080 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:00.940840 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c8234-444d-44e3-82fc-b44260a61080 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:00.983067 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1160/2322] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:07.279403 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fec8b2-6414-43d8-9a5b-c169508ca007 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:07.282321 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-05fec8b2-6414-43d8-9a5b-c169508ca007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:07.529076 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fec8b2-6414-43d8-9a5b-c169508ca007 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:07.561514 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4898b8-000c-4ee2-8cd4-43ece55c7c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:07.562658 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4898b8-000c-4ee2-8cd4-43ece55c7c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:07.565528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4898b8-000c-4ee2-8cd4-43ece55c7c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:07.565987 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4898b8-000c-4ee2-8cd4-43ece55c7c57 admin admin] PATH_INFO: `/v3/users/4a469a9e4478483297bb1f8d64f7b894` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:07.568534 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4898b8-000c-4ee2-8cd4-43ece55c7c57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a469a9e4478483297bb1f8d64f7b894)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:07.579479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4898b8-000c-4ee2-8cd4-43ece55c7c57 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:07.803486 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-9d4898b8-000c-4ee2-8cd4-43ece55c7c57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a469a9e4478483297bb1f8d64f7b894'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.835275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-9d4898b8-000c-4ee2-8cd4-43ece55c7c57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a469a9e4478483297bb1f8d64f7b894'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.836225 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-9d4898b8-000c-4ee2-8cd4-43ece55c7c57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a469a9e4478483297bb1f8d64f7b894'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.837092 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-9d4898b8-000c-4ee2-8cd4-43ece55c7c57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a469a9e4478483297bb1f8d64f7b894'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.866618 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-9d4898b8-000c-4ee2-8cd4-43ece55c7c57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a469a9e4478483297bb1f8d64f7b894'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:07.906999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1163/2323] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:30:07 2022] DELETE /identity/v3/users/4a469a9e4478483297bb1f8d64f7b894 => generated 0 bytes in 625 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:07.909162 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174cd19-2215-4678-a169-396f5ba8bf05 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:07.910073 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174cd19-2215-4678-a169-396f5ba8bf05 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:07.910521 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5174cd19-2215-4678-a169-396f5ba8bf05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:07.918076 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e537b30-04b4-4697-b7e9-ee0f6e511a1e None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:07.919482 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e537b30-04b4-4697-b7e9-ee0f6e511a1e None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:07.919774 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e537b30-04b4-4697-b7e9-ee0f6e511a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:07.956753 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-5174cd19-2215-4678-a169-396f5ba8bf05 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:07.958423 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-5174cd19-2215-4678-a169-396f5ba8bf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:07.989592 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-8e537b30-04b4-4697-b7e9-ee0f6e511a1e None None] MFA Rules not processed for user `264967946cd04a869b83f112622ec140`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:07.990748 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-8e537b30-04b4-4697-b7e9-ee0f6e511a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:08.056215 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1161/2324] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:30:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:30:08.066263 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174cd19-2215-4678-a169-396f5ba8bf05 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:08.068016 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-5174cd19-2215-4678-a169-396f5ba8bf05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:08.074100 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:08.085376 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:08.152696 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5174cd19-2215-4678-a169-396f5ba8bf05 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:08.158298 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b26346-28c4-439e-a248-57696bdd386a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:08.159200 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b26346-28c4-439e-a248-57696bdd386a service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:08.159704 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b26346-28c4-439e-a248-57696bdd386a service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:08.160791 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b26346-28c4-439e-a248-57696bdd386a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:08.182315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b26346-28c4-439e-a248-57696bdd386a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:08.184263 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b26346-28c4-439e-a248-57696bdd386a service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:08.195311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1164/2325] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:30:07 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:08.196383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1162/2326] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:30:08.216098 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e537b30-04b4-4697-b7e9-ee0f6e511a1e None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:08.223804 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-8e537b30-04b4-4697-b7e9-ee0f6e511a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:08.428573 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e537b30-04b4-4697-b7e9-ee0f6e511a1e None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:08.456829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d35eb-08db-4980-9ab7-24b367dd4126 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:08.459795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d35eb-08db-4980-9ab7-24b367dd4126 service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:08.460455 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d35eb-08db-4980-9ab7-24b367dd4126 service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:08.462535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d35eb-08db-4980-9ab7-24b367dd4126 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:08.470904 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-9c5d35eb-08db-4980-9ab7-24b367dd4126 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:08.588778 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d35eb-08db-4980-9ab7-24b367dd4126 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:08.590528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5d35eb-08db-4980-9ab7-24b367dd4126 service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:08.604272 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1165/2327] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:30:09.191955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b26346-28c4-439e-a248-57696bdd386a service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:09.193632 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-32b26346-28c4-439e-a248-57696bdd386a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:09.244949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b26346-28c4-439e-a248-57696bdd386a service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:09.260313 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2931c7b-6b72-45aa-8409-d5b99e8c0987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:09.262043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2931c7b-6b72-45aa-8409-d5b99e8c0987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:09.262354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2931c7b-6b72-45aa-8409-d5b99e8c0987 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:09.264256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2931c7b-6b72-45aa-8409-d5b99e8c0987 admin admin] PATH_INFO: `/v3/projects/7de4a15836cf4757b2dda2b5eda39289` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:09.268269 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2931c7b-6b72-45aa-8409-d5b99e8c0987 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7de4a15836cf4757b2dda2b5eda39289)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:09.270659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2931c7b-6b72-45aa-8409-d5b99e8c0987 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:09.380611 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a2931c7b-6b72-45aa-8409-d5b99e8c0987 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7de4a15836cf4757b2dda2b5eda39289', 'request_id': 'req-a2931c7b-6b72-45aa-8409-d5b99e8c0987'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:09.397750 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a2931c7b-6b72-45aa-8409-d5b99e8c0987 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7de4a15836cf4757b2dda2b5eda39289', 'request_id': 'req-a2931c7b-6b72-45aa-8409-d5b99e8c0987'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:09.410587 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a2931c7b-6b72-45aa-8409-d5b99e8c0987 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7de4a15836cf4757b2dda2b5eda39289', 'request_id': 'req-a2931c7b-6b72-45aa-8409-d5b99e8c0987'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:09.435181 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a2931c7b-6b72-45aa-8409-d5b99e8c0987 admin admin] The token cache is being invalidate because project 7de4a15836cf4757b2dda2b5eda39289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:30:09.435812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a2931c7b-6b72-45aa-8409-d5b99e8c0987 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:09.436929 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a2931c7b-6b72-45aa-8409-d5b99e8c0987 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:09.441914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1163/2328] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:30:09 2022] DELETE /identity/v3/projects/7de4a15836cf4757b2dda2b5eda39289 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:10.590574 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e0107-b7be-4be8-b7e3-8b73d9944ea3 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:10.591030 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e0107-b7be-4be8-b7e3-8b73d9944ea3 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:10.591131 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03e0107-b7be-4be8-b7e3-8b73d9944ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:10.612454 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-e03e0107-b7be-4be8-b7e3-8b73d9944ea3 None None] MFA Rules not processed for user `cff74fa58ac342228f9f5235347bf6bb`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:10.616340 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-e03e0107-b7be-4be8-b7e3-8b73d9944ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:10.686146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:10.706725 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1166/2329] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:30:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:14.736777 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cb22e-2043-4cfd-a8f7-1d9c9bab9839 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:14.737258 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cb22e-2043-4cfd-a8f7-1d9c9bab9839 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:14.737365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650cb22e-2043-4cfd-a8f7-1d9c9bab9839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:14.757948 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-650cb22e-2043-4cfd-a8f7-1d9c9bab9839 None None] MFA Rules not processed for user `39bbc5ff02d24f40b796bd2245a7431a`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:14.759536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-650cb22e-2043-4cfd-a8f7-1d9c9bab9839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:14.816107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1164/2330] 10.222.0.44 () {58 vars in 967 bytes} [Thu Jun 16 00:30:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:14.829130 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e0107-b7be-4be8-b7e3-8b73d9944ea3 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:14.830533 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-e03e0107-b7be-4be8-b7e3-8b73d9944ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:14.902143 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03e0107-b7be-4be8-b7e3-8b73d9944ea3 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:14.907785 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd0cd8-d8e4-4c11-9552-9e1abe3cbad8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918c4a8c6a64812b61fc235ab8e7bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:14.908433 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd0cd8-d8e4-4c11-9552-9e1abe3cbad8 service swift] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:14.908719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd0cd8-d8e4-4c11-9552-9e1abe3cbad8 service swift] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:14.908996 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fd0cd8-d8e4-4c11-9552-9e1abe3cbad8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:14.917179 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd0cd8-d8e4-4c11-9552-9e1abe3cbad8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:14.918781 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fd0cd8-d8e4-4c11-9552-9e1abe3cbad8 service swift] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:14.926689 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1167/2331] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 00:30:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:30:16.880958 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650cb22e-2043-4cfd-a8f7-1d9c9bab9839 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:16.882458 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-650cb22e-2043-4cfd-a8f7-1d9c9bab9839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:16.919253 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:16.959869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650cb22e-2043-4cfd-a8f7-1d9c9bab9839 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:16.964678 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf9e0f7-1c66-4e51-9939-8df9f6d8f142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:16.965583 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9e0f7-1c66-4e51-9939-8df9f6d8f142 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:16.965876 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9e0f7-1c66-4e51-9939-8df9f6d8f142 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:16.966155 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf9e0f7-1c66-4e51-9939-8df9f6d8f142 admin admin] PATH_INFO: `/v3/users/4cca20d97f474e52bf6581a6a8c57670` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:16.967429 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9e0f7-1c66-4e51-9939-8df9f6d8f142 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4cca20d97f474e52bf6581a6a8c57670)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:16.969553 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf9e0f7-1c66-4e51-9939-8df9f6d8f142 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:17.022076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-dbf9e0f7-1c66-4e51-9939-8df9f6d8f142 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4cca20d97f474e52bf6581a6a8c57670'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:17.030189 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-dbf9e0f7-1c66-4e51-9939-8df9f6d8f142 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4cca20d97f474e52bf6581a6a8c57670'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:17.030960 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-dbf9e0f7-1c66-4e51-9939-8df9f6d8f142 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4cca20d97f474e52bf6581a6a8c57670'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:17.043875 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-dbf9e0f7-1c66-4e51-9939-8df9f6d8f142 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4cca20d97f474e52bf6581a6a8c57670'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:17.044557 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-dbf9e0f7-1c66-4e51-9939-8df9f6d8f142 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4cca20d97f474e52bf6581a6a8c57670'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:17.058053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1165/2332] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:30:16 2022] DELETE /identity/v3/users/4cca20d97f474e52bf6581a6a8c57670 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:17.241340 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd0cd8-d8e4-4c11-9552-9e1abe3cbad8 service swift] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:17.253548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fd0cd8-d8e4-4c11-9552-9e1abe3cbad8 service swift] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:17.314443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af6034-476f-487b-9eb6-f9cb9d8be082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:17.315306 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af6034-476f-487b-9eb6-f9cb9d8be082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:17.315592 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af6034-476f-487b-9eb6-f9cb9d8be082 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:17.315975 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91af6034-476f-487b-9eb6-f9cb9d8be082 admin admin] PATH_INFO: `/v3/projects/572e79ce0a7c49b784aa301e367a176b` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:17.317191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af6034-476f-487b-9eb6-f9cb9d8be082 admin admin] RBAC: Authorizing `identity:delete_project(project_id=572e79ce0a7c49b784aa301e367a176b)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:17.319112 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91af6034-476f-487b-9eb6-f9cb9d8be082 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:17.370834 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-91af6034-476f-487b-9eb6-f9cb9d8be082 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '572e79ce0a7c49b784aa301e367a176b', 'request_id': 'req-91af6034-476f-487b-9eb6-f9cb9d8be082'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:17.377535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-91af6034-476f-487b-9eb6-f9cb9d8be082 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '572e79ce0a7c49b784aa301e367a176b', 'request_id': 'req-91af6034-476f-487b-9eb6-f9cb9d8be082'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:17.383840 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-91af6034-476f-487b-9eb6-f9cb9d8be082 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '572e79ce0a7c49b784aa301e367a176b', 'request_id': 'req-91af6034-476f-487b-9eb6-f9cb9d8be082'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:17.396239 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-91af6034-476f-487b-9eb6-f9cb9d8be082 admin admin] The token cache is being invalidate because project 572e79ce0a7c49b784aa301e367a176b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:30:17.396516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-91af6034-476f-487b-9eb6-f9cb9d8be082 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:17.397145 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-91af6034-476f-487b-9eb6-f9cb9d8be082 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:30:17.398696 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1168/2333] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:30:17 2022] DELETE /identity/v3/projects/572e79ce0a7c49b784aa301e367a176b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:30:27.054321 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=38,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:27.393208 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:30:53.059942 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c618be1-a698-49a4-9ec9-14f064cd0d9a None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:53.060464 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c618be1-a698-49a4-9ec9-14f064cd0d9a None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:53.060573 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c618be1-a698-49a4-9ec9-14f064cd0d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:53.078595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-0c618be1-a698-49a4-9ec9-14f064cd0d9a None None] MFA Rules not processed for user `f0c5a5705f34440abce48190674a76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:30:53.079914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-0c618be1-a698-49a4-9ec9-14f064cd0d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:53.147857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1166/2334] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:30:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:30:56.527009 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af6034-476f-487b-9eb6-f9cb9d8be082 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:30:56.528794 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-91af6034-476f-487b-9eb6-f9cb9d8be082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:56.593004 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91af6034-476f-487b-9eb6-f9cb9d8be082 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:30:56.596666 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3451e-9013-49c0-90b5-8a99ebe9fc78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:30:56.597351 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3451e-9013-49c0-90b5-8a99ebe9fc78 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:30:56.597638 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3451e-9013-49c0-90b5-8a99ebe9fc78 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:30:56.597944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3451e-9013-49c0-90b5-8a99ebe9fc78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:30:56.599798 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-27b3451e-9013-49c0-90b5-8a99ebe9fc78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:30:56.665202 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3451e-9013-49c0-90b5-8a99ebe9fc78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:30:56.666872 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b3451e-9013-49c0-90b5-8a99ebe9fc78 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:30:56.676761 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1169/2335] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:30:56 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:31:02.421612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01328cab-c63e-49f2-808f-40b3b02e1a3b None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:02.422128 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01328cab-c63e-49f2-808f-40b3b02e1a3b None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:02.422241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01328cab-c63e-49f2-808f-40b3b02e1a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:02.440449 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-01328cab-c63e-49f2-808f-40b3b02e1a3b None None] MFA Rules not processed for user `39bbc5ff02d24f40b796bd2245a7431a`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:02.441689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-01328cab-c63e-49f2-808f-40b3b02e1a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:02.507865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1167/2336] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 00:31:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:02.530199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3451e-9013-49c0-90b5-8a99ebe9fc78 service neutron] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:02.531760 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-27b3451e-9013-49c0-90b5-8a99ebe9fc78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:02.602459 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b3451e-9013-49c0-90b5-8a99ebe9fc78 service neutron] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:02.607720 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784870f-a2ad-41f1-889e-d82e17e7812e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918c4a8c6a64812b61fc235ab8e7bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:02.609039 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784870f-a2ad-41f1-889e-d82e17e7812e service swift] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:02.609329 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784870f-a2ad-41f1-889e-d82e17e7812e service swift] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:02.609646 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784870f-a2ad-41f1-889e-d82e17e7812e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:02.618297 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784870f-a2ad-41f1-889e-d82e17e7812e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:02.619938 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784870f-a2ad-41f1-889e-d82e17e7812e service swift] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:02.628891 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1170/2337] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 00:31:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:31:08.197577 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01328cab-c63e-49f2-808f-40b3b02e1a3b None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:08.198140 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784870f-a2ad-41f1-889e-d82e17e7812e service swift] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:08.209112 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784870f-a2ad-41f1-889e-d82e17e7812e service swift] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:08.209306 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01328cab-c63e-49f2-808f-40b3b02e1a3b None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:08.213509 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b29eb31-1eb9-4d92-b678-90c8707f8906 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:08.214095 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29eb31-1eb9-4d92-b678-90c8707f8906 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:08.214549 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29eb31-1eb9-4d92-b678-90c8707f8906 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:08.215317 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b29eb31-1eb9-4d92-b678-90c8707f8906 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:08.216895 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-2b29eb31-1eb9-4d92-b678-90c8707f8906 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:08.217870 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a3a01-4cb1-48d5-921f-bde99096e2b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:08.219990 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a3a01-4cb1-48d5-921f-bde99096e2b3 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:08.220372 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a3a01-4cb1-48d5-921f-bde99096e2b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:08.220795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a3a01-4cb1-48d5-921f-bde99096e2b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:08.225225 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-fb5a3a01-4cb1-48d5-921f-bde99096e2b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:08.292578 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:08.304953 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b29eb31-1eb9-4d92-b678-90c8707f8906 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:08.309191 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b29eb31-1eb9-4d92-b678-90c8707f8906 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:08.335559 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1168/2338] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:08.339950 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a3a01-4cb1-48d5-921f-bde99096e2b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:08.341499 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a3a01-4cb1-48d5-921f-bde99096e2b3 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:08.354602 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1171/2339] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:31:17.590122 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33643819-987c-4a06-9552-fe1b5eb09023 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:17.590702 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33643819-987c-4a06-9552-fe1b5eb09023 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:17.590804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33643819-987c-4a06-9552-fe1b5eb09023 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:17.592447 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1169/2340] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 16 00:31:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:31:17.598765 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f951d6-db1e-45f3-b73a-ac3f2f2fe4d5 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:17.599231 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f951d6-db1e-45f3-b73a-ac3f2f2fe4d5 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:17.599459 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f951d6-db1e-45f3-b73a-ac3f2f2fe4d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:17.636165 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-48f951d6-db1e-45f3-b73a-ac3f2f2fe4d5 None None] MFA Rules not processed for user `40432493f16b4df681daf5a1af87832a`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:17.637510 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-48f951d6-db1e-45f3-b73a-ac3f2f2fe4d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:17.648013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1172/2341] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 16 00:31:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:17.659286 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33643819-987c-4a06-9552-fe1b5eb09023 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:17.661572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-33643819-987c-4a06-9552-fe1b5eb09023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:17.665936 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=85 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:17.744042 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33643819-987c-4a06-9552-fe1b5eb09023 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:17.747557 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74065d99-05d0-4e7e-8729-aa7875d12dba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faaab5440b7041faa5a6f9ea18c188c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:17.748234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74065d99-05d0-4e7e-8729-aa7875d12dba service glance] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:17.749055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74065d99-05d0-4e7e-8729-aa7875d12dba service glance] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:17.749335 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74065d99-05d0-4e7e-8729-aa7875d12dba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:17.759363 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74065d99-05d0-4e7e-8729-aa7875d12dba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:17.760821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74065d99-05d0-4e7e-8729-aa7875d12dba service glance] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:17.772303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1170/2342] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:17.837878 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381eec16-25c6-402c-8220-ee11da3e15bb None None] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:17.838090 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381eec16-25c6-402c-8220-ee11da3e15bb None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:17.838374 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381eec16-25c6-402c-8220-ee11da3e15bb None None] PATH_INFO: `/` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:17.839837 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1173/2343] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 16 00:31:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:31:17.844675 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8dfb2-cb93-455b-b2d6-073c21dfee7d None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:17.844969 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8dfb2-cb93-455b-b2d6-073c21dfee7d None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:17.845266 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f8dfb2-cb93-455b-b2d6-073c21dfee7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:17.863757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-41f8dfb2-cb93-455b-b2d6-073c21dfee7d None None] MFA Rules not processed for user `222e3db424f0476386bc3432cc0f868e`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:17.864957 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-41f8dfb2-cb93-455b-b2d6-073c21dfee7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:17.872220 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1171/2344] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 16 00:31:17 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:31:17.883932 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381eec16-25c6-402c-8220-ee11da3e15bb None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:17.895111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381eec16-25c6-402c-8220-ee11da3e15bb None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:17.898639 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dbf0e0-adf8-4383-a049-4e58b65bba92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:17.899258 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbf0e0-adf8-4383-a049-4e58b65bba92 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:17.899537 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbf0e0-adf8-4383-a049-4e58b65bba92 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:17.899853 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dbf0e0-adf8-4383-a049-4e58b65bba92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:17.906820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbf0e0-adf8-4383-a049-4e58b65bba92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:17.908325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dbf0e0-adf8-4383-a049-4e58b65bba92 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:17.915933 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1174/2345] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:17 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:17.997425 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f773956-5c0a-448b-9f90-5bf89e606df2 None None] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:17.997792 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f773956-5c0a-448b-9f90-5bf89e606df2 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:17.998077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f773956-5c0a-448b-9f90-5bf89e606df2 None None] PATH_INFO: `/` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:18.000199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1172/2346] 10.222.0.44 () {54 vars in 921 bytes} [Thu Jun 16 00:31:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 16 00:31:18.005607 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b470b-ba0f-4b4d-a03d-a4debb27a878 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:18.005900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b470b-ba0f-4b4d-a03d-a4debb27a878 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:18.006180 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b470b-ba0f-4b4d-a03d-a4debb27a878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:18.024112 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-d41b470b-ba0f-4b4d-a03d-a4debb27a878 None None] MFA Rules not processed for user `40432493f16b4df681daf5a1af87832a`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:18.025295 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-d41b470b-ba0f-4b4d-a03d-a4debb27a878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:18.034428 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1175/2347] 10.222.0.44 () {58 vars in 1018 bytes} [Thu Jun 16 00:31:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:18.044958 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f773956-5c0a-448b-9f90-5bf89e606df2 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:18.056648 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f773956-5c0a-448b-9f90-5bf89e606df2 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:18.060429 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a683fdf8-4a31-4ebe-82a9-00973d334cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:18.061594 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683fdf8-4a31-4ebe-82a9-00973d334cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:18.061882 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683fdf8-4a31-4ebe-82a9-00973d334cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:18.062742 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a683fdf8-4a31-4ebe-82a9-00973d334cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:18.073427 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683fdf8-4a31-4ebe-82a9-00973d334cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:18.074861 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a683fdf8-4a31-4ebe-82a9-00973d334cb5 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:18.085667 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1173/2348] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:18.150085 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b470b-ba0f-4b4d-a03d-a4debb27a878 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:18.151500 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-d41b470b-ba0f-4b4d-a03d-a4debb27a878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:18.220397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b470b-ba0f-4b4d-a03d-a4debb27a878 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:18.225544 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279bad8-ba0c-4283-87db-277b89e71771 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9164f14fe6894daba1a9f2d8f1f4929c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:18.226184 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279bad8-ba0c-4283-87db-277b89e71771 service placement] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:18.226470 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279bad8-ba0c-4283-87db-277b89e71771 service placement] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:18.226750 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0279bad8-ba0c-4283-87db-277b89e71771 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:18.228513 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-0279bad8-ba0c-4283-87db-277b89e71771 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:18.240049 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279bad8-ba0c-4283-87db-277b89e71771 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:18.241624 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0279bad8-ba0c-4283-87db-277b89e71771 service placement] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:18.251177 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1176/2349] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:21.546125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d7c8f-7d21-4c65-ad6b-8558b9ea944c None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:21.546583 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d7c8f-7d21-4c65-ad6b-8558b9ea944c None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:21.546683 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d7c8f-7d21-4c65-ad6b-8558b9ea944c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:21.564605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-046d7c8f-7d21-4c65-ad6b-8558b9ea944c None None] MFA Rules not processed for user `39bbc5ff02d24f40b796bd2245a7431a`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:21.565828 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-046d7c8f-7d21-4c65-ad6b-8558b9ea944c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:21.572976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1174/2350] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 00:31:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:21.584503 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279bad8-ba0c-4283-87db-277b89e71771 service placement] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:21.595743 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0279bad8-ba0c-4283-87db-277b89e71771 service placement] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:21.600900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3a17f-e722-4d77-b679-7c8ed75819af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918c4a8c6a64812b61fc235ab8e7bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:21.601553 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3a17f-e722-4d77-b679-7c8ed75819af service swift] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:21.601835 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3a17f-e722-4d77-b679-7c8ed75819af service swift] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:21.602108 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e3a17f-e722-4d77-b679-7c8ed75819af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:21.610583 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3a17f-e722-4d77-b679-7c8ed75819af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:21.612181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e3a17f-e722-4d77-b679-7c8ed75819af service swift] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:21.620047 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1177/2351] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 00:31:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 00:31:22.348039 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d7c8f-7d21-4c65-ad6b-8558b9ea944c None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:22.349875 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-046d7c8f-7d21-4c65-ad6b-8558b9ea944c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:22.366021 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d7c8f-7d21-4c65-ad6b-8558b9ea944c None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:22.371701 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdb704-a480-462d-a0a7-bd44e5dbe2ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:22.372354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdb704-a480-462d-a0a7-bd44e5dbe2ea service nova] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:22.372636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdb704-a480-462d-a0a7-bd44e5dbe2ea service nova] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:22.372911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cdb704-a480-462d-a0a7-bd44e5dbe2ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:22.374740 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-91cdb704-a480-462d-a0a7-bd44e5dbe2ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:22.433636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cdb704-a480-462d-a0a7-bd44e5dbe2ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:22.435286 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91cdb704-a480-462d-a0a7-bd44e5dbe2ea service nova] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:22.444607 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1175/2352] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:22 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:31:23.415190 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3a17f-e722-4d77-b679-7c8ed75819af service swift] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:23.416608 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-95e3a17f-e722-4d77-b679-7c8ed75819af service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:23.432597 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e3a17f-e722-4d77-b679-7c8ed75819af service swift] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:23.438411 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5776abfb-2e62-482f-ad0e-c17f4060c547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:23.439151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776abfb-2e62-482f-ad0e-c17f4060c547 service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:23.439418 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776abfb-2e62-482f-ad0e-c17f4060c547 service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:23.439719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5776abfb-2e62-482f-ad0e-c17f4060c547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:23.441597 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-5776abfb-2e62-482f-ad0e-c17f4060c547 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:23.503662 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776abfb-2e62-482f-ad0e-c17f4060c547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:23.505301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5776abfb-2e62-482f-ad0e-c17f4060c547 service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:23.509835 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:23.514805 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1178/2353] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:23 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:32.440428 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=74 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:38.085695 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdb704-a480-462d-a0a7-bd44e5dbe2ea service nova] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:38.087238 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-91cdb704-a480-462d-a0a7-bd44e5dbe2ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:38.100115 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cdb704-a480-462d-a0a7-bd44e5dbe2ea service nova] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:38.103878 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cc6e8-12b8-4652-b5de-9a1afa180bcb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:38.104521 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cc6e8-12b8-4652-b5de-9a1afa180bcb service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:38.104808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cc6e8-12b8-4652-b5de-9a1afa180bcb service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:38.105086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2cc6e8-12b8-4652-b5de-9a1afa180bcb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:38.106874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-3e2cc6e8-12b8-4652-b5de-9a1afa180bcb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:38.117474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cc6e8-12b8-4652-b5de-9a1afa180bcb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:38.118911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2cc6e8-12b8-4652-b5de-9a1afa180bcb service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:38.127297 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1176/2354] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:31:38 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:31:48.123410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=6 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:31:54.816365 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c2ed7-5d33-4ea1-9c12-59912dbea131 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:54.816861 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c2ed7-5d33-4ea1-9c12-59912dbea131 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:54.816964 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65c2ed7-5d33-4ea1-9c12-59912dbea131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:54.834725 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-c65c2ed7-5d33-4ea1-9c12-59912dbea131 None None] MFA Rules not processed for user `39bbc5ff02d24f40b796bd2245a7431a`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:31:54.835942 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-c65c2ed7-5d33-4ea1-9c12-59912dbea131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:31:54.843355 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1179/2355] 10.222.0.44 () {58 vars in 967 bytes} [Thu Jun 16 00:31:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:31:54.856339 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cc6e8-12b8-4652-b5de-9a1afa180bcb service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:31:54.868331 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2cc6e8-12b8-4652-b5de-9a1afa180bcb service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:31:54.873474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da719524-9ceb-47df-a6eb-54371a650e54 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918c4a8c6a64812b61fc235ab8e7bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:31:54.874120 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da719524-9ceb-47df-a6eb-54371a650e54 service swift] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:31:54.874477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da719524-9ceb-47df-a6eb-54371a650e54 service swift] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:31:54.875296 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da719524-9ceb-47df-a6eb-54371a650e54 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:31:54.884212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da719524-9ceb-47df-a6eb-54371a650e54 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:31:54.885833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da719524-9ceb-47df-a6eb-54371a650e54 service swift] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:31:54.895557 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1177/2356] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 00:31:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:32:04.829814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:04.891604 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=6 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:10.100981 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55785cb-8114-4abc-94a0-1f53cc86c30b None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:10.101523 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55785cb-8114-4abc-94a0-1f53cc86c30b None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:10.101678 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55785cb-8114-4abc-94a0-1f53cc86c30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:10.119866 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-a55785cb-8114-4abc-94a0-1f53cc86c30b None None] MFA Rules not processed for user `8a57c3f4e4d7479c9f301195cd9764cc`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:32:10.121076 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-a55785cb-8114-4abc-94a0-1f53cc86c30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:10.128475 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1180/2357] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:32:10 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:32:16.382260 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da719524-9ceb-47df-a6eb-54371a650e54 service swift] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:16.407711 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da719524-9ceb-47df-a6eb-54371a650e54 service swift] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:16.414921 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f21bb4-9dca-4fc0-91e0-1d12cf4c5074 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:16.415808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f21bb4-9dca-4fc0-91e0-1d12cf4c5074 service nova] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:16.416219 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f21bb4-9dca-4fc0-91e0-1d12cf4c5074 service nova] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:16.416630 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f21bb4-9dca-4fc0-91e0-1d12cf4c5074 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:16.418689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-31f21bb4-9dca-4fc0-91e0-1d12cf4c5074 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:16.431482 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f21bb4-9dca-4fc0-91e0-1d12cf4c5074 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:16.433234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f21bb4-9dca-4fc0-91e0-1d12cf4c5074 service nova] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:16.444439 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1178/2358] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:20.114996 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:26.439900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=6 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:32:52.809165 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55785cb-8114-4abc-94a0-1f53cc86c30b None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:52.821582 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55785cb-8114-4abc-94a0-1f53cc86c30b None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:52.826924 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1c592-c827-463f-99ea-7e7ea2e463ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:52.827557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1c592-c827-463f-99ea-7e7ea2e463ca service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:52.827875 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1c592-c827-463f-99ea-7e7ea2e463ca service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:52.828156 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1c592-c827-463f-99ea-7e7ea2e463ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:52.829923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-fbe1c592-c827-463f-99ea-7e7ea2e463ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:52.840657 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1c592-c827-463f-99ea-7e7ea2e463ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:52.842270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1c592-c827-463f-99ea-7e7ea2e463ca service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:52.851872 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1181/2359] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:52 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:32:55.929976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f21bb4-9dca-4fc0-91e0-1d12cf4c5074 service nova] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:32:55.943344 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f21bb4-9dca-4fc0-91e0-1d12cf4c5074 service nova] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:32:55.950093 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1b38e-b9b9-48d4-9b4e-3724d76c05d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:32:55.951178 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1b38e-b9b9-48d4-9b4e-3724d76c05d1 service nova] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:32:55.951946 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1b38e-b9b9-48d4-9b4e-3724d76c05d1 service nova] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:32:55.952423 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b1b38e-b9b9-48d4-9b4e-3724d76c05d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:32:55.954688 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-c6b1b38e-b9b9-48d4-9b4e-3724d76c05d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:32:55.970869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1b38e-b9b9-48d4-9b4e-3724d76c05d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:32:55.972660 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b1b38e-b9b9-48d4-9b4e-3724d76c05d1 service nova] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:32:55.983661 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1179/2360] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:32:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:02.847659 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=6 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:05.317736 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c9d74-d54c-4f8e-9f51-fcfdca6a35e7 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:05.318324 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c9d74-d54c-4f8e-9f51-fcfdca6a35e7 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:05.318324 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59c9d74-d54c-4f8e-9f51-fcfdca6a35e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:05.335911 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-f59c9d74-d54c-4f8e-9f51-fcfdca6a35e7 None None] MFA Rules not processed for user `f0c5a5705f34440abce48190674a76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:05.337116 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-f59c9d74-d54c-4f8e-9f51-fcfdca6a35e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:05.344202 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1182/2361] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:33:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:05.651344 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1b38e-b9b9-48d4-9b4e-3724d76c05d1 service nova] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:05.661302 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b1b38e-b9b9-48d4-9b4e-3724d76c05d1 service nova] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:05.664938 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31462970-39a7-4a0a-a870-61deac6a7b54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:05.665587 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31462970-39a7-4a0a-a870-61deac6a7b54 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:05.665872 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31462970-39a7-4a0a-a870-61deac6a7b54 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:05.666152 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31462970-39a7-4a0a-a870-61deac6a7b54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:05.668124 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-31462970-39a7-4a0a-a870-61deac6a7b54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:05.677918 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31462970-39a7-4a0a-a870-61deac6a7b54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:05.679360 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31462970-39a7-4a0a-a870-61deac6a7b54 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:05.687322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1180/2362] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:12.715171 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959c60f-ec76-4389-8bf5-b2d62b73c21e None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:12.715762 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959c60f-ec76-4389-8bf5-b2d62b73c21e None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:12.715968 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d959c60f-ec76-4389-8bf5-b2d62b73c21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:12.734832 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-d959c60f-ec76-4389-8bf5-b2d62b73c21e None None] MFA Rules not processed for user `a6c145cb49f54dd88307f416ff1bb92b`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:12.736667 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-d959c60f-ec76-4389-8bf5-b2d62b73c21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:12.744350 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1183/2363] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:33:12 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:13.340775 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31462970-39a7-4a0a-a870-61deac6a7b54 service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:13.351653 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31462970-39a7-4a0a-a870-61deac6a7b54 service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:13.355690 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05bc95c-d75a-448c-a533-91d8ec7ec62e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:13.356333 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bc95c-d75a-448c-a533-91d8ec7ec62e service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:13.356618 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bc95c-d75a-448c-a533-91d8ec7ec62e service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:13.356898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05bc95c-d75a-448c-a533-91d8ec7ec62e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:13.358674 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e05bc95c-d75a-448c-a533-91d8ec7ec62e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:13.370736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bc95c-d75a-448c-a533-91d8ec7ec62e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:13.372249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05bc95c-d75a-448c-a533-91d8ec7ec62e service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:13.381635 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1181/2364] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:18.301283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959c60f-ec76-4389-8bf5-b2d62b73c21e None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:18.314542 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d959c60f-ec76-4389-8bf5-b2d62b73c21e None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:18.320115 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ef20d-48b5-4362-9667-3b66b6d56d5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:18.320756 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ef20d-48b5-4362-9667-3b66b6d56d5d service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:18.321047 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ef20d-48b5-4362-9667-3b66b6d56d5d service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:18.321327 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07ef20d-48b5-4362-9667-3b66b6d56d5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:18.323101 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-d07ef20d-48b5-4362-9667-3b66b6d56d5d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:18.335813 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ef20d-48b5-4362-9667-3b66b6d56d5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:18.337414 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07ef20d-48b5-4362-9667-3b66b6d56d5d service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:18.348868 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1184/2365] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:23.378364 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=18 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:26.335565 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9f6c1-7ab2-4f0a-881a-62a53dea5a21 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:26.336577 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9f6c1-7ab2-4f0a-881a-62a53dea5a21 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:26.337037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e9f6c1-7ab2-4f0a-881a-62a53dea5a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:26.358749 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-16e9f6c1-7ab2-4f0a-881a-62a53dea5a21 None None] MFA Rules not processed for user `39bbc5ff02d24f40b796bd2245a7431a`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:26.360020 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-16e9f6c1-7ab2-4f0a-881a-62a53dea5a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:26.367417 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1182/2366] 10.222.0.44 () {58 vars in 967 bytes} [Thu Jun 16 00:33:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:26.436427 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ef20d-48b5-4362-9667-3b66b6d56d5d service nova] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:26.448649 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07ef20d-48b5-4362-9667-3b66b6d56d5d service nova] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:26.454662 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94cb43-31d3-4151-a85c-05fb282aadb4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918c4a8c6a64812b61fc235ab8e7bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:26.455385 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94cb43-31d3-4151-a85c-05fb282aadb4 service swift] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:26.455760 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94cb43-31d3-4151-a85c-05fb282aadb4 service swift] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:26.456120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c94cb43-31d3-4151-a85c-05fb282aadb4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:26.465095 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94cb43-31d3-4151-a85c-05fb282aadb4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:26.466769 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c94cb43-31d3-4151-a85c-05fb282aadb4 service swift] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:26.475838 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1185/2367] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 00:33:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:33:26.886413 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9f6c1-7ab2-4f0a-881a-62a53dea5a21 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:26.896541 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e9f6c1-7ab2-4f0a-881a-62a53dea5a21 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:26.900395 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c4a54-1929-49e8-a3c9-2b9fd6d15606 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:26.901043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c4a54-1929-49e8-a3c9-2b9fd6d15606 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:26.901324 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c4a54-1929-49e8-a3c9-2b9fd6d15606 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:26.901600 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719c4a54-1929-49e8-a3c9-2b9fd6d15606 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:26.903365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-719c4a54-1929-49e8-a3c9-2b9fd6d15606 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:26.967884 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c4a54-1929-49e8-a3c9-2b9fd6d15606 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:26.969442 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719c4a54-1929-49e8-a3c9-2b9fd6d15606 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:26.979459 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1183/2368] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:30.253371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94cb43-31d3-4151-a85c-05fb282aadb4 service swift] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:30.255501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-1c94cb43-31d3-4151-a85c-05fb282aadb4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:30.273917 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c94cb43-31d3-4151-a85c-05fb282aadb4 service swift] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:30.279308 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a36683-6a72-4feb-8dc9-89aa5953d071 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9164f14fe6894daba1a9f2d8f1f4929c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:30.279993 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a36683-6a72-4feb-8dc9-89aa5953d071 service placement] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:30.280282 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a36683-6a72-4feb-8dc9-89aa5953d071 service placement] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:30.280563 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a36683-6a72-4feb-8dc9-89aa5953d071 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:30.282390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-42a36683-6a72-4feb-8dc9-89aa5953d071 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:30.294530 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a36683-6a72-4feb-8dc9-89aa5953d071 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:30.296200 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a36683-6a72-4feb-8dc9-89aa5953d071 service placement] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:30.306772 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1186/2369] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:34.305187 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c4a54-1929-49e8-a3c9-2b9fd6d15606 service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:34.306712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-719c4a54-1929-49e8-a3c9-2b9fd6d15606 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:34.325934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719c4a54-1929-49e8-a3c9-2b9fd6d15606 service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:34.331375 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33d161-4d4d-40f1-ba7a-8a08878a9472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:34.332533 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33d161-4d4d-40f1-ba7a-8a08878a9472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:34.332967 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33d161-4d4d-40f1-ba7a-8a08878a9472 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:34.333549 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c33d161-4d4d-40f1-ba7a-8a08878a9472 admin admin] PATH_INFO: `/v3/users/ac127f66bf2b4432acd34132911d7c0c` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:34.335040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33d161-4d4d-40f1-ba7a-8a08878a9472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac127f66bf2b4432acd34132911d7c0c)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:34.337440 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c33d161-4d4d-40f1-ba7a-8a08878a9472 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:34.400528 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-6c33d161-4d4d-40f1-ba7a-8a08878a9472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac127f66bf2b4432acd34132911d7c0c'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:34.409124 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-6c33d161-4d4d-40f1-ba7a-8a08878a9472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac127f66bf2b4432acd34132911d7c0c'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:34.409744 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-6c33d161-4d4d-40f1-ba7a-8a08878a9472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac127f66bf2b4432acd34132911d7c0c'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:34.425306 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-6c33d161-4d4d-40f1-ba7a-8a08878a9472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac127f66bf2b4432acd34132911d7c0c'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:34.426131 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-6c33d161-4d4d-40f1-ba7a-8a08878a9472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac127f66bf2b4432acd34132911d7c0c'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:34.440327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1184/2370] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:33:34 2022] DELETE /identity/v3/users/ac127f66bf2b4432acd34132911d7c0c => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:33:34.640498 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a36683-6a72-4feb-8dc9-89aa5953d071 service placement] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:34.647498 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=25 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:34.660222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a36683-6a72-4feb-8dc9-89aa5953d071 service placement] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:34.725326 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3ebaa-aeb1-4eb9-99fe-2399330a2343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:34.726208 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3ebaa-aeb1-4eb9-99fe-2399330a2343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:34.726496 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3ebaa-aeb1-4eb9-99fe-2399330a2343 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:34.727050 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3ebaa-aeb1-4eb9-99fe-2399330a2343 admin admin] PATH_INFO: `/v3/projects/4b5ec212032a46aab16a55fde900c916` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:34.728487 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3ebaa-aeb1-4eb9-99fe-2399330a2343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b5ec212032a46aab16a55fde900c916)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:34.730456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3ebaa-aeb1-4eb9-99fe-2399330a2343 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:34.780170 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-d2f3ebaa-aeb1-4eb9-99fe-2399330a2343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b5ec212032a46aab16a55fde900c916', 'request_id': 'req-d2f3ebaa-aeb1-4eb9-99fe-2399330a2343'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:34.789376 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-d2f3ebaa-aeb1-4eb9-99fe-2399330a2343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b5ec212032a46aab16a55fde900c916', 'request_id': 'req-d2f3ebaa-aeb1-4eb9-99fe-2399330a2343'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:34.797080 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-d2f3ebaa-aeb1-4eb9-99fe-2399330a2343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b5ec212032a46aab16a55fde900c916', 'request_id': 'req-d2f3ebaa-aeb1-4eb9-99fe-2399330a2343'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:34.811749 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-d2f3ebaa-aeb1-4eb9-99fe-2399330a2343 admin admin] The token cache is being invalidate because project 4b5ec212032a46aab16a55fde900c916 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:33:34.812047 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-d2f3ebaa-aeb1-4eb9-99fe-2399330a2343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:34.812676 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-d2f3ebaa-aeb1-4eb9-99fe-2399330a2343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:34.814305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1187/2371] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:33:34 2022] DELETE /identity/v3/projects/4b5ec212032a46aab16a55fde900c916 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:33:34.818255 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33d161-4d4d-40f1-ba7a-8a08878a9472 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:34.819792 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-6c33d161-4d4d-40f1-ba7a-8a08878a9472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:34.833453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c33d161-4d4d-40f1-ba7a-8a08878a9472 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:34.898660 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f30535-f48e-4ff3-a67c-bdd2948f8fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:34.899601 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f30535-f48e-4ff3-a67c-bdd2948f8fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:34.899917 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f30535-f48e-4ff3-a67c-bdd2948f8fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:34.900275 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f30535-f48e-4ff3-a67c-bdd2948f8fc8 admin admin] PATH_INFO: `/v3/users/6b20754b73d0438a87b592b6db537a01` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:34.901553 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f30535-f48e-4ff3-a67c-bdd2948f8fc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b20754b73d0438a87b592b6db537a01)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:34.904227 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f30535-f48e-4ff3-a67c-bdd2948f8fc8 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:34.906558 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:34.985655 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-20f30535-f48e-4ff3-a67c-bdd2948f8fc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b20754b73d0438a87b592b6db537a01'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:34.993064 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-20f30535-f48e-4ff3-a67c-bdd2948f8fc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b20754b73d0438a87b592b6db537a01'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:34.993781 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-20f30535-f48e-4ff3-a67c-bdd2948f8fc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b20754b73d0438a87b592b6db537a01'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:35.013235 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-20f30535-f48e-4ff3-a67c-bdd2948f8fc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b20754b73d0438a87b592b6db537a01'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:35.013956 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-20f30535-f48e-4ff3-a67c-bdd2948f8fc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b20754b73d0438a87b592b6db537a01'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:35.030080 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1185/2372] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:33:34 2022] DELETE /identity/v3/users/6b20754b73d0438a87b592b6db537a01 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:33:35.374344 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3ebaa-aeb1-4eb9-99fe-2399330a2343 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:35.377507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-d2f3ebaa-aeb1-4eb9-99fe-2399330a2343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:35.390834 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3ebaa-aeb1-4eb9-99fe-2399330a2343 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:35.463056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ff775-cd15-4242-9e30-8d4bd01aa7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:35.464279 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ff775-cd15-4242-9e30-8d4bd01aa7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:35.464752 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ff775-cd15-4242-9e30-8d4bd01aa7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:35.465033 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6ff775-cd15-4242-9e30-8d4bd01aa7d4 admin admin] PATH_INFO: `/v3/projects/bbf7faf77203437c9bc678c26ed86bfd` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:35.466265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ff775-cd15-4242-9e30-8d4bd01aa7d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbf7faf77203437c9bc678c26ed86bfd)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:35.468271 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6ff775-cd15-4242-9e30-8d4bd01aa7d4 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:35.517900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:35.534524 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-3d6ff775-cd15-4242-9e30-8d4bd01aa7d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbf7faf77203437c9bc678c26ed86bfd', 'request_id': 'req-3d6ff775-cd15-4242-9e30-8d4bd01aa7d4'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:35.540574 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-3d6ff775-cd15-4242-9e30-8d4bd01aa7d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbf7faf77203437c9bc678c26ed86bfd', 'request_id': 'req-3d6ff775-cd15-4242-9e30-8d4bd01aa7d4'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:35.547768 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-3d6ff775-cd15-4242-9e30-8d4bd01aa7d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbf7faf77203437c9bc678c26ed86bfd', 'request_id': 'req-3d6ff775-cd15-4242-9e30-8d4bd01aa7d4'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:35.563543 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-3d6ff775-cd15-4242-9e30-8d4bd01aa7d4 admin admin] The token cache is being invalidate because project bbf7faf77203437c9bc678c26ed86bfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:33:35.563969 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-3d6ff775-cd15-4242-9e30-8d4bd01aa7d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:35.564810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-3d6ff775-cd15-4242-9e30-8d4bd01aa7d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:35.566463 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1188/2373] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:33:35 2022] DELETE /identity/v3/projects/bbf7faf77203437c9bc678c26ed86bfd => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:33:43.099815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f30535-f48e-4ff3-a67c-bdd2948f8fc8 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:43.101493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-20f30535-f48e-4ff3-a67c-bdd2948f8fc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:43.161020 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f30535-f48e-4ff3-a67c-bdd2948f8fc8 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:43.209702 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87647f-2538-46dc-b4f5-8d76cdf84426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:43.210350 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87647f-2538-46dc-b4f5-8d76cdf84426 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:43.210635 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87647f-2538-46dc-b4f5-8d76cdf84426 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:43.210911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b87647f-2538-46dc-b4f5-8d76cdf84426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:43.212715 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-9b87647f-2538-46dc-b4f5-8d76cdf84426 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:43.259183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:43.276380 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87647f-2538-46dc-b4f5-8d76cdf84426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:43.277793 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b87647f-2538-46dc-b4f5-8d76cdf84426 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:43.287356 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1186/2374] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:45.559091 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:DELETE=5,keystone:SELECT=11,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:46.443511 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ff775-cd15-4242-9e30-8d4bd01aa7d4 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:46.445166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-3d6ff775-cd15-4242-9e30-8d4bd01aa7d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:46.458308 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6ff775-cd15-4242-9e30-8d4bd01aa7d4 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:46.462872 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13755306-79fe-4bab-b710-188cf01e224c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:46.463770 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13755306-79fe-4bab-b710-188cf01e224c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:46.464060 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13755306-79fe-4bab-b710-188cf01e224c admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:46.464414 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13755306-79fe-4bab-b710-188cf01e224c admin admin] PATH_INFO: `/v3/users/8a57c3f4e4d7479c9f301195cd9764cc` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:46.466188 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13755306-79fe-4bab-b710-188cf01e224c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a57c3f4e4d7479c9f301195cd9764cc)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:46.468161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13755306-79fe-4bab-b710-188cf01e224c admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:46.514605 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-13755306-79fe-4bab-b710-188cf01e224c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a57c3f4e4d7479c9f301195cd9764cc'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:46.521919 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-13755306-79fe-4bab-b710-188cf01e224c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a57c3f4e4d7479c9f301195cd9764cc'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:46.522605 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-13755306-79fe-4bab-b710-188cf01e224c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a57c3f4e4d7479c9f301195cd9764cc'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:46.523234 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-13755306-79fe-4bab-b710-188cf01e224c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a57c3f4e4d7479c9f301195cd9764cc'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:46.536168 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-13755306-79fe-4bab-b710-188cf01e224c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a57c3f4e4d7479c9f301195cd9764cc'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:46.548818 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1189/2375] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:33:46 2022] DELETE /identity/v3/users/8a57c3f4e4d7479c9f301195cd9764cc => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:33:46.727005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87647f-2538-46dc-b4f5-8d76cdf84426 service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:46.740153 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b87647f-2538-46dc-b4f5-8d76cdf84426 service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:46.798720 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2ef72-443f-4662-a186-72a277d3aa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:46.799584 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2ef72-443f-4662-a186-72a277d3aa43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:46.799899 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2ef72-443f-4662-a186-72a277d3aa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:46.800177 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2ef72-443f-4662-a186-72a277d3aa43 admin admin] PATH_INFO: `/v3/projects/3f0f1114473045f899e99736ff9765df` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:46.801664 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2ef72-443f-4662-a186-72a277d3aa43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f0f1114473045f899e99736ff9765df)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:46.803283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2ef72-443f-4662-a186-72a277d3aa43 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:46.850096 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-3eb2ef72-443f-4662-a186-72a277d3aa43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f0f1114473045f899e99736ff9765df', 'request_id': 'req-3eb2ef72-443f-4662-a186-72a277d3aa43'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:46.855577 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-3eb2ef72-443f-4662-a186-72a277d3aa43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f0f1114473045f899e99736ff9765df', 'request_id': 'req-3eb2ef72-443f-4662-a186-72a277d3aa43'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:46.861648 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-3eb2ef72-443f-4662-a186-72a277d3aa43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f0f1114473045f899e99736ff9765df', 'request_id': 'req-3eb2ef72-443f-4662-a186-72a277d3aa43'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:46.873397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-3eb2ef72-443f-4662-a186-72a277d3aa43 admin admin] The token cache is being invalidate because project 3f0f1114473045f899e99736ff9765df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:33:46.873686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-3eb2ef72-443f-4662-a186-72a277d3aa43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:46.874405 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-3eb2ef72-443f-4662-a186-72a277d3aa43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:33:46.876523 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1187/2376] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:33:46 2022] DELETE /identity/v3/projects/3f0f1114473045f899e99736ff9765df => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:33:46.882294 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076528d-c890-4716-a9cf-431fa653017a None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:46.882766 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076528d-c890-4716-a9cf-431fa653017a None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:46.882865 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076528d-c890-4716-a9cf-431fa653017a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:46.901970 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-6076528d-c890-4716-a9cf-431fa653017a None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:46.903188 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-6076528d-c890-4716-a9cf-431fa653017a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:46.961128 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1190/2377] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:46.968481 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413641b8-4605-4c89-9b11-30e82864d756 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:46.968775 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413641b8-4605-4c89-9b11-30e82864d756 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:46.969057 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413641b8-4605-4c89-9b11-30e82864d756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:46.987964 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-413641b8-4605-4c89-9b11-30e82864d756 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:46.989200 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-413641b8-4605-4c89-9b11-30e82864d756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:46.997171 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1188/2378] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:33:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:47.001790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076528d-c890-4716-a9cf-431fa653017a None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:47.011329 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076528d-c890-4716-a9cf-431fa653017a None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:47.015933 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f6674-48ad-4cc4-a9f5-7c0d01c6c7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:47.017208 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f6674-48ad-4cc4-a9f5-7c0d01c6c7af admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:47.017499 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f6674-48ad-4cc4-a9f5-7c0d01c6c7af admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:47.017780 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09f6674-48ad-4cc4-a9f5-7c0d01c6c7af admin admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:47.018505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f6674-48ad-4cc4-a9f5-7c0d01c6c7af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:33:47.018818 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f6674-48ad-4cc4-a9f5-7c0d01c6c7af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:47.020711 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09f6674-48ad-4cc4-a9f5-7c0d01c6c7af admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:47.031988 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1191/2379] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:33:47.036048 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413641b8-4605-4c89-9b11-30e82864d756 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:47.045211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413641b8-4605-4c89-9b11-30e82864d756 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:47.049876 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f799b8-620d-4980-b935-f63e21a8145d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:47.050514 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f799b8-620d-4980-b935-f63e21a8145d admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:47.050799 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f799b8-620d-4980-b935-f63e21a8145d admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:47.051073 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f799b8-620d-4980-b935-f63e21a8145d admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:47.051795 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f799b8-620d-4980-b935-f63e21a8145d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:47.053736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f799b8-620d-4980-b935-f63e21a8145d admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:47.088706 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1189/2380] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:33:47 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:33:47.092826 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f6674-48ad-4cc4-a9f5-7c0d01c6c7af admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:47.102705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09f6674-48ad-4cc4-a9f5-7c0d01c6c7af admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:47.159197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4878f16-a426-4384-9e84-16000c35d339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:47.159889 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4878f16-a426-4384-9e84-16000c35d339 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:47.160182 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4878f16-a426-4384-9e84-16000c35d339 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:47.160469 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4878f16-a426-4384-9e84-16000c35d339 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:47.161167 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4878f16-a426-4384-9e84-16000c35d339 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:47.163086 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4878f16-a426-4384-9e84-16000c35d339 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:47.169560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:47.183182 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1192/2381] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:33:47 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:33:47.187730 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f799b8-620d-4980-b935-f63e21a8145d admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:47.198674 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f799b8-620d-4980-b935-f63e21a8145d admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:47.203219 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bc07c-b124-4ee1-bd57-b0c4f9144e5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:47.203908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bc07c-b124-4ee1-bd57-b0c4f9144e5e admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:47.204757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bc07c-b124-4ee1-bd57-b0c4f9144e5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:47.205039 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55bc07c-b124-4ee1-bd57-b0c4f9144e5e admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:47.205760 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55bc07c-b124-4ee1-bd57-b0c4f9144e5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:47.207363 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55bc07c-b124-4ee1-bd57-b0c4f9144e5e admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:47.217198 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1190/2382] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:33:47.221132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4878f16-a426-4384-9e84-16000c35d339 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:47.231070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4878f16-a426-4384-9e84-16000c35d339 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:47.235709 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffe9df2-a39f-44d4-b22f-91434baebb6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:47.236360 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe9df2-a39f-44d4-b22f-91434baebb6b admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:47.236651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe9df2-a39f-44d4-b22f-91434baebb6b admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:47.236933 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffe9df2-a39f-44d4-b22f-91434baebb6b admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:47.237679 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe9df2-a39f-44d4-b22f-91434baebb6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:47.239275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffe9df2-a39f-44d4-b22f-91434baebb6b admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:47.249017 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1193/2383] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:33:47 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:33:47.253365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bc07c-b124-4ee1-bd57-b0c4f9144e5e admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:47.263162 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55bc07c-b124-4ee1-bd57-b0c4f9144e5e admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:47.268350 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7df4af-1798-4a63-8471-e35f7f941689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:47.269214 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7df4af-1798-4a63-8471-e35f7f941689 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:47.269782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7df4af-1798-4a63-8471-e35f7f941689 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:47.270061 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7df4af-1798-4a63-8471-e35f7f941689 admin admin] PATH_INFO: `/v3/projects/985ab6e44f6d4425a2def9b3a52262d8/users/9e3855abd7ea410fa64d546b3a85ff31/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:47.284242 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7df4af-1798-4a63-8471-e35f7f941689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=985ab6e44f6d4425a2def9b3a52262d8, user_id=9e3855abd7ea410fa64d546b3a85ff31, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:47.287060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7df4af-1798-4a63-8471-e35f7f941689 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:47.300085 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1191/2384] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:33:47 2022] PUT /identity/v3/projects/985ab6e44f6d4425a2def9b3a52262d8/users/9e3855abd7ea410fa64d546b3a85ff31/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:33:47.305176 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ffd34-3667-44cf-880f-da2bef90d1ef None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:47.305476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ffd34-3667-44cf-880f-da2bef90d1ef None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:47.305833 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6ffd34-3667-44cf-880f-da2bef90d1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:47.323354 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-0d6ffd34-3667-44cf-880f-da2bef90d1ef None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:47.324606 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-0d6ffd34-3667-44cf-880f-da2bef90d1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:47.382551 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1194/2385] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:33:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:47.392610 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7df4af-1798-4a63-8471-e35f7f941689 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:47.394294 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-4b7df4af-1798-4a63-8471-e35f7f941689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:47.400044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:33:47.452570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7df4af-1798-4a63-8471-e35f7f941689 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:47.456907 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ee4b9-7be8-4619-8d25-1e5769a5eca3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:47.457547 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ee4b9-7be8-4619-8d25-1e5769a5eca3 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:47.457833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ee4b9-7be8-4619-8d25-1e5769a5eca3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:47.458112 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382ee4b9-7be8-4619-8d25-1e5769a5eca3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:47.467196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ee4b9-7be8-4619-8d25-1e5769a5eca3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:47.468654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382ee4b9-7be8-4619-8d25-1e5769a5eca3 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:47.478636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1192/2386] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:51.699123 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb26de0-dbeb-4571-a3a0-227d0182d656 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:51.699645 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb26de0-dbeb-4571-a3a0-227d0182d656 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:51.699762 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb26de0-dbeb-4571-a3a0-227d0182d656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:51.727718 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-ccb26de0-dbeb-4571-a3a0-227d0182d656 None None] MFA Rules not processed for user `9e3855abd7ea410fa64d546b3a85ff31`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:51.728947 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-ccb26de0-dbeb-4571-a3a0-227d0182d656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:51.810733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1195/2387] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:33:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:33:51.825497 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ee4b9-7be8-4619-8d25-1e5769a5eca3 service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:33:51.827040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-382ee4b9-7be8-4619-8d25-1e5769a5eca3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:51.917037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382ee4b9-7be8-4619-8d25-1e5769a5eca3 service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:33:51.923415 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7de91-e02c-4b6b-9c7b-07a1ab2e32bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:33:51.924138 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7de91-e02c-4b6b-9c7b-07a1ab2e32bf service nova] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:51.924424 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7de91-e02c-4b6b-9c7b-07a1ab2e32bf service nova] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:51.924841 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c7de91-e02c-4b6b-9c7b-07a1ab2e32bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:51.933691 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c7de91-e02c-4b6b-9c7b-07a1ab2e32bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:33:51.935493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c7de91-e02c-4b6b-9c7b-07a1ab2e32bf service nova] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:33:51.946227 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1193/2388] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:33:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:33:53.302164 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36173137-deee-4b3f-88e3-73a5e1be3e4a None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:33:53.302729 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36173137-deee-4b3f-88e3-73a5e1be3e4a None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:33:53.302729 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36173137-deee-4b3f-88e3-73a5e1be3e4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:33:53.320888 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-36173137-deee-4b3f-88e3-73a5e1be3e4a None None] MFA Rules not processed for user `9e3855abd7ea410fa64d546b3a85ff31`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:33:53.322373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-36173137-deee-4b3f-88e3-73a5e1be3e4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:33:53.329820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1196/2389] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:33:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:34:01.941549 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=59 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:34:03.315447 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:INSERT=3,keystone:SELECT=69 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:08.030223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7de91-e02c-4b6b-9c7b-07a1ab2e32bf service nova] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:35:08.032337 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-05c7de91-e02c-4b6b-9c7b-07a1ab2e32bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:35:08.135450 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c7de91-e02c-4b6b-9c7b-07a1ab2e32bf service nova] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:35:08.140548 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada768e1-1500-4f5e-8903-a21cc9911372 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9164f14fe6894daba1a9f2d8f1f4929c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:35:08.141228 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada768e1-1500-4f5e-8903-a21cc9911372 service placement] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:35:08.141509 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada768e1-1500-4f5e-8903-a21cc9911372 service placement] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:35:08.141789 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada768e1-1500-4f5e-8903-a21cc9911372 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:35:08.144405 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-ada768e1-1500-4f5e-8903-a21cc9911372 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:35:08.156466 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada768e1-1500-4f5e-8903-a21cc9911372 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:35:08.158090 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada768e1-1500-4f5e-8903-a21cc9911372 service placement] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:35:08.168920 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1194/2390] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:35:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:35:11.025241 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264c838-d085-402c-bc54-8cb2be3b5023 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:35:11.025743 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264c838-d085-402c-bc54-8cb2be3b5023 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:35:11.025870 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a264c838-d085-402c-bc54-8cb2be3b5023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:35:11.043813 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-a264c838-d085-402c-bc54-8cb2be3b5023 None None] MFA Rules not processed for user `f0c5a5705f34440abce48190674a76d5`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:35:11.045006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-a264c838-d085-402c-bc54-8cb2be3b5023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:35:11.098793 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1197/2391] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:35:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:35:18.165096 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=32 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:21.091483 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=25 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:24.238974 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f27f89-a3bc-4b96-8c80-36279babb071 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:35:24.239468 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f27f89-a3bc-4b96-8c80-36279babb071 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:35:24.239574 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f27f89-a3bc-4b96-8c80-36279babb071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:35:24.257827 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-74f27f89-a3bc-4b96-8c80-36279babb071 None None] MFA Rules not processed for user `39bbc5ff02d24f40b796bd2245a7431a`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:35:24.259216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-74f27f89-a3bc-4b96-8c80-36279babb071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:35:24.316794 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1195/2392] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 00:35:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:35:24.364641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264c838-d085-402c-bc54-8cb2be3b5023 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:35:24.366096 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-a264c838-d085-402c-bc54-8cb2be3b5023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:35:24.438637 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a264c838-d085-402c-bc54-8cb2be3b5023 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:35:24.443720 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87659415-5a2e-44d1-9a5a-3faf36d2e396 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918c4a8c6a64812b61fc235ab8e7bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:35:24.444378 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87659415-5a2e-44d1-9a5a-3faf36d2e396 service swift] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:35:24.444673 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87659415-5a2e-44d1-9a5a-3faf36d2e396 service swift] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:35:24.444959 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87659415-5a2e-44d1-9a5a-3faf36d2e396 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:35:24.453445 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87659415-5a2e-44d1-9a5a-3faf36d2e396 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:35:24.455031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87659415-5a2e-44d1-9a5a-3faf36d2e396 service swift] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:35:24.463526 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1198/2393] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 00:35:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:35:34.310046 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=25 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:34.459954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=32 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:35:41.086540 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebcd09-277d-4bd2-97a6-2a3eeea5214e None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:35:41.087033 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebcd09-277d-4bd2-97a6-2a3eeea5214e None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:35:41.087136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ebcd09-277d-4bd2-97a6-2a3eeea5214e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:35:41.108006 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-95ebcd09-277d-4bd2-97a6-2a3eeea5214e None None] MFA Rules not processed for user `39bbc5ff02d24f40b796bd2245a7431a`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:35:41.109329 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-95ebcd09-277d-4bd2-97a6-2a3eeea5214e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:35:41.117414 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1196/2394] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 00:35:41 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:35:41.130013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87659415-5a2e-44d1-9a5a-3faf36d2e396 service swift] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:35:41.141194 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87659415-5a2e-44d1-9a5a-3faf36d2e396 service swift] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:35:41.147124 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533b8f7-730e-4b4d-bfd4-ebe91965aa00 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918c4a8c6a64812b61fc235ab8e7bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:35:41.147807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533b8f7-730e-4b4d-bfd4-ebe91965aa00 service swift] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:35:41.148095 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533b8f7-730e-4b4d-bfd4-ebe91965aa00 service swift] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:35:41.148377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533b8f7-730e-4b4d-bfd4-ebe91965aa00 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:35:41.159818 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533b8f7-730e-4b4d-bfd4-ebe91965aa00 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:35:41.161432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c533b8f7-730e-4b4d-bfd4-ebe91965aa00 service swift] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:35:41.175649 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1199/2395] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 00:35:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:35:50.553401 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebcd09-277d-4bd2-97a6-2a3eeea5214e None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:35:50.562901 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ebcd09-277d-4bd2-97a6-2a3eeea5214e None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:35:50.566492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dea57f2-bf5d-49fe-8621-6256869e58b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:35:50.567127 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea57f2-bf5d-49fe-8621-6256869e58b0 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:35:50.567411 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea57f2-bf5d-49fe-8621-6256869e58b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:35:50.567761 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dea57f2-bf5d-49fe-8621-6256869e58b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:35:50.569503 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-3dea57f2-bf5d-49fe-8621-6256869e58b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:35:50.652877 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea57f2-bf5d-49fe-8621-6256869e58b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:35:50.655231 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dea57f2-bf5d-49fe-8621-6256869e58b0 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:35:50.678574 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1197/2396] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:35:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:35:51.171799 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=6 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:00.663093 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=31 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:03.791978 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533b8f7-730e-4b4d-bfd4-ebe91965aa00 service swift] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:03.801901 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c533b8f7-730e-4b4d-bfd4-ebe91965aa00 service swift] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:03.805250 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004809a-cfb9-4154-9c96-1b14492267a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:03.805937 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004809a-cfb9-4154-9c96-1b14492267a8 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:03.806219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004809a-cfb9-4154-9c96-1b14492267a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:03.806494 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9004809a-cfb9-4154-9c96-1b14492267a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:03.808292 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-9004809a-cfb9-4154-9c96-1b14492267a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:03.820017 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004809a-cfb9-4154-9c96-1b14492267a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:03.821435 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9004809a-cfb9-4154-9c96-1b14492267a8 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:03.831150 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1200/2397] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:36:04.898823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d123c1b-0514-4e05-ac15-2740ae1a0357 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:04.899395 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d123c1b-0514-4e05-ac15-2740ae1a0357 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:04.900756 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d123c1b-0514-4e05-ac15-2740ae1a0357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:04.919040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-6d123c1b-0514-4e05-ac15-2740ae1a0357 None None] MFA Rules not processed for user `39bbc5ff02d24f40b796bd2245a7431a`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:36:04.920394 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-6d123c1b-0514-4e05-ac15-2740ae1a0357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:04.928457 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1198/2398] 10.222.0.44 () {58 vars in 967 bytes} [Thu Jun 16 00:36:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:36:04.942020 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004809a-cfb9-4154-9c96-1b14492267a8 service neutron] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:04.954758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9004809a-cfb9-4154-9c96-1b14492267a8 service neutron] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:04.960791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea22a4b-e1ac-4cd2-91a1-a261270659d7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918c4a8c6a64812b61fc235ab8e7bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:04.961638 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea22a4b-e1ac-4cd2-91a1-a261270659d7 service swift] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:04.961739 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea22a4b-e1ac-4cd2-91a1-a261270659d7 service swift] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:04.961969 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea22a4b-e1ac-4cd2-91a1-a261270659d7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:04.970876 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea22a4b-e1ac-4cd2-91a1-a261270659d7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:04.973049 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea22a4b-e1ac-4cd2-91a1-a261270659d7 service swift] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:04.982460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1201/2399] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 00:36:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:36:07.156572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d123c1b-0514-4e05-ac15-2740ae1a0357 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:07.169459 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d123c1b-0514-4e05-ac15-2740ae1a0357 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:07.175104 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae1f0c-2f24-477f-beb0-9e449e3da3a2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9164f14fe6894daba1a9f2d8f1f4929c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:07.175898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae1f0c-2f24-477f-beb0-9e449e3da3a2 service placement] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:07.176252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae1f0c-2f24-477f-beb0-9e449e3da3a2 service placement] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:07.176601 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ae1f0c-2f24-477f-beb0-9e449e3da3a2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:07.178452 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-50ae1f0c-2f24-477f-beb0-9e449e3da3a2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:07.190116 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae1f0c-2f24-477f-beb0-9e449e3da3a2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:07.191740 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ae1f0c-2f24-477f-beb0-9e449e3da3a2 service placement] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:07.202410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1199/2400] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:07 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:36:08.135517 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea22a4b-e1ac-4cd2-91a1-a261270659d7 service swift] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:08.146982 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea22a4b-e1ac-4cd2-91a1-a261270659d7 service swift] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:08.151787 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39f22c-3aa0-4b24-a1a1-53f940c512a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:08.153226 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39f22c-3aa0-4b24-a1a1-53f940c512a6 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:08.153788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39f22c-3aa0-4b24-a1a1-53f940c512a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:08.154313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f39f22c-3aa0-4b24-a1a1-53f940c512a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:08.156316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-1f39f22c-3aa0-4b24-a1a1-53f940c512a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:08.175997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39f22c-3aa0-4b24-a1a1-53f940c512a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:08.177547 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f39f22c-3aa0-4b24-a1a1-53f940c512a6 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:08.190058 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1202/2401] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:36:09.378846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae1f0c-2f24-477f-beb0-9e449e3da3a2 service placement] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:09.388952 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ae1f0c-2f24-477f-beb0-9e449e3da3a2 service placement] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:09.393719 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ea2c1-e2dd-4854-b615-ed68f98a33f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:09.394387 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ea2c1-e2dd-4854-b615-ed68f98a33f3 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:09.394677 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ea2c1-e2dd-4854-b615-ed68f98a33f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:09.394963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42ea2c1-e2dd-4854-b615-ed68f98a33f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:09.397410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e42ea2c1-e2dd-4854-b615-ed68f98a33f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:09.419652 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ea2c1-e2dd-4854-b615-ed68f98a33f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:09.421191 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42ea2c1-e2dd-4854-b615-ed68f98a33f3 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:09.434895 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1200/2402] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:36:09 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:36:10.192648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39f22c-3aa0-4b24-a1a1-53f940c512a6 service neutron] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:10.194119 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-1f39f22c-3aa0-4b24-a1a1-53f940c512a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:10.207673 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f39f22c-3aa0-4b24-a1a1-53f940c512a6 service neutron] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:10.212258 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ac4ab-318a-4d2e-83ad-be3d771034fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:10.213138 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ac4ab-318a-4d2e-83ad-be3d771034fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:10.213410 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ac4ab-318a-4d2e-83ad-be3d771034fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:10.213696 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64ac4ab-318a-4d2e-83ad-be3d771034fe admin admin] PATH_INFO: `/v3/users/cff74fa58ac342228f9f5235347bf6bb` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:10.214902 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ac4ab-318a-4d2e-83ad-be3d771034fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=cff74fa58ac342228f9f5235347bf6bb)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:10.216873 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64ac4ab-318a-4d2e-83ad-be3d771034fe admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:10.263476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c64ac4ab-318a-4d2e-83ad-be3d771034fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cff74fa58ac342228f9f5235347bf6bb'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:10.270679 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c64ac4ab-318a-4d2e-83ad-be3d771034fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cff74fa58ac342228f9f5235347bf6bb'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:10.271308 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c64ac4ab-318a-4d2e-83ad-be3d771034fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cff74fa58ac342228f9f5235347bf6bb'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:10.277955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c64ac4ab-318a-4d2e-83ad-be3d771034fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cff74fa58ac342228f9f5235347bf6bb'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:10.284310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c64ac4ab-318a-4d2e-83ad-be3d771034fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cff74fa58ac342228f9f5235347bf6bb'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:10.296367 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1203/2403] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:36:10 2022] DELETE /identity/v3/users/cff74fa58ac342228f9f5235347bf6bb => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:10.463209 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ea2c1-e2dd-4854-b615-ed68f98a33f3 service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:10.475170 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42ea2c1-e2dd-4854-b615-ed68f98a33f3 service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:10.531142 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7339e-8dd5-420e-8d02-2df6be740321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:10.532085 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7339e-8dd5-420e-8d02-2df6be740321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:10.532373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7339e-8dd5-420e-8d02-2df6be740321 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:10.532647 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d7339e-8dd5-420e-8d02-2df6be740321 admin admin] PATH_INFO: `/v3/projects/c645f5673fe144de9432ba22b7d5ae87` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:10.534357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7339e-8dd5-420e-8d02-2df6be740321 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c645f5673fe144de9432ba22b7d5ae87)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:10.536321 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d7339e-8dd5-420e-8d02-2df6be740321 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:10.581694 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-e1d7339e-8dd5-420e-8d02-2df6be740321 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c645f5673fe144de9432ba22b7d5ae87', 'request_id': 'req-e1d7339e-8dd5-420e-8d02-2df6be740321'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:10.587218 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-e1d7339e-8dd5-420e-8d02-2df6be740321 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c645f5673fe144de9432ba22b7d5ae87', 'request_id': 'req-e1d7339e-8dd5-420e-8d02-2df6be740321'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:10.593292 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-e1d7339e-8dd5-420e-8d02-2df6be740321 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c645f5673fe144de9432ba22b7d5ae87', 'request_id': 'req-e1d7339e-8dd5-420e-8d02-2df6be740321'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:10.606171 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-e1d7339e-8dd5-420e-8d02-2df6be740321 admin admin] The token cache is being invalidate because project c645f5673fe144de9432ba22b7d5ae87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:36:10.606479 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-e1d7339e-8dd5-420e-8d02-2df6be740321 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:10.607232 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-e1d7339e-8dd5-420e-8d02-2df6be740321 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:10.608804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1201/2404] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:36:10 2022] DELETE /identity/v3/projects/c645f5673fe144de9432ba22b7d5ae87 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:10.612763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ac4ab-318a-4d2e-83ad-be3d771034fe admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:10.614155 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-c64ac4ab-318a-4d2e-83ad-be3d771034fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:10.627209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64ac4ab-318a-4d2e-83ad-be3d771034fe admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:10.685555 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04febb76-031c-4a6f-8241-64d3c1bf539e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:10.686366 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04febb76-031c-4a6f-8241-64d3c1bf539e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:10.686652 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04febb76-031c-4a6f-8241-64d3c1bf539e admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:10.687012 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04febb76-031c-4a6f-8241-64d3c1bf539e admin admin] PATH_INFO: `/v3/users/264967946cd04a869b83f112622ec140` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:10.688417 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04febb76-031c-4a6f-8241-64d3c1bf539e admin admin] RBAC: Authorizing `identity:delete_user(user_id=264967946cd04a869b83f112622ec140)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:10.691166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04febb76-031c-4a6f-8241-64d3c1bf539e admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:10.729498 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:10.740894 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-04febb76-031c-4a6f-8241-64d3c1bf539e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '264967946cd04a869b83f112622ec140'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:10.748352 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-04febb76-031c-4a6f-8241-64d3c1bf539e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '264967946cd04a869b83f112622ec140'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:10.749040 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-04febb76-031c-4a6f-8241-64d3c1bf539e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '264967946cd04a869b83f112622ec140'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:10.749655 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-04febb76-031c-4a6f-8241-64d3c1bf539e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '264967946cd04a869b83f112622ec140'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:10.763701 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-04febb76-031c-4a6f-8241-64d3c1bf539e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '264967946cd04a869b83f112622ec140'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:10.777648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1204/2405] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:36:10 2022] DELETE /identity/v3/users/264967946cd04a869b83f112622ec140 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:11.195586 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7339e-8dd5-420e-8d02-2df6be740321 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:36:11.197105 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e1d7339e-8dd5-420e-8d02-2df6be740321 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:36:11.210040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d7339e-8dd5-420e-8d02-2df6be740321 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:36:11.263266 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:11.270789 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204f6b8-8694-4de9-bae6-1233705af087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:36:11.271703 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204f6b8-8694-4de9-bae6-1233705af087 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:36:11.272231 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204f6b8-8694-4de9-bae6-1233705af087 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:36:11.272582 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4204f6b8-8694-4de9-bae6-1233705af087 admin admin] PATH_INFO: `/v3/projects/e2820d95b7c14841a71444c5f3890d0d` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:36:11.274035 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204f6b8-8694-4de9-bae6-1233705af087 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2820d95b7c14841a71444c5f3890d0d)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:36:11.276092 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4204f6b8-8694-4de9-bae6-1233705af087 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:36:11.327655 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-4204f6b8-8694-4de9-bae6-1233705af087 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2820d95b7c14841a71444c5f3890d0d', 'request_id': 'req-4204f6b8-8694-4de9-bae6-1233705af087'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:11.333563 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-4204f6b8-8694-4de9-bae6-1233705af087 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2820d95b7c14841a71444c5f3890d0d', 'request_id': 'req-4204f6b8-8694-4de9-bae6-1233705af087'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:11.339865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-4204f6b8-8694-4de9-bae6-1233705af087 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2820d95b7c14841a71444c5f3890d0d', 'request_id': 'req-4204f6b8-8694-4de9-bae6-1233705af087'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:11.352039 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-4204f6b8-8694-4de9-bae6-1233705af087 admin admin] The token cache is being invalidate because project e2820d95b7c14841a71444c5f3890d0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:36:11.352327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-4204f6b8-8694-4de9-bae6-1233705af087 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:11.352975 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-4204f6b8-8694-4de9-bae6-1233705af087 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:36:11.354565 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1202/2406] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:36:11 2022] DELETE /identity/v3/projects/e2820d95b7c14841a71444c5f3890d0d => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:36:20.774139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=16,keystone:DELETE=5,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:36:21.349049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=25,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:00.308429 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04febb76-031c-4a6f-8241-64d3c1bf539e admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:00.309834 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-04febb76-031c-4a6f-8241-64d3c1bf539e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:00.366760 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04febb76-031c-4a6f-8241-64d3c1bf539e admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:00.414319 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8efc9-6709-4d05-abe7-64430c0e9035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:00.414966 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8efc9-6709-4d05-abe7-64430c0e9035 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:00.415250 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8efc9-6709-4d05-abe7-64430c0e9035 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:00.415527 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c8efc9-6709-4d05-abe7-64430c0e9035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:00.417306 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-e2c8efc9-6709-4d05-abe7-64430c0e9035 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:00.477542 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c8efc9-6709-4d05-abe7-64430c0e9035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:00.478909 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c8efc9-6709-4d05-abe7-64430c0e9035 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:00.488924 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1205/2407] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:03.519499 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204f6b8-8694-4de9-bae6-1233705af087 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:03.521199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-4204f6b8-8694-4de9-bae6-1233705af087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:03.539406 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4204f6b8-8694-4de9-bae6-1233705af087 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:03.552992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e56541-9024-447a-9fb5-b1c5e2d1d9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:03.554024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e56541-9024-447a-9fb5-b1c5e2d1d9b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:03.554322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e56541-9024-447a-9fb5-b1c5e2d1d9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:03.554588 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e56541-9024-447a-9fb5-b1c5e2d1d9b2 admin admin] PATH_INFO: `/v3/users/f0c5a5705f34440abce48190674a76d5` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:03.573462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e56541-9024-447a-9fb5-b1c5e2d1d9b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0c5a5705f34440abce48190674a76d5)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:03.575415 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e56541-9024-447a-9fb5-b1c5e2d1d9b2 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:03.620949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d4e56541-9024-447a-9fb5-b1c5e2d1d9b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0c5a5705f34440abce48190674a76d5'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:03.627661 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d4e56541-9024-447a-9fb5-b1c5e2d1d9b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0c5a5705f34440abce48190674a76d5'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:03.628285 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d4e56541-9024-447a-9fb5-b1c5e2d1d9b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0c5a5705f34440abce48190674a76d5'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:03.640155 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d4e56541-9024-447a-9fb5-b1c5e2d1d9b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0c5a5705f34440abce48190674a76d5'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:03.640785 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d4e56541-9024-447a-9fb5-b1c5e2d1d9b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0c5a5705f34440abce48190674a76d5'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:03.653431 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1203/2408] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:03 2022] DELETE /identity/v3/users/f0c5a5705f34440abce48190674a76d5 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:03.825981 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8efc9-6709-4d05-abe7-64430c0e9035 service neutron] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:03.842386 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c8efc9-6709-4d05-abe7-64430c0e9035 service neutron] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:03.901116 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a965a-cc35-483a-bf42-40ddd88eca41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:03.901976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a965a-cc35-483a-bf42-40ddd88eca41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:03.902258 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a965a-cc35-483a-bf42-40ddd88eca41 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:03.902532 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a965a-cc35-483a-bf42-40ddd88eca41 admin admin] PATH_INFO: `/v3/projects/def39ced63b64e3aa65c9542ae512e7e` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:03.910471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:03.913302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a965a-cc35-483a-bf42-40ddd88eca41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=def39ced63b64e3aa65c9542ae512e7e)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:03.915557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a965a-cc35-483a-bf42-40ddd88eca41 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:03.967773 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-b29a965a-cc35-483a-bf42-40ddd88eca41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'def39ced63b64e3aa65c9542ae512e7e', 'request_id': 'req-b29a965a-cc35-483a-bf42-40ddd88eca41'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:03.973640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-b29a965a-cc35-483a-bf42-40ddd88eca41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'def39ced63b64e3aa65c9542ae512e7e', 'request_id': 'req-b29a965a-cc35-483a-bf42-40ddd88eca41'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:03.980557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-b29a965a-cc35-483a-bf42-40ddd88eca41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'def39ced63b64e3aa65c9542ae512e7e', 'request_id': 'req-b29a965a-cc35-483a-bf42-40ddd88eca41'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:03.994855 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-b29a965a-cc35-483a-bf42-40ddd88eca41 admin admin] The token cache is being invalidate because project def39ced63b64e3aa65c9542ae512e7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:03.995148 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-b29a965a-cc35-483a-bf42-40ddd88eca41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:03.995813 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-b29a965a-cc35-483a-bf42-40ddd88eca41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:03.997450 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1206/2409] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:03 2022] DELETE /identity/v3/projects/def39ced63b64e3aa65c9542ae512e7e => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:04.003075 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04294724-d3dd-4eea-a78b-0439d1c44bb3 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:04.003417 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04294724-d3dd-4eea-a78b-0439d1c44bb3 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:04.003831 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04294724-d3dd-4eea-a78b-0439d1c44bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:04.022648 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-04294724-d3dd-4eea-a78b-0439d1c44bb3 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:04.023904 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-04294724-d3dd-4eea-a78b-0439d1c44bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:04.083775 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1204/2410] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:04.091581 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94081781-2b8e-4d60-9736-85dd8d7ac7c6 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:04.091909 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94081781-2b8e-4d60-9736-85dd8d7ac7c6 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:04.092192 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94081781-2b8e-4d60-9736-85dd8d7ac7c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:04.109992 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-94081781-2b8e-4d60-9736-85dd8d7ac7c6 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:04.111194 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-94081781-2b8e-4d60-9736-85dd8d7ac7c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:04.119600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1207/2411] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:04.123665 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04294724-d3dd-4eea-a78b-0439d1c44bb3 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:04.133312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04294724-d3dd-4eea-a78b-0439d1c44bb3 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:04.137939 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9716d-585d-441b-967c-956750af7949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:04.138591 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9716d-585d-441b-967c-956750af7949 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:04.138878 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9716d-585d-441b-967c-956750af7949 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:04.139160 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d9716d-585d-441b-967c-956750af7949 admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:04.139948 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9716d-585d-441b-967c-956750af7949 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:37:04.140262 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9716d-585d-441b-967c-956750af7949 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:04.141873 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d9716d-585d-441b-967c-956750af7949 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:04.153609 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1205/2412] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:37:04.157692 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94081781-2b8e-4d60-9736-85dd8d7ac7c6 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:04.167349 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94081781-2b8e-4d60-9736-85dd8d7ac7c6 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:04.172000 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee8675-d034-4839-9a8a-5811b4b204ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:04.172642 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee8675-d034-4839-9a8a-5811b4b204ab admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:04.172929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee8675-d034-4839-9a8a-5811b4b204ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:04.173207 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee8675-d034-4839-9a8a-5811b4b204ab admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:04.173890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee8675-d034-4839-9a8a-5811b4b204ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:04.176446 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee8675-d034-4839-9a8a-5811b4b204ab admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:04.204437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1208/2413] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:04 2022] POST /identity/v3/projects => generated 403 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:04.205562 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9716d-585d-441b-967c-956750af7949 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:04.215410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d9716d-585d-441b-967c-956750af7949 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:04.259560 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:04.272992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab40be-daf3-4433-ba76-56a84c601cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:04.273651 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab40be-daf3-4433-ba76-56a84c601cd5 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:04.273940 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab40be-daf3-4433-ba76-56a84c601cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:04.274217 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ab40be-daf3-4433-ba76-56a84c601cd5 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:04.274895 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab40be-daf3-4433-ba76-56a84c601cd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:04.276860 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ab40be-daf3-4433-ba76-56a84c601cd5 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:04.296115 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1206/2414] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:37:04 2022] POST /identity/v3/users => generated 302 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:37:04.300165 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee8675-d034-4839-9a8a-5811b4b204ab admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:04.310533 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee8675-d034-4839-9a8a-5811b4b204ab admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:04.315218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93682b2-fb28-4f91-8173-a4f807382c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:04.315909 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93682b2-fb28-4f91-8173-a4f807382c8b admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:04.316200 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93682b2-fb28-4f91-8173-a4f807382c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:04.316486 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93682b2-fb28-4f91-8173-a4f807382c8b admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:04.317224 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93682b2-fb28-4f91-8173-a4f807382c8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:04.318829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93682b2-fb28-4f91-8173-a4f807382c8b admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:04.328928 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1209/2415] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:04.333203 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab40be-daf3-4433-ba76-56a84c601cd5 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:04.342955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ab40be-daf3-4433-ba76-56a84c601cd5 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:04.348184 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4c88a2-0368-4892-95d0-7915bb8ff653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:04.348826 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c88a2-0368-4892-95d0-7915bb8ff653 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:04.349111 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c88a2-0368-4892-95d0-7915bb8ff653 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:04.349391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4c88a2-0368-4892-95d0-7915bb8ff653 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:04.350108 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c88a2-0368-4892-95d0-7915bb8ff653 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:04.351730 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4c88a2-0368-4892-95d0-7915bb8ff653 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:04.361432 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1207/2416] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:04.365212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93682b2-fb28-4f91-8173-a4f807382c8b admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:04.374982 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93682b2-fb28-4f91-8173-a4f807382c8b admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:04.379600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8946c3-3606-4fc3-9e70-1884b9578214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:04.380518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8946c3-3606-4fc3-9e70-1884b9578214 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:04.380809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8946c3-3606-4fc3-9e70-1884b9578214 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:04.381092 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8946c3-3606-4fc3-9e70-1884b9578214 admin admin] PATH_INFO: `/v3/projects/2ed1e3becaa344d0af296aaab0bb84e0/users/ed5aedf6f2ba4d7e99b3e58000db8d75/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:04.396469 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8946c3-3606-4fc3-9e70-1884b9578214 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ed1e3becaa344d0af296aaab0bb84e0, user_id=ed5aedf6f2ba4d7e99b3e58000db8d75, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:04.399133 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8946c3-3606-4fc3-9e70-1884b9578214 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:04.412501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1210/2417] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:04 2022] PUT /identity/v3/projects/2ed1e3becaa344d0af296aaab0bb84e0/users/ed5aedf6f2ba4d7e99b3e58000db8d75/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:04.417370 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef044be-9d6e-49aa-82a4-f7b08aa47110 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:04.417667 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef044be-9d6e-49aa-82a4-f7b08aa47110 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:04.417950 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef044be-9d6e-49aa-82a4-f7b08aa47110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:04.436558 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-2ef044be-9d6e-49aa-82a4-f7b08aa47110 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:04.437768 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-2ef044be-9d6e-49aa-82a4-f7b08aa47110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:04.494978 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1208/2418] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:04.504527 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8946c3-3606-4fc3-9e70-1884b9578214 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:04.506302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-5e8946c3-3606-4fc3-9e70-1884b9578214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:04.563537 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8946c3-3606-4fc3-9e70-1884b9578214 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:04.567166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf62a6-7b65-44c1-9b0f-ad305859632a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:04.567840 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf62a6-7b65-44c1-9b0f-ad305859632a service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:04.568151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf62a6-7b65-44c1-9b0f-ad305859632a service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:04.568401 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cf62a6-7b65-44c1-9b0f-ad305859632a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:04.577351 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf62a6-7b65-44c1-9b0f-ad305859632a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:04.578793 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cf62a6-7b65-44c1-9b0f-ad305859632a service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:04.588685 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1211/2419] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:37:05.207499 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d31a1e-57f8-47ee-b8ce-f4afa2fb95e6 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:05.208068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d31a1e-57f8-47ee-b8ce-f4afa2fb95e6 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:05.208068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d31a1e-57f8-47ee-b8ce-f4afa2fb95e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:05.233617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-36d31a1e-57f8-47ee-b8ce-f4afa2fb95e6 None None] MFA Rules not processed for user `ed5aedf6f2ba4d7e99b3e58000db8d75`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:05.234837 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-36d31a1e-57f8-47ee-b8ce-f4afa2fb95e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:05.300650 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1209/2420] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:05.305185 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf62a6-7b65-44c1-9b0f-ad305859632a service neutron] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:05.314756 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cf62a6-7b65-44c1-9b0f-ad305859632a service neutron] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:05.320046 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7172a4-4b09-4c34-bcb1-72593f85c42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:05.320703 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7172a4-4b09-4c34-bcb1-72593f85c42e admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:05.320989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7172a4-4b09-4c34-bcb1-72593f85c42e admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:05.321263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7172a4-4b09-4c34-bcb1-72593f85c42e admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:05.321990 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7172a4-4b09-4c34-bcb1-72593f85c42e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:05.323920 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7172a4-4b09-4c34-bcb1-72593f85c42e admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:05.350575 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1212/2421] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:05 2022] POST /identity/v3/projects => generated 403 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:05.354537 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d31a1e-57f8-47ee-b8ce-f4afa2fb95e6 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:05.366031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d31a1e-57f8-47ee-b8ce-f4afa2fb95e6 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:05.416818 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:05.423959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4356b-7221-4798-b8db-ec9fb13c9002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:05.425448 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4356b-7221-4798-b8db-ec9fb13c9002 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:05.425854 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4356b-7221-4798-b8db-ec9fb13c9002 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:05.426285 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f4356b-7221-4798-b8db-ec9fb13c9002 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:05.427176 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4356b-7221-4798-b8db-ec9fb13c9002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:05.429184 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f4356b-7221-4798-b8db-ec9fb13c9002 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:05.448719 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1210/2422] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:37:05 2022] POST /identity/v3/users => generated 308 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:05.452686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7172a4-4b09-4c34-bcb1-72593f85c42e admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:05.459349 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:05.463417 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7172a4-4b09-4c34-bcb1-72593f85c42e admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:05.469335 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84e4ce-2acb-46c3-90d4-b3ffa0ca9936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:05.470158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84e4ce-2acb-46c3-90d4-b3ffa0ca9936 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:05.470628 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84e4ce-2acb-46c3-90d4-b3ffa0ca9936 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:05.470971 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84e4ce-2acb-46c3-90d4-b3ffa0ca9936 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:05.472378 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84e4ce-2acb-46c3-90d4-b3ffa0ca9936 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:05.473983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84e4ce-2acb-46c3-90d4-b3ffa0ca9936 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:05.484625 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1213/2423] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:05.489404 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4356b-7221-4798-b8db-ec9fb13c9002 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:05.499293 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f4356b-7221-4798-b8db-ec9fb13c9002 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:05.503934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e481ec-d2bf-4eec-8831-4e1ce850bd6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:05.504797 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e481ec-d2bf-4eec-8831-4e1ce850bd6f admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:05.505079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e481ec-d2bf-4eec-8831-4e1ce850bd6f admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:05.505351 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e481ec-d2bf-4eec-8831-4e1ce850bd6f admin admin] PATH_INFO: `/v3/projects/5488b373c72b4aa3a1c9284d2d9ebae2/users/e74bbd74c2e64ca6a68a08ba70037a38/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:05.520538 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e481ec-d2bf-4eec-8831-4e1ce850bd6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5488b373c72b4aa3a1c9284d2d9ebae2, user_id=e74bbd74c2e64ca6a68a08ba70037a38, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:05.523201 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e481ec-d2bf-4eec-8831-4e1ce850bd6f admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:05.536446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1211/2424] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:05 2022] PUT /identity/v3/projects/5488b373c72b4aa3a1c9284d2d9ebae2/users/e74bbd74c2e64ca6a68a08ba70037a38/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:05.540426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84e4ce-2acb-46c3-90d4-b3ffa0ca9936 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:05.550873 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84e4ce-2acb-46c3-90d4-b3ffa0ca9936 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:05.606565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca2af6-97c0-4504-bc17-79cde2c704ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:05.607272 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca2af6-97c0-4504-bc17-79cde2c704ba admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:05.607564 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca2af6-97c0-4504-bc17-79cde2c704ba admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:05.607873 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca2af6-97c0-4504-bc17-79cde2c704ba admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:05.608627 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca2af6-97c0-4504-bc17-79cde2c704ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:05.610236 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca2af6-97c0-4504-bc17-79cde2c704ba admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:05.620658 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1214/2425] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:05 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:05.624866 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e481ec-d2bf-4eec-8831-4e1ce850bd6f admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:05.634847 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e481ec-d2bf-4eec-8831-4e1ce850bd6f admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:05.639494 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60175f-f75b-4358-93d4-5c82cbe0dca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:05.640398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60175f-f75b-4358-93d4-5c82cbe0dca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:05.640679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60175f-f75b-4358-93d4-5c82cbe0dca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:05.640952 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60175f-f75b-4358-93d4-5c82cbe0dca4 admin admin] PATH_INFO: `/v3/projects/5488b373c72b4aa3a1c9284d2d9ebae2/users/e74bbd74c2e64ca6a68a08ba70037a38/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:05.643153 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60175f-f75b-4358-93d4-5c82cbe0dca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5488b373c72b4aa3a1c9284d2d9ebae2, user_id=e74bbd74c2e64ca6a68a08ba70037a38, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:05.645853 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60175f-f75b-4358-93d4-5c82cbe0dca4 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:05.655887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1212/2426] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:05 2022] PUT /identity/v3/projects/5488b373c72b4aa3a1c9284d2d9ebae2/users/e74bbd74c2e64ca6a68a08ba70037a38/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:06.280452 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a642521-d5fc-41dc-9b30-88baaaddaf4d None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:06.280818 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a642521-d5fc-41dc-9b30-88baaaddaf4d None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:06.281169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a642521-d5fc-41dc-9b30-88baaaddaf4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:06.307899 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-4a642521-d5fc-41dc-9b30-88baaaddaf4d None None] MFA Rules not processed for user `e74bbd74c2e64ca6a68a08ba70037a38`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:06.309117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-4a642521-d5fc-41dc-9b30-88baaaddaf4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:06.381687 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1215/2427] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:06 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:07.385769 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60175f-f75b-4358-93d4-5c82cbe0dca4 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:07.453435 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60175f-f75b-4358-93d4-5c82cbe0dca4 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:07.458261 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4cafe-d2f0-49e4-afdd-c99dc7902444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:07.459124 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4cafe-d2f0-49e4-afdd-c99dc7902444 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:07.459402 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4cafe-d2f0-49e4-afdd-c99dc7902444 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:07.459707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e4cafe-d2f0-49e4-afdd-c99dc7902444 admin admin] PATH_INFO: `/v3/users/ed5aedf6f2ba4d7e99b3e58000db8d75` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:07.460884 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4cafe-d2f0-49e4-afdd-c99dc7902444 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed5aedf6f2ba4d7e99b3e58000db8d75)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:07.468414 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e4cafe-d2f0-49e4-afdd-c99dc7902444 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:07.514495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-59e4cafe-d2f0-49e4-afdd-c99dc7902444 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed5aedf6f2ba4d7e99b3e58000db8d75'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:07.521968 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-59e4cafe-d2f0-49e4-afdd-c99dc7902444 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed5aedf6f2ba4d7e99b3e58000db8d75'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:07.522616 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-59e4cafe-d2f0-49e4-afdd-c99dc7902444 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed5aedf6f2ba4d7e99b3e58000db8d75'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:07.534359 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-59e4cafe-d2f0-49e4-afdd-c99dc7902444 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed5aedf6f2ba4d7e99b3e58000db8d75'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:07.534998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-59e4cafe-d2f0-49e4-afdd-c99dc7902444 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed5aedf6f2ba4d7e99b3e58000db8d75'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:07.547040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1213/2428] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:07 2022] DELETE /identity/v3/users/ed5aedf6f2ba4d7e99b3e58000db8d75 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:07.719557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a642521-d5fc-41dc-9b30-88baaaddaf4d None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:07.730752 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a642521-d5fc-41dc-9b30-88baaaddaf4d None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:07.788604 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cd659-ed69-4806-b067-73965d8fb271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:07.789398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cd659-ed69-4806-b067-73965d8fb271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:07.789688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cd659-ed69-4806-b067-73965d8fb271 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:07.789969 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12cd659-ed69-4806-b067-73965d8fb271 admin admin] PATH_INFO: `/v3/projects/2ed1e3becaa344d0af296aaab0bb84e0` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:07.791189 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12cd659-ed69-4806-b067-73965d8fb271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ed1e3becaa344d0af296aaab0bb84e0)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:07.793143 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12cd659-ed69-4806-b067-73965d8fb271 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:07.811218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:07.840111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-e12cd659-ed69-4806-b067-73965d8fb271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ed1e3becaa344d0af296aaab0bb84e0', 'request_id': 'req-e12cd659-ed69-4806-b067-73965d8fb271'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:07.845826 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-e12cd659-ed69-4806-b067-73965d8fb271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ed1e3becaa344d0af296aaab0bb84e0', 'request_id': 'req-e12cd659-ed69-4806-b067-73965d8fb271'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:07.852982 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-e12cd659-ed69-4806-b067-73965d8fb271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ed1e3becaa344d0af296aaab0bb84e0', 'request_id': 'req-e12cd659-ed69-4806-b067-73965d8fb271'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:07.865638 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-e12cd659-ed69-4806-b067-73965d8fb271 admin admin] The token cache is being invalidate because project 2ed1e3becaa344d0af296aaab0bb84e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:07.865931 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-e12cd659-ed69-4806-b067-73965d8fb271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:07.866578 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-e12cd659-ed69-4806-b067-73965d8fb271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:07.868161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1216/2429] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:07 2022] DELETE /identity/v3/projects/2ed1e3becaa344d0af296aaab0bb84e0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:07.872144 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4cafe-d2f0-49e4-afdd-c99dc7902444 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:07.873555 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-59e4cafe-d2f0-49e4-afdd-c99dc7902444 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:07.886411 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e4cafe-d2f0-49e4-afdd-c99dc7902444 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:07.916426 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:07.949142 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bc70ae-133d-4bae-8b2f-e6cf29f185b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:07.950019 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc70ae-133d-4bae-8b2f-e6cf29f185b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:07.950303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc70ae-133d-4bae-8b2f-e6cf29f185b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:07.950607 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bc70ae-133d-4bae-8b2f-e6cf29f185b8 admin admin] PATH_INFO: `/v3/users/e74bbd74c2e64ca6a68a08ba70037a38` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:07.951832 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc70ae-133d-4bae-8b2f-e6cf29f185b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e74bbd74c2e64ca6a68a08ba70037a38)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:07.953797 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2bc70ae-133d-4bae-8b2f-e6cf29f185b8 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:07.999285 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a2bc70ae-133d-4bae-8b2f-e6cf29f185b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e74bbd74c2e64ca6a68a08ba70037a38'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:08.007553 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a2bc70ae-133d-4bae-8b2f-e6cf29f185b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e74bbd74c2e64ca6a68a08ba70037a38'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:08.008200 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a2bc70ae-133d-4bae-8b2f-e6cf29f185b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e74bbd74c2e64ca6a68a08ba70037a38'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:08.020740 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a2bc70ae-133d-4bae-8b2f-e6cf29f185b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e74bbd74c2e64ca6a68a08ba70037a38'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:08.021360 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a2bc70ae-133d-4bae-8b2f-e6cf29f185b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e74bbd74c2e64ca6a68a08ba70037a38'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:08.033453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1214/2430] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:07 2022] DELETE /identity/v3/users/e74bbd74c2e64ca6a68a08ba70037a38 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:08.202562 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cd659-ed69-4806-b067-73965d8fb271 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:08.204025 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-e12cd659-ed69-4806-b067-73965d8fb271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:08.217684 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12cd659-ed69-4806-b067-73965d8fb271 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:08.276670 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801c5aaa-50c7-4132-95f0-fa5eccd03131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:08.277540 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c5aaa-50c7-4132-95f0-fa5eccd03131 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:08.277825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c5aaa-50c7-4132-95f0-fa5eccd03131 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:08.278103 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801c5aaa-50c7-4132-95f0-fa5eccd03131 admin admin] PATH_INFO: `/v3/projects/5488b373c72b4aa3a1c9284d2d9ebae2` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:08.279285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c5aaa-50c7-4132-95f0-fa5eccd03131 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5488b373c72b4aa3a1c9284d2d9ebae2)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:08.281246 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801c5aaa-50c7-4132-95f0-fa5eccd03131 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:08.326867 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-801c5aaa-50c7-4132-95f0-fa5eccd03131 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5488b373c72b4aa3a1c9284d2d9ebae2', 'request_id': 'req-801c5aaa-50c7-4132-95f0-fa5eccd03131'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:08.332821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-801c5aaa-50c7-4132-95f0-fa5eccd03131 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5488b373c72b4aa3a1c9284d2d9ebae2', 'request_id': 'req-801c5aaa-50c7-4132-95f0-fa5eccd03131'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:08.338771 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-801c5aaa-50c7-4132-95f0-fa5eccd03131 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5488b373c72b4aa3a1c9284d2d9ebae2', 'request_id': 'req-801c5aaa-50c7-4132-95f0-fa5eccd03131'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:08.351081 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-801c5aaa-50c7-4132-95f0-fa5eccd03131 admin admin] The token cache is being invalidate because project 5488b373c72b4aa3a1c9284d2d9ebae2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:08.351375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-801c5aaa-50c7-4132-95f0-fa5eccd03131 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:08.352046 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-801c5aaa-50c7-4132-95f0-fa5eccd03131 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:08.353579 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1217/2431] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:08 2022] DELETE /identity/v3/projects/5488b373c72b4aa3a1c9284d2d9ebae2 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:08.358512 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21855a-bd80-4e16-93e9-63d9dd442b22 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:08.358805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21855a-bd80-4e16-93e9-63d9dd442b22 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:08.359088 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a21855a-bd80-4e16-93e9-63d9dd442b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:08.376927 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-8a21855a-bd80-4e16-93e9-63d9dd442b22 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:08.378633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-8a21855a-bd80-4e16-93e9-63d9dd442b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:08.437341 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1215/2432] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:08.445090 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad856b-9353-4acc-baf8-7519cc2dea8d None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:08.445388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad856b-9353-4acc-baf8-7519cc2dea8d None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:08.445676 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad856b-9353-4acc-baf8-7519cc2dea8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:08.463433 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-c8ad856b-9353-4acc-baf8-7519cc2dea8d None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:08.464651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-c8ad856b-9353-4acc-baf8-7519cc2dea8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:08.472848 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1218/2433] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:08.476848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21855a-bd80-4e16-93e9-63d9dd442b22 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:08.487804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a21855a-bd80-4e16-93e9-63d9dd442b22 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:08.492717 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df222e9-582e-4817-8670-f1c430ddbd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:08.493361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df222e9-582e-4817-8670-f1c430ddbd49 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:08.493643 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df222e9-582e-4817-8670-f1c430ddbd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:08.493981 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df222e9-582e-4817-8670-f1c430ddbd49 admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:08.494789 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df222e9-582e-4817-8670-f1c430ddbd49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:37:08.495097 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df222e9-582e-4817-8670-f1c430ddbd49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:08.496901 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df222e9-582e-4817-8670-f1c430ddbd49 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:08.509294 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1216/2434] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:37:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:37:08.513415 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad856b-9353-4acc-baf8-7519cc2dea8d None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:08.522882 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad856b-9353-4acc-baf8-7519cc2dea8d None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:08.527560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7dffb-5236-459d-a417-eb91b7d2d44d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:08.528237 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7dffb-5236-459d-a417-eb91b7d2d44d admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:08.528526 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7dffb-5236-459d-a417-eb91b7d2d44d admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:08.528807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7dffb-5236-459d-a417-eb91b7d2d44d admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:08.529497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7dffb-5236-459d-a417-eb91b7d2d44d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:08.531412 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7dffb-5236-459d-a417-eb91b7d2d44d admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:08.557108 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1219/2435] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:08 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:08.561129 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df222e9-582e-4817-8670-f1c430ddbd49 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:08.571157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df222e9-582e-4817-8670-f1c430ddbd49 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:08.604231 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:08.630162 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fd795-619d-4ce5-b352-be97814d9d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:08.630832 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fd795-619d-4ce5-b352-be97814d9d76 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:08.631120 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fd795-619d-4ce5-b352-be97814d9d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:08.631404 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26fd795-619d-4ce5-b352-be97814d9d76 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:08.632129 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fd795-619d-4ce5-b352-be97814d9d76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:08.634059 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26fd795-619d-4ce5-b352-be97814d9d76 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:08.652824 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1217/2436] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:37:08 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:37:08.656865 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7dffb-5236-459d-a417-eb91b7d2d44d admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:08.667642 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7dffb-5236-459d-a417-eb91b7d2d44d admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:08.672494 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1185a04-2897-4185-8c62-353dd659102c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:08.673177 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1185a04-2897-4185-8c62-353dd659102c admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:08.673459 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1185a04-2897-4185-8c62-353dd659102c admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:08.673749 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1185a04-2897-4185-8c62-353dd659102c admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:08.675082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1185a04-2897-4185-8c62-353dd659102c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:08.676828 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1185a04-2897-4185-8c62-353dd659102c admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:08.678097 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:08.691263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1220/2437] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:08.692553 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fd795-619d-4ce5-b352-be97814d9d76 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:08.702495 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26fd795-619d-4ce5-b352-be97814d9d76 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:08.707104 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a6041d-061d-4a90-b92d-d5c4b31a9cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:08.707800 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6041d-061d-4a90-b92d-d5c4b31a9cdd admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:08.708087 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6041d-061d-4a90-b92d-d5c4b31a9cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:08.708367 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a6041d-061d-4a90-b92d-d5c4b31a9cdd admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:08.709092 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6041d-061d-4a90-b92d-d5c4b31a9cdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:08.710692 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a6041d-061d-4a90-b92d-d5c4b31a9cdd admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:08.720485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1218/2438] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:08.725212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1185a04-2897-4185-8c62-353dd659102c admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:08.735019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1185a04-2897-4185-8c62-353dd659102c admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:08.740192 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c7a0b-bea1-4f30-a3ee-5ec1b4c43927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:08.741060 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c7a0b-bea1-4f30-a3ee-5ec1b4c43927 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:08.741341 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c7a0b-bea1-4f30-a3ee-5ec1b4c43927 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:08.741614 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c7a0b-bea1-4f30-a3ee-5ec1b4c43927 admin admin] PATH_INFO: `/v3/projects/e2060455267e465cabc2574cf5f8f57f/users/7b5de3124e9d430489afe292d460382e/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:08.755588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c7a0b-bea1-4f30-a3ee-5ec1b4c43927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2060455267e465cabc2574cf5f8f57f, user_id=7b5de3124e9d430489afe292d460382e, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:08.758264 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c7a0b-bea1-4f30-a3ee-5ec1b4c43927 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:08.773018 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1221/2439] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:08 2022] PUT /identity/v3/projects/e2060455267e465cabc2574cf5f8f57f/users/7b5de3124e9d430489afe292d460382e/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:37:08.783070 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e863b-3f11-4407-83f0-29ebfba9933d None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:08.783359 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e863b-3f11-4407-83f0-29ebfba9933d None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:08.784234 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9e863b-3f11-4407-83f0-29ebfba9933d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:08.810444 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-9e9e863b-3f11-4407-83f0-29ebfba9933d None None] MFA Rules not processed for user `7b5de3124e9d430489afe292d460382e`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:08.811694 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-9e9e863b-3f11-4407-83f0-29ebfba9933d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:08.877947 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1219/2440] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:08.882316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c7a0b-bea1-4f30-a3ee-5ec1b4c43927 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:08.943302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c7a0b-bea1-4f30-a3ee-5ec1b4c43927 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:08.947917 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c76ce-b9f4-401a-ac40-7b17b57bef9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:08.948566 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c76ce-b9f4-401a-ac40-7b17b57bef9d admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:08.948849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c76ce-b9f4-401a-ac40-7b17b57bef9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:08.949124 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c76ce-b9f4-401a-ac40-7b17b57bef9d admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:08.949809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c76ce-b9f4-401a-ac40-7b17b57bef9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:08.951740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409c76ce-b9f4-401a-ac40-7b17b57bef9d admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:08.976883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1222/2441] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:08 2022] POST /identity/v3/projects => generated 377 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:08.980968 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e863b-3f11-4407-83f0-29ebfba9933d None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:08.991529 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9e863b-3f11-4407-83f0-29ebfba9933d None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:09.047099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa58103-c1e3-4aef-b956-884a49cde9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:09.047790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa58103-c1e3-4aef-b956-884a49cde9cc admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:09.048078 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa58103-c1e3-4aef-b956-884a49cde9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:09.048357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa58103-c1e3-4aef-b956-884a49cde9cc admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:09.049062 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa58103-c1e3-4aef-b956-884a49cde9cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:09.050986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa58103-c1e3-4aef-b956-884a49cde9cc admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:09.070106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1220/2442] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:37:08 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:09.074122 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c76ce-b9f4-401a-ac40-7b17b57bef9d admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:09.084700 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c76ce-b9f4-401a-ac40-7b17b57bef9d admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:09.089422 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c0dbf-5eba-4e17-84fa-4f30ae669972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:09.090078 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c0dbf-5eba-4e17-84fa-4f30ae669972 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:09.090361 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c0dbf-5eba-4e17-84fa-4f30ae669972 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:09.090636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38c0dbf-5eba-4e17-84fa-4f30ae669972 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:09.091351 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c0dbf-5eba-4e17-84fa-4f30ae669972 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:09.092969 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38c0dbf-5eba-4e17-84fa-4f30ae669972 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:09.103869 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1223/2443] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:09.107867 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa58103-c1e3-4aef-b956-884a49cde9cc admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:09.117989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa58103-c1e3-4aef-b956-884a49cde9cc admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:09.122627 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b75f7f-b060-4d5f-8ef5-978350b135f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:09.123497 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b75f7f-b060-4d5f-8ef5-978350b135f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:09.123822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b75f7f-b060-4d5f-8ef5-978350b135f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:09.124100 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b75f7f-b060-4d5f-8ef5-978350b135f2 admin admin] PATH_INFO: `/v3/projects/fcc6b4e020c1490b88b33e0289b16e1c/users/b107d3cf74ae47b0aed7ee28ed381517/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:09.138940 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b75f7f-b060-4d5f-8ef5-978350b135f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcc6b4e020c1490b88b33e0289b16e1c, user_id=b107d3cf74ae47b0aed7ee28ed381517, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:09.141596 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b75f7f-b060-4d5f-8ef5-978350b135f2 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:09.154652 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1221/2444] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:09 2022] PUT /identity/v3/projects/fcc6b4e020c1490b88b33e0289b16e1c/users/b107d3cf74ae47b0aed7ee28ed381517/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:37:09.158500 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c0dbf-5eba-4e17-84fa-4f30ae669972 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:09.168310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38c0dbf-5eba-4e17-84fa-4f30ae669972 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:09.224742 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e85008-55ad-4e16-9515-78f579e25fe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:09.225411 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e85008-55ad-4e16-9515-78f579e25fe4 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:09.225705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e85008-55ad-4e16-9515-78f579e25fe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:09.225987 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e85008-55ad-4e16-9515-78f579e25fe4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:09.226710 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e85008-55ad-4e16-9515-78f579e25fe4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:09.228347 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e85008-55ad-4e16-9515-78f579e25fe4 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:09.237973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1224/2445] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:09.242108 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b75f7f-b060-4d5f-8ef5-978350b135f2 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:09.252954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b75f7f-b060-4d5f-8ef5-978350b135f2 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:09.257824 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75fee8-18af-403e-bdfc-b4f83b8ef90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:09.258708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75fee8-18af-403e-bdfc-b4f83b8ef90c admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:09.258998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75fee8-18af-403e-bdfc-b4f83b8ef90c admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:09.259282 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75fee8-18af-403e-bdfc-b4f83b8ef90c admin admin] PATH_INFO: `/v3/projects/fcc6b4e020c1490b88b33e0289b16e1c/users/b107d3cf74ae47b0aed7ee28ed381517/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:09.261439 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75fee8-18af-403e-bdfc-b4f83b8ef90c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcc6b4e020c1490b88b33e0289b16e1c, user_id=b107d3cf74ae47b0aed7ee28ed381517, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:09.264179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c75fee8-18af-403e-bdfc-b4f83b8ef90c admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:09.267476 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:09.276919 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1222/2446] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:09 2022] PUT /identity/v3/projects/fcc6b4e020c1490b88b33e0289b16e1c/users/b107d3cf74ae47b0aed7ee28ed381517/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:09.287994 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5627302-449d-4309-94b0-9f5f14f27e3c None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:09.288287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5627302-449d-4309-94b0-9f5f14f27e3c None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:09.288566 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5627302-449d-4309-94b0-9f5f14f27e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:09.314278 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-a5627302-449d-4309-94b0-9f5f14f27e3c None None] MFA Rules not processed for user `b107d3cf74ae47b0aed7ee28ed381517`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:09.316045 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-a5627302-449d-4309-94b0-9f5f14f27e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:09.346628 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:09.384586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1225/2447] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:09 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:09.396354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75fee8-18af-403e-bdfc-b4f83b8ef90c admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:09.398047 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-2c75fee8-18af-403e-bdfc-b4f83b8ef90c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:09.476108 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75fee8-18af-403e-bdfc-b4f83b8ef90c admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:09.480001 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f90150-7331-4982-a935-1fbe0f93a215 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:09.480645 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f90150-7331-4982-a935-1fbe0f93a215 service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:09.480934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f90150-7331-4982-a935-1fbe0f93a215 service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:09.481216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f90150-7331-4982-a935-1fbe0f93a215 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:09.536869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f90150-7331-4982-a935-1fbe0f93a215 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:09.538311 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f90150-7331-4982-a935-1fbe0f93a215 service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:09.547177 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1223/2448] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:09 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:10.731443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5627302-449d-4309-94b0-9f5f14f27e3c None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:10.741537 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5627302-449d-4309-94b0-9f5f14f27e3c None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:10.745086 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc0fb0-379a-4bbe-8a29-3ed833dbd533 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:10.745717 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc0fb0-379a-4bbe-8a29-3ed833dbd533 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:10.746001 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc0fb0-379a-4bbe-8a29-3ed833dbd533 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:10.746276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc0fb0-379a-4bbe-8a29-3ed833dbd533 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:10.748065 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-c0fc0fb0-379a-4bbe-8a29-3ed833dbd533 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:10.827850 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc0fb0-379a-4bbe-8a29-3ed833dbd533 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:10.829301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc0fb0-379a-4bbe-8a29-3ed833dbd533 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:10.848632 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1226/2449] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:16.185279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f90150-7331-4982-a935-1fbe0f93a215 service cinder] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:16.193773 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f90150-7331-4982-a935-1fbe0f93a215 service cinder] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:16.197493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c983a1-30a1-47d4-9b5e-e7faa8d89aae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:16.198138 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c983a1-30a1-47d4-9b5e-e7faa8d89aae service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:16.198429 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c983a1-30a1-47d4-9b5e-e7faa8d89aae service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:16.198708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c983a1-30a1-47d4-9b5e-e7faa8d89aae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:16.208601 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c983a1-30a1-47d4-9b5e-e7faa8d89aae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:16.210048 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c983a1-30a1-47d4-9b5e-e7faa8d89aae service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:16.219833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1224/2450] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:16 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:16.947932 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc0fb0-379a-4bbe-8a29-3ed833dbd533 service cinder] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:16.949507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-c0fc0fb0-379a-4bbe-8a29-3ed833dbd533 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:17.036822 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc0fb0-379a-4bbe-8a29-3ed833dbd533 service cinder] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:17.044126 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42191b3f-6fcd-4cad-b7ec-1f9ddf1dd660 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:17.045187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42191b3f-6fcd-4cad-b7ec-1f9ddf1dd660 service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:17.045634 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42191b3f-6fcd-4cad-b7ec-1f9ddf1dd660 service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:17.046096 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42191b3f-6fcd-4cad-b7ec-1f9ddf1dd660 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:17.048745 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-42191b3f-6fcd-4cad-b7ec-1f9ddf1dd660 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:17.066417 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42191b3f-6fcd-4cad-b7ec-1f9ddf1dd660 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:17.068251 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42191b3f-6fcd-4cad-b7ec-1f9ddf1dd660 service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:17.084936 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1227/2451] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:22.452396 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c983a1-30a1-47d4-9b5e-e7faa8d89aae service cinder] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:22.453831 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a8c983a1-30a1-47d4-9b5e-e7faa8d89aae service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:22.509896 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c983a1-30a1-47d4-9b5e-e7faa8d89aae service cinder] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:22.513652 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a0a37-1615-4b9c-81f8-a2bc0c614d31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:22.514288 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a0a37-1615-4b9c-81f8-a2bc0c614d31 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:22.514570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a0a37-1615-4b9c-81f8-a2bc0c614d31 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:22.514840 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945a0a37-1615-4b9c-81f8-a2bc0c614d31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:22.517077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-945a0a37-1615-4b9c-81f8-a2bc0c614d31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:22.527083 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a0a37-1615-4b9c-81f8-a2bc0c614d31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:22.528540 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945a0a37-1615-4b9c-81f8-a2bc0c614d31 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:22.538063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1225/2452] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:22 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:27.076473 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=90 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:29.796867 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42191b3f-6fcd-4cad-b7ec-1f9ddf1dd660 service nova] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:29.798428 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-42191b3f-6fcd-4cad-b7ec-1f9ddf1dd660 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:29.810503 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42191b3f-6fcd-4cad-b7ec-1f9ddf1dd660 service nova] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:29.814159 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aed15f-c61d-460b-9788-738622a3e663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:29.815373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aed15f-c61d-460b-9788-738622a3e663 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:29.815696 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aed15f-c61d-460b-9788-738622a3e663 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:29.815979 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aed15f-c61d-460b-9788-738622a3e663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:29.817732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-56aed15f-c61d-460b-9788-738622a3e663 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:29.879167 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aed15f-c61d-460b-9788-738622a3e663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:29.880641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aed15f-c61d-460b-9788-738622a3e663 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:29.890521 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1228/2453] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:37:32.534125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=91 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:32.907174 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a0a37-1615-4b9c-81f8-a2bc0c614d31 service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:32.909613 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-945a0a37-1615-4b9c-81f8-a2bc0c614d31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:32.925064 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945a0a37-1615-4b9c-81f8-a2bc0c614d31 service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:32.929570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23996269-f8f6-42d5-86d3-d7ddf0aa26b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:32.930409 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23996269-f8f6-42d5-86d3-d7ddf0aa26b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:32.930689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23996269-f8f6-42d5-86d3-d7ddf0aa26b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:32.931127 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23996269-f8f6-42d5-86d3-d7ddf0aa26b5 admin admin] PATH_INFO: `/v3/users/a6c145cb49f54dd88307f416ff1bb92b` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:32.933831 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23996269-f8f6-42d5-86d3-d7ddf0aa26b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6c145cb49f54dd88307f416ff1bb92b)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:32.936035 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23996269-f8f6-42d5-86d3-d7ddf0aa26b5 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:32.982782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-23996269-f8f6-42d5-86d3-d7ddf0aa26b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6c145cb49f54dd88307f416ff1bb92b'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:32.989977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-23996269-f8f6-42d5-86d3-d7ddf0aa26b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6c145cb49f54dd88307f416ff1bb92b'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:32.990552 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-23996269-f8f6-42d5-86d3-d7ddf0aa26b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6c145cb49f54dd88307f416ff1bb92b'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:33.002494 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-23996269-f8f6-42d5-86d3-d7ddf0aa26b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6c145cb49f54dd88307f416ff1bb92b'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:33.003129 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-23996269-f8f6-42d5-86d3-d7ddf0aa26b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6c145cb49f54dd88307f416ff1bb92b'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:33.015246 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1226/2454] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:32 2022] DELETE /identity/v3/users/a6c145cb49f54dd88307f416ff1bb92b => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:33.186441 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aed15f-c61d-460b-9788-738622a3e663 service neutron] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:33.196978 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aed15f-c61d-460b-9788-738622a3e663 service neutron] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:33.253339 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fbc9ad-225a-48b4-9d01-5bc43beeb354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:33.254123 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbc9ad-225a-48b4-9d01-5bc43beeb354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:33.254413 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbc9ad-225a-48b4-9d01-5bc43beeb354 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:33.254692 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fbc9ad-225a-48b4-9d01-5bc43beeb354 admin admin] PATH_INFO: `/v3/projects/0a869108ba4446c4b767d186c5db253f` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:33.255929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fbc9ad-225a-48b4-9d01-5bc43beeb354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a869108ba4446c4b767d186c5db253f)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:33.257841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fbc9ad-225a-48b4-9d01-5bc43beeb354 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:33.302677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-64fbc9ad-225a-48b4-9d01-5bc43beeb354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a869108ba4446c4b767d186c5db253f', 'request_id': 'req-64fbc9ad-225a-48b4-9d01-5bc43beeb354'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:33.308032 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-64fbc9ad-225a-48b4-9d01-5bc43beeb354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a869108ba4446c4b767d186c5db253f', 'request_id': 'req-64fbc9ad-225a-48b4-9d01-5bc43beeb354'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:33.313909 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-64fbc9ad-225a-48b4-9d01-5bc43beeb354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a869108ba4446c4b767d186c5db253f', 'request_id': 'req-64fbc9ad-225a-48b4-9d01-5bc43beeb354'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:33.326108 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-64fbc9ad-225a-48b4-9d01-5bc43beeb354 admin admin] The token cache is being invalidate because project 0a869108ba4446c4b767d186c5db253f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:33.326395 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-64fbc9ad-225a-48b4-9d01-5bc43beeb354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:33.327012 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-64fbc9ad-225a-48b4-9d01-5bc43beeb354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:33.328547 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1229/2455] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:33 2022] DELETE /identity/v3/projects/0a869108ba4446c4b767d186c5db253f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:33.334348 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb675bd-759f-496c-a87c-216ccf47a2aa None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:33.334639 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb675bd-759f-496c-a87c-216ccf47a2aa None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:33.334919 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb675bd-759f-496c-a87c-216ccf47a2aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:33.352695 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-9fb675bd-759f-496c-a87c-216ccf47a2aa None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:33.353885 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-9fb675bd-759f-496c-a87c-216ccf47a2aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:33.410961 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1227/2456] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:33.419012 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f9fbd-b148-4b05-9054-ab617218fbe3 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:33.419305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f9fbd-b148-4b05-9054-ab617218fbe3 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:33.419586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f9fbd-b148-4b05-9054-ab617218fbe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:33.437649 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-544f9fbd-b148-4b05-9054-ab617218fbe3 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:33.438833 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-544f9fbd-b148-4b05-9054-ab617218fbe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:33.447109 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1230/2457] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:33.451093 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb675bd-759f-496c-a87c-216ccf47a2aa None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:33.461325 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb675bd-759f-496c-a87c-216ccf47a2aa None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:33.466042 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43655429-b9b7-45e0-a44a-b6620f28c143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:33.466699 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43655429-b9b7-45e0-a44a-b6620f28c143 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:33.466987 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43655429-b9b7-45e0-a44a-b6620f28c143 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:33.467266 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43655429-b9b7-45e0-a44a-b6620f28c143 admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:33.468032 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43655429-b9b7-45e0-a44a-b6620f28c143 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:37:33.468343 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43655429-b9b7-45e0-a44a-b6620f28c143 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:33.469952 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43655429-b9b7-45e0-a44a-b6620f28c143 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:33.481505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1228/2458] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:37:33.485786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f9fbd-b148-4b05-9054-ab617218fbe3 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:33.495461 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f9fbd-b148-4b05-9054-ab617218fbe3 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:33.500137 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cc13d-a25f-4a9b-ac96-9b7b3d6d8f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:33.500781 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cc13d-a25f-4a9b-ac96-9b7b3d6d8f2d admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:33.501067 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cc13d-a25f-4a9b-ac96-9b7b3d6d8f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:33.501342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cc13d-a25f-4a9b-ac96-9b7b3d6d8f2d admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:33.502590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7cc13d-a25f-4a9b-ac96-9b7b3d6d8f2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:33.504575 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7cc13d-a25f-4a9b-ac96-9b7b3d6d8f2d admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:33.518252 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:33.531975 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1231/2459] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:33 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:37:33.535942 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43655429-b9b7-45e0-a44a-b6620f28c143 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:33.545880 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43655429-b9b7-45e0-a44a-b6620f28c143 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:33.601726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815e4d9-49ba-44da-955a-922b6ebf1f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:33.602387 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815e4d9-49ba-44da-955a-922b6ebf1f4b admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:33.602672 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815e4d9-49ba-44da-955a-922b6ebf1f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:33.602948 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1815e4d9-49ba-44da-955a-922b6ebf1f4b admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:33.603670 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815e4d9-49ba-44da-955a-922b6ebf1f4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:33.605589 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1815e4d9-49ba-44da-955a-922b6ebf1f4b admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:33.612121 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:33.627430 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1229/2460] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:37:33 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:37:33.631522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cc13d-a25f-4a9b-ac96-9b7b3d6d8f2d admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:33.642397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cc13d-a25f-4a9b-ac96-9b7b3d6d8f2d admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:33.647565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dcd35-a7aa-4df7-b32d-eed7b5181ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:33.648244 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dcd35-a7aa-4df7-b32d-eed7b5181ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:33.648528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dcd35-a7aa-4df7-b32d-eed7b5181ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:33.648807 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7dcd35-a7aa-4df7-b32d-eed7b5181ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:33.649527 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7dcd35-a7aa-4df7-b32d-eed7b5181ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:33.651120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7dcd35-a7aa-4df7-b32d-eed7b5181ad8 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:33.661852 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1232/2461] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:33.665690 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815e4d9-49ba-44da-955a-922b6ebf1f4b admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:33.675751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1815e4d9-49ba-44da-955a-922b6ebf1f4b admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:33.680350 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac75626-6e75-4534-b002-33a4e483794d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:33.681032 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac75626-6e75-4534-b002-33a4e483794d admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:33.681315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac75626-6e75-4534-b002-33a4e483794d admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:33.681594 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac75626-6e75-4534-b002-33a4e483794d admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:33.682308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac75626-6e75-4534-b002-33a4e483794d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:33.683931 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac75626-6e75-4534-b002-33a4e483794d admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:33.693815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1230/2462] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:33.698700 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dcd35-a7aa-4df7-b32d-eed7b5181ad8 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:33.709052 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7dcd35-a7aa-4df7-b32d-eed7b5181ad8 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:33.713762 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e60c3-d72e-4b58-bda3-08b25bc6a324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:33.714660 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e60c3-d72e-4b58-bda3-08b25bc6a324 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:33.714945 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e60c3-d72e-4b58-bda3-08b25bc6a324 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:33.715221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e60c3-d72e-4b58-bda3-08b25bc6a324 admin admin] PATH_INFO: `/v3/projects/9f60e0fd890d4b7f815fbe273b067c72/users/8cd9eab960e74618b0570a124ad7ce10/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:33.730688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e60c3-d72e-4b58-bda3-08b25bc6a324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f60e0fd890d4b7f815fbe273b067c72, user_id=8cd9eab960e74618b0570a124ad7ce10, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:33.733420 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e60c3-d72e-4b58-bda3-08b25bc6a324 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:33.746082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1233/2463] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:33 2022] PUT /identity/v3/projects/9f60e0fd890d4b7f815fbe273b067c72/users/8cd9eab960e74618b0570a124ad7ce10/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:33.756046 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750b848-2f56-44f6-8d33-b5c08b0017f5 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:33.756390 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750b848-2f56-44f6-8d33-b5c08b0017f5 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:33.756674 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9750b848-2f56-44f6-8d33-b5c08b0017f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:33.783164 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-9750b848-2f56-44f6-8d33-b5c08b0017f5 None None] MFA Rules not processed for user `8cd9eab960e74618b0570a124ad7ce10`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:33.785126 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-9750b848-2f56-44f6-8d33-b5c08b0017f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:33.850241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1231/2464] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:33 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:33.854682 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e60c3-d72e-4b58-bda3-08b25bc6a324 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:33.915316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e60c3-d72e-4b58-bda3-08b25bc6a324 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:33.919929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789768f-eb94-4ffb-87bd-23546c04d23f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:33.920583 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789768f-eb94-4ffb-87bd-23546c04d23f admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:33.920866 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789768f-eb94-4ffb-87bd-23546c04d23f admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:33.921143 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c789768f-eb94-4ffb-87bd-23546c04d23f admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:33.921828 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789768f-eb94-4ffb-87bd-23546c04d23f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:33.923995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c789768f-eb94-4ffb-87bd-23546c04d23f admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:33.949408 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1234/2465] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:33 2022] POST /identity/v3/projects => generated 403 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:33.953375 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750b848-2f56-44f6-8d33-b5c08b0017f5 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:33.965194 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9750b848-2f56-44f6-8d33-b5c08b0017f5 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:34.023815 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f998cd3-8a37-4f52-bbcd-76503a57614e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:34.024496 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f998cd3-8a37-4f52-bbcd-76503a57614e admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:34.024778 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f998cd3-8a37-4f52-bbcd-76503a57614e admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:34.025052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f998cd3-8a37-4f52-bbcd-76503a57614e admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:34.025747 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f998cd3-8a37-4f52-bbcd-76503a57614e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:34.027696 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f998cd3-8a37-4f52-bbcd-76503a57614e admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:34.051088 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1232/2466] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:37:33 2022] POST /identity/v3/users => generated 308 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:34.052110 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789768f-eb94-4ffb-87bd-23546c04d23f admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:34.062317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c789768f-eb94-4ffb-87bd-23546c04d23f admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:34.067508 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800396d-f83f-4552-9106-cca455931698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:34.068211 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800396d-f83f-4552-9106-cca455931698 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:34.068497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800396d-f83f-4552-9106-cca455931698 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:34.068779 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5800396d-f83f-4552-9106-cca455931698 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:34.069512 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800396d-f83f-4552-9106-cca455931698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:34.071104 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5800396d-f83f-4552-9106-cca455931698 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:34.082324 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1235/2467] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:34.086426 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f998cd3-8a37-4f52-bbcd-76503a57614e admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:34.096301 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f998cd3-8a37-4f52-bbcd-76503a57614e admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:34.100849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac9329-17bd-4d36-a13d-45e6dd3963b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:34.102276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac9329-17bd-4d36-a13d-45e6dd3963b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:34.102566 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac9329-17bd-4d36-a13d-45e6dd3963b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:34.102843 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac9329-17bd-4d36-a13d-45e6dd3963b0 admin admin] PATH_INFO: `/v3/projects/c247fab0b4644c04ab04e3e8147bfad8/users/b101099f9b4c41bbac1b470937e1abff/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:34.117166 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac9329-17bd-4d36-a13d-45e6dd3963b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c247fab0b4644c04ab04e3e8147bfad8, user_id=b101099f9b4c41bbac1b470937e1abff, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:34.119883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac9329-17bd-4d36-a13d-45e6dd3963b0 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:34.133073 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1233/2468] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:34 2022] PUT /identity/v3/projects/c247fab0b4644c04ab04e3e8147bfad8/users/b101099f9b4c41bbac1b470937e1abff/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:37:34.137326 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800396d-f83f-4552-9106-cca455931698 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:34.148042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5800396d-f83f-4552-9106-cca455931698 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:34.203374 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76559c7c-97e0-4876-b0ba-896e4f45f866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:34.204067 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76559c7c-97e0-4876-b0ba-896e4f45f866 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:34.204354 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76559c7c-97e0-4876-b0ba-896e4f45f866 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:34.204633 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76559c7c-97e0-4876-b0ba-896e4f45f866 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:34.205925 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76559c7c-97e0-4876-b0ba-896e4f45f866 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:34.207522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76559c7c-97e0-4876-b0ba-896e4f45f866 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:34.217155 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1236/2469] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:34.221308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac9329-17bd-4d36-a13d-45e6dd3963b0 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:34.231319 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac9329-17bd-4d36-a13d-45e6dd3963b0 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:34.236080 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd267a5-4eba-4fba-950b-da9a2366d8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:34.237504 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd267a5-4eba-4fba-950b-da9a2366d8eb admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:34.237808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd267a5-4eba-4fba-950b-da9a2366d8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:34.238065 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd267a5-4eba-4fba-950b-da9a2366d8eb admin admin] PATH_INFO: `/v3/projects/c247fab0b4644c04ab04e3e8147bfad8/users/b101099f9b4c41bbac1b470937e1abff/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:34.240058 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd267a5-4eba-4fba-950b-da9a2366d8eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c247fab0b4644c04ab04e3e8147bfad8, user_id=b101099f9b4c41bbac1b470937e1abff, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:34.242736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd267a5-4eba-4fba-950b-da9a2366d8eb admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:34.253526 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1234/2470] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:34 2022] PUT /identity/v3/projects/c247fab0b4644c04ab04e3e8147bfad8/users/b101099f9b4c41bbac1b470937e1abff/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:34.263377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eeb802-ecb3-4809-8a1a-428d818cc38b None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:34.263701 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eeb802-ecb3-4809-8a1a-428d818cc38b None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:34.263988 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eeb802-ecb3-4809-8a1a-428d818cc38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:34.290038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-66eeb802-ecb3-4809-8a1a-428d818cc38b None None] MFA Rules not processed for user `b101099f9b4c41bbac1b470937e1abff`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:34.291158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-66eeb802-ecb3-4809-8a1a-428d818cc38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:34.309396 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:34.359282 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1237/2471] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:34 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:34.370392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd267a5-4eba-4fba-950b-da9a2366d8eb admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:34.372120 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-ebd267a5-4eba-4fba-950b-da9a2366d8eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:34.395107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:34.430045 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd267a5-4eba-4fba-950b-da9a2366d8eb admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:34.433723 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef180aa-0649-4526-849b-be962ff4bd40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:34.434365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef180aa-0649-4526-849b-be962ff4bd40 service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:34.434652 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef180aa-0649-4526-849b-be962ff4bd40 service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:34.434931 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef180aa-0649-4526-849b-be962ff4bd40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:34.444094 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef180aa-0649-4526-849b-be962ff4bd40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:34.445536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef180aa-0649-4526-849b-be962ff4bd40 service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:34.454885 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1235/2472] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:34 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:34.598465 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eeb802-ecb3-4809-8a1a-428d818cc38b None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:34.660302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eeb802-ecb3-4809-8a1a-428d818cc38b None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:34.664846 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990fa3b-b753-4798-a4c3-eafa27ee3618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:34.665708 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990fa3b-b753-4798-a4c3-eafa27ee3618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:34.665993 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990fa3b-b753-4798-a4c3-eafa27ee3618 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:34.666271 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7990fa3b-b753-4798-a4c3-eafa27ee3618 admin admin] PATH_INFO: `/v3/users/8cd9eab960e74618b0570a124ad7ce10` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:34.667464 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990fa3b-b753-4798-a4c3-eafa27ee3618 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cd9eab960e74618b0570a124ad7ce10)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:34.669436 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7990fa3b-b753-4798-a4c3-eafa27ee3618 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:34.714657 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7990fa3b-b753-4798-a4c3-eafa27ee3618 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cd9eab960e74618b0570a124ad7ce10'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:34.722819 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7990fa3b-b753-4798-a4c3-eafa27ee3618 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cd9eab960e74618b0570a124ad7ce10'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:34.723516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7990fa3b-b753-4798-a4c3-eafa27ee3618 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cd9eab960e74618b0570a124ad7ce10'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:34.724235 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7990fa3b-b753-4798-a4c3-eafa27ee3618 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cd9eab960e74618b0570a124ad7ce10'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:34.736280 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7990fa3b-b753-4798-a4c3-eafa27ee3618 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cd9eab960e74618b0570a124ad7ce10'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:34.748996 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1238/2473] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:34 2022] DELETE /identity/v3/users/8cd9eab960e74618b0570a124ad7ce10 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:34.753456 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79286c75-804d-4425-9b11-fc821fcf0a65 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:34.753938 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79286c75-804d-4425-9b11-fc821fcf0a65 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:34.754051 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79286c75-804d-4425-9b11-fc821fcf0a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:34.771641 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-79286c75-804d-4425-9b11-fc821fcf0a65 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:34.772831 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-79286c75-804d-4425-9b11-fc821fcf0a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:34.832716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1236/2474] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:34.842881 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990fa3b-b753-4798-a4c3-eafa27ee3618 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:34.844704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-7990fa3b-b753-4798-a4c3-eafa27ee3618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:34.884342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:34.903064 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7990fa3b-b753-4798-a4c3-eafa27ee3618 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:34.906762 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb3d00-7d54-4d1b-95f1-43594d8d6492 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:34.907404 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb3d00-7d54-4d1b-95f1-43594d8d6492 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:34.907733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb3d00-7d54-4d1b-95f1-43594d8d6492 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:34.908013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb3d00-7d54-4d1b-95f1-43594d8d6492 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:34.916935 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb3d00-7d54-4d1b-95f1-43594d8d6492 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:34.918388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb3d00-7d54-4d1b-95f1-43594d8d6492 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:34.928040 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1239/2475] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:35.431522 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79286c75-804d-4425-9b11-fc821fcf0a65 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:35.432992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-79286c75-804d-4425-9b11-fc821fcf0a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:35.445625 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79286c75-804d-4425-9b11-fc821fcf0a65 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:35.450339 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395cadc-101c-47e6-bc12-7c94d3b17f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:35.451240 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395cadc-101c-47e6-bc12-7c94d3b17f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:35.451522 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395cadc-101c-47e6-bc12-7c94d3b17f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:35.451828 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2395cadc-101c-47e6-bc12-7c94d3b17f81 admin admin] PATH_INFO: `/v3/projects/9f60e0fd890d4b7f815fbe273b067c72` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:35.453076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395cadc-101c-47e6-bc12-7c94d3b17f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f60e0fd890d4b7f815fbe273b067c72)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:35.455594 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2395cadc-101c-47e6-bc12-7c94d3b17f81 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:35.500315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2395cadc-101c-47e6-bc12-7c94d3b17f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f60e0fd890d4b7f815fbe273b067c72', 'request_id': 'req-2395cadc-101c-47e6-bc12-7c94d3b17f81'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:35.506208 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2395cadc-101c-47e6-bc12-7c94d3b17f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f60e0fd890d4b7f815fbe273b067c72', 'request_id': 'req-2395cadc-101c-47e6-bc12-7c94d3b17f81'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:35.512175 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2395cadc-101c-47e6-bc12-7c94d3b17f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f60e0fd890d4b7f815fbe273b067c72', 'request_id': 'req-2395cadc-101c-47e6-bc12-7c94d3b17f81'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:35.525022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2395cadc-101c-47e6-bc12-7c94d3b17f81 admin admin] The token cache is being invalidate because project 9f60e0fd890d4b7f815fbe273b067c72 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:35.525305 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2395cadc-101c-47e6-bc12-7c94d3b17f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:35.526027 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2395cadc-101c-47e6-bc12-7c94d3b17f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:35.527570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1237/2476] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:35 2022] DELETE /identity/v3/projects/9f60e0fd890d4b7f815fbe273b067c72 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:35.531569 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb3d00-7d54-4d1b-95f1-43594d8d6492 service neutron] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:35.541503 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb3d00-7d54-4d1b-95f1-43594d8d6492 service neutron] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:35.597066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b80246a-7fdd-40de-b8cd-e303f6646601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:35.597933 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80246a-7fdd-40de-b8cd-e303f6646601 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:35.598216 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80246a-7fdd-40de-b8cd-e303f6646601 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:35.598494 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b80246a-7fdd-40de-b8cd-e303f6646601 admin admin] PATH_INFO: `/v3/users/b101099f9b4c41bbac1b470937e1abff` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:35.599707 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80246a-7fdd-40de-b8cd-e303f6646601 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b101099f9b4c41bbac1b470937e1abff)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:35.601634 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b80246a-7fdd-40de-b8cd-e303f6646601 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:35.649361 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-5b80246a-7fdd-40de-b8cd-e303f6646601 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b101099f9b4c41bbac1b470937e1abff'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:35.656349 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-5b80246a-7fdd-40de-b8cd-e303f6646601 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b101099f9b4c41bbac1b470937e1abff'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:35.656964 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-5b80246a-7fdd-40de-b8cd-e303f6646601 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b101099f9b4c41bbac1b470937e1abff'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:35.657579 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-5b80246a-7fdd-40de-b8cd-e303f6646601 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b101099f9b4c41bbac1b470937e1abff'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:35.669483 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-5b80246a-7fdd-40de-b8cd-e303f6646601 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b101099f9b4c41bbac1b470937e1abff'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:35.681494 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1240/2477] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:35 2022] DELETE /identity/v3/users/b101099f9b4c41bbac1b470937e1abff => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:35.957964 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395cadc-101c-47e6-bc12-7c94d3b17f81 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:35.958850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-2395cadc-101c-47e6-bc12-7c94d3b17f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:35.972697 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2395cadc-101c-47e6-bc12-7c94d3b17f81 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:36.027961 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:36.043505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4bab16-f97d-4270-b1fb-eccfa8573414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:36.044401 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bab16-f97d-4270-b1fb-eccfa8573414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:36.044686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bab16-f97d-4270-b1fb-eccfa8573414 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:36.044961 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4bab16-f97d-4270-b1fb-eccfa8573414 admin admin] PATH_INFO: `/v3/projects/c247fab0b4644c04ab04e3e8147bfad8` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:36.046135 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4bab16-f97d-4270-b1fb-eccfa8573414 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c247fab0b4644c04ab04e3e8147bfad8)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:36.048124 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4bab16-f97d-4270-b1fb-eccfa8573414 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:36.092005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-ed4bab16-f97d-4270-b1fb-eccfa8573414 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c247fab0b4644c04ab04e3e8147bfad8', 'request_id': 'req-ed4bab16-f97d-4270-b1fb-eccfa8573414'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:36.098001 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-ed4bab16-f97d-4270-b1fb-eccfa8573414 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c247fab0b4644c04ab04e3e8147bfad8', 'request_id': 'req-ed4bab16-f97d-4270-b1fb-eccfa8573414'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:36.103946 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-ed4bab16-f97d-4270-b1fb-eccfa8573414 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c247fab0b4644c04ab04e3e8147bfad8', 'request_id': 'req-ed4bab16-f97d-4270-b1fb-eccfa8573414'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:36.115952 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-ed4bab16-f97d-4270-b1fb-eccfa8573414 admin admin] The token cache is being invalidate because project c247fab0b4644c04ab04e3e8147bfad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:36.116318 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-ed4bab16-f97d-4270-b1fb-eccfa8573414 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:36.116980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-ed4bab16-f97d-4270-b1fb-eccfa8573414 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:36.118510 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1238/2478] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:35 2022] DELETE /identity/v3/projects/c247fab0b4644c04ab04e3e8147bfad8 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:36.123560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0bc52-717b-4a69-bf3f-86b43f8ed333 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:36.123901 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0bc52-717b-4a69-bf3f-86b43f8ed333 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:36.124191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed0bc52-717b-4a69-bf3f-86b43f8ed333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:36.142849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-aed0bc52-717b-4a69-bf3f-86b43f8ed333 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:36.144069 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-aed0bc52-717b-4a69-bf3f-86b43f8ed333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:36.195585 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:36.206592 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1241/2479] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:36.216028 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8625fe-9986-4167-bb26-4684b9027a9c None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:36.216355 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8625fe-9986-4167-bb26-4684b9027a9c None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:36.216679 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8625fe-9986-4167-bb26-4684b9027a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:36.235523 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-0a8625fe-9986-4167-bb26-4684b9027a9c None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:36.236926 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-0a8625fe-9986-4167-bb26-4684b9027a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:36.245950 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1239/2480] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:36.250163 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0bc52-717b-4a69-bf3f-86b43f8ed333 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:36.260360 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed0bc52-717b-4a69-bf3f-86b43f8ed333 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:36.265034 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eceabe2-481a-4770-976c-323736a6c57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:36.265718 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eceabe2-481a-4770-976c-323736a6c57e admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:36.266006 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eceabe2-481a-4770-976c-323736a6c57e admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:36.266285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eceabe2-481a-4770-976c-323736a6c57e admin admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:36.267266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eceabe2-481a-4770-976c-323736a6c57e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:37:36.267640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eceabe2-481a-4770-976c-323736a6c57e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:36.269251 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eceabe2-481a-4770-976c-323736a6c57e admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:36.280609 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1242/2481] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:37:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:37:36.285192 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8625fe-9986-4167-bb26-4684b9027a9c None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:36.294347 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8625fe-9986-4167-bb26-4684b9027a9c None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:36.299566 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b0a5a-857a-4e35-a126-ee150c1f830a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:36.300241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b0a5a-857a-4e35-a126-ee150c1f830a admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:36.300524 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b0a5a-857a-4e35-a126-ee150c1f830a admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:36.300798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954b0a5a-857a-4e35-a126-ee150c1f830a admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:36.301484 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b0a5a-857a-4e35-a126-ee150c1f830a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:36.303385 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954b0a5a-857a-4e35-a126-ee150c1f830a admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:36.328845 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1240/2482] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:36 2022] POST /identity/v3/projects => generated 365 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:36.332817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eceabe2-481a-4770-976c-323736a6c57e admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:36.342805 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eceabe2-481a-4770-976c-323736a6c57e admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:36.398577 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8f095-79d5-439d-a405-883b46a5aa2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:36.399259 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8f095-79d5-439d-a405-883b46a5aa2d admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:36.399533 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8f095-79d5-439d-a405-883b46a5aa2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:36.399847 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8f095-79d5-439d-a405-883b46a5aa2d admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:36.400542 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8f095-79d5-439d-a405-883b46a5aa2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:36.402474 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8f095-79d5-439d-a405-883b46a5aa2d admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:36.421613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1243/2483] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:37:36 2022] POST /identity/v3/users => generated 283 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:36.425699 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b0a5a-857a-4e35-a126-ee150c1f830a admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:36.435939 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954b0a5a-857a-4e35-a126-ee150c1f830a admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:36.441236 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbe440-9ade-4f47-9830-33e002195ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:36.441887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbe440-9ade-4f47-9830-33e002195ceb admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:36.442169 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbe440-9ade-4f47-9830-33e002195ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:36.442448 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbe440-9ade-4f47-9830-33e002195ceb admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:36.443161 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbe440-9ade-4f47-9830-33e002195ceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:36.444787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbe440-9ade-4f47-9830-33e002195ceb admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:36.456077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1241/2484] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:36.459839 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8f095-79d5-439d-a405-883b46a5aa2d admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:36.469552 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8f095-79d5-439d-a405-883b46a5aa2d admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:36.474173 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fadfa5-e540-40d2-bec9-8c2b0da855e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:36.474820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fadfa5-e540-40d2-bec9-8c2b0da855e6 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:36.475107 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fadfa5-e540-40d2-bec9-8c2b0da855e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:36.475387 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fadfa5-e540-40d2-bec9-8c2b0da855e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:36.476147 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fadfa5-e540-40d2-bec9-8c2b0da855e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:36.477744 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fadfa5-e540-40d2-bec9-8c2b0da855e6 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:36.488651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1244/2485] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:36.492613 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbe440-9ade-4f47-9830-33e002195ceb admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:36.502877 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbe440-9ade-4f47-9830-33e002195ceb admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:36.507394 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a8068-cdc9-4338-8944-c6c437018056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:36.508288 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a8068-cdc9-4338-8944-c6c437018056 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:36.508567 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a8068-cdc9-4338-8944-c6c437018056 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:36.508840 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a8068-cdc9-4338-8944-c6c437018056 admin admin] PATH_INFO: `/v3/projects/b826f9f752f64dc090c45c1ade5e9b35/users/12f367ad9bc949598a839a7e2fbb1e2d/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:36.523309 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a8068-cdc9-4338-8944-c6c437018056 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b826f9f752f64dc090c45c1ade5e9b35, user_id=12f367ad9bc949598a839a7e2fbb1e2d, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:36.526020 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a8068-cdc9-4338-8944-c6c437018056 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:36.539587 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1242/2486] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:36 2022] PUT /identity/v3/projects/b826f9f752f64dc090c45c1ade5e9b35/users/12f367ad9bc949598a839a7e2fbb1e2d/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:36.550177 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe5a62-6536-4835-9231-2b463d27d228 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:36.550638 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe5a62-6536-4835-9231-2b463d27d228 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:36.550759 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe5a62-6536-4835-9231-2b463d27d228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:36.577360 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-6bbe5a62-6536-4835-9231-2b463d27d228 None None] MFA Rules not processed for user `12f367ad9bc949598a839a7e2fbb1e2d`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:36.578566 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-6bbe5a62-6536-4835-9231-2b463d27d228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:36.640729 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1245/2487] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:36 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:36.646114 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a8068-cdc9-4338-8944-c6c437018056 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:36.709812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a8068-cdc9-4338-8944-c6c437018056 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:36.714457 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40871a5a-0181-4d27-9c8d-84c0108e585a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:36.715109 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40871a5a-0181-4d27-9c8d-84c0108e585a admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:36.715396 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40871a5a-0181-4d27-9c8d-84c0108e585a admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:36.715708 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40871a5a-0181-4d27-9c8d-84c0108e585a admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:36.716390 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40871a5a-0181-4d27-9c8d-84c0108e585a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:36.718411 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40871a5a-0181-4d27-9c8d-84c0108e585a admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:36.736683 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:36.747535 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1243/2488] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:36 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:37:36.748673 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe5a62-6536-4835-9231-2b463d27d228 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:36.759129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe5a62-6536-4835-9231-2b463d27d228 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:36.806301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:36.816133 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb064750-4fba-4800-8be1-7ea54fa88c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:36.816833 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb064750-4fba-4800-8be1-7ea54fa88c71 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:36.817144 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb064750-4fba-4800-8be1-7ea54fa88c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:36.817423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb064750-4fba-4800-8be1-7ea54fa88c71 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:36.818113 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb064750-4fba-4800-8be1-7ea54fa88c71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:36.820083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb064750-4fba-4800-8be1-7ea54fa88c71 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:36.839583 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1246/2489] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:37:36 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:37:36.843505 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40871a5a-0181-4d27-9c8d-84c0108e585a admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:36.854459 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40871a5a-0181-4d27-9c8d-84c0108e585a admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:36.859005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a65de-9e0e-4228-8652-73c9efa213b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:36.859688 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a65de-9e0e-4228-8652-73c9efa213b0 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:36.859979 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a65de-9e0e-4228-8652-73c9efa213b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:36.860253 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46a65de-9e0e-4228-8652-73c9efa213b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:36.860967 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a65de-9e0e-4228-8652-73c9efa213b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:36.862580 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46a65de-9e0e-4228-8652-73c9efa213b0 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:36.872888 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1244/2490] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:36.877268 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb064750-4fba-4800-8be1-7ea54fa88c71 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:36.887099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb064750-4fba-4800-8be1-7ea54fa88c71 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:36.891957 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d582d5-8ee4-49e7-83ef-be58510957ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:36.893362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d582d5-8ee4-49e7-83ef-be58510957ee admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:36.893641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d582d5-8ee4-49e7-83ef-be58510957ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:36.893917 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d582d5-8ee4-49e7-83ef-be58510957ee admin admin] PATH_INFO: `/v3/projects/8ba6210057534cafabd1f876a28bb879/users/f41c4a05860347f6a8bf0e40dc4b4dce/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:36.908313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d582d5-8ee4-49e7-83ef-be58510957ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ba6210057534cafabd1f876a28bb879, user_id=f41c4a05860347f6a8bf0e40dc4b4dce, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:36.910984 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d582d5-8ee4-49e7-83ef-be58510957ee admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:36.923800 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1247/2491] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:36 2022] PUT /identity/v3/projects/8ba6210057534cafabd1f876a28bb879/users/f41c4a05860347f6a8bf0e40dc4b4dce/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:36.927722 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a65de-9e0e-4228-8652-73c9efa213b0 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:36.937534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46a65de-9e0e-4228-8652-73c9efa213b0 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:36.995361 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46583e83-c564-4faf-b088-948fa41b51ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:36.996113 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46583e83-c564-4faf-b088-948fa41b51ac admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:36.996257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46583e83-c564-4faf-b088-948fa41b51ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:36.996537 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46583e83-c564-4faf-b088-948fa41b51ac admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:36.997254 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46583e83-c564-4faf-b088-948fa41b51ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:36.998891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46583e83-c564-4faf-b088-948fa41b51ac admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:37.008576 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1245/2492] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:37.012758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d582d5-8ee4-49e7-83ef-be58510957ee admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:37.023163 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d582d5-8ee4-49e7-83ef-be58510957ee admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:37.027745 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b797e2-2df1-499f-ba63-4ca7253dd23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:37.028619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b797e2-2df1-499f-ba63-4ca7253dd23b admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:37.028901 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b797e2-2df1-499f-ba63-4ca7253dd23b admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:37.029180 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b797e2-2df1-499f-ba63-4ca7253dd23b admin admin] PATH_INFO: `/v3/projects/8ba6210057534cafabd1f876a28bb879/users/f41c4a05860347f6a8bf0e40dc4b4dce/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:37.031163 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b797e2-2df1-499f-ba63-4ca7253dd23b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ba6210057534cafabd1f876a28bb879, user_id=f41c4a05860347f6a8bf0e40dc4b4dce, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:37.034544 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b797e2-2df1-499f-ba63-4ca7253dd23b admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:37.045357 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1248/2493] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:37 2022] PUT /identity/v3/projects/8ba6210057534cafabd1f876a28bb879/users/f41c4a05860347f6a8bf0e40dc4b4dce/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:37.056103 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250f166-a2c8-4fb7-8cbc-3a02cbf7232a None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:37.056400 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250f166-a2c8-4fb7-8cbc-3a02cbf7232a None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:37.056709 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250f166-a2c8-4fb7-8cbc-3a02cbf7232a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:37.082675 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-2250f166-a2c8-4fb7-8cbc-3a02cbf7232a None None] MFA Rules not processed for user `f41c4a05860347f6a8bf0e40dc4b4dce`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:37.084227 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-2250f166-a2c8-4fb7-8cbc-3a02cbf7232a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:37.155773 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1246/2494] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:37 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:37.167039 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b797e2-2df1-499f-ba63-4ca7253dd23b admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:37.168850 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-29b797e2-2df1-499f-ba63-4ca7253dd23b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:37.231426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b797e2-2df1-499f-ba63-4ca7253dd23b admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:37.235210 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b4e31-f48a-46ca-88cb-26eff5167401 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:37.235886 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b4e31-f48a-46ca-88cb-26eff5167401 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:37.236205 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b4e31-f48a-46ca-88cb-26eff5167401 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:37.236485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2b4e31-f48a-46ca-88cb-26eff5167401 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:37.246448 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b4e31-f48a-46ca-88cb-26eff5167401 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:37.247878 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2b4e31-f48a-46ca-88cb-26eff5167401 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:37.258101 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1249/2495] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:37 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:37.337231 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250f166-a2c8-4fb7-8cbc-3a02cbf7232a None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:37.347076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250f166-a2c8-4fb7-8cbc-3a02cbf7232a None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:37.350800 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d42b1-b132-430a-98f7-3c1a4596d1c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:37.351434 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d42b1-b132-430a-98f7-3c1a4596d1c5 service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:37.351760 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d42b1-b132-430a-98f7-3c1a4596d1c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:37.352042 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d42b1-b132-430a-98f7-3c1a4596d1c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:37.407941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d42b1-b132-430a-98f7-3c1a4596d1c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:37.409388 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d42b1-b132-430a-98f7-3c1a4596d1c5 service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:37.418658 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1247/2496] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:37 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:47.253551 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=46,keystone:INSERT=5 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:47.414228 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=97 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:50.307064 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b4e31-f48a-46ca-88cb-26eff5167401 service cinder] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:50.308572 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-df2b4e31-f48a-46ca-88cb-26eff5167401 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:50.382338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2b4e31-f48a-46ca-88cb-26eff5167401 service cinder] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:50.387697 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa902b5-5c9d-4464-bb2c-3325c32ad3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:50.388620 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa902b5-5c9d-4464-bb2c-3325c32ad3bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:50.389027 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa902b5-5c9d-4464-bb2c-3325c32ad3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:50.389367 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa902b5-5c9d-4464-bb2c-3325c32ad3bf admin admin] PATH_INFO: `/v3/users/7b5de3124e9d430489afe292d460382e` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:50.390590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa902b5-5c9d-4464-bb2c-3325c32ad3bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b5de3124e9d430489afe292d460382e)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:50.393699 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa902b5-5c9d-4464-bb2c-3325c32ad3bf admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:50.451092 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4fa902b5-5c9d-4464-bb2c-3325c32ad3bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b5de3124e9d430489afe292d460382e'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:50.459874 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4fa902b5-5c9d-4464-bb2c-3325c32ad3bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b5de3124e9d430489afe292d460382e'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:50.460581 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4fa902b5-5c9d-4464-bb2c-3325c32ad3bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b5de3124e9d430489afe292d460382e'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:50.461299 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4fa902b5-5c9d-4464-bb2c-3325c32ad3bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b5de3124e9d430489afe292d460382e'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:50.473619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4fa902b5-5c9d-4464-bb2c-3325c32ad3bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b5de3124e9d430489afe292d460382e'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:50.485631 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1250/2497] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:50 2022] DELETE /identity/v3/users/7b5de3124e9d430489afe292d460382e => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:50.490040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edaa88-78b5-4716-abf6-029f821994a6 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:50.490501 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edaa88-78b5-4716-abf6-029f821994a6 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:50.490603 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4edaa88-78b5-4716-abf6-029f821994a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:50.507503 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-b4edaa88-78b5-4716-abf6-029f821994a6 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:50.508727 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-b4edaa88-78b5-4716-abf6-029f821994a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:50.568154 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1248/2498] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:50.577914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa902b5-5c9d-4464-bb2c-3325c32ad3bf admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:50.580527 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-4fa902b5-5c9d-4464-bb2c-3325c32ad3bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:50.638572 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa902b5-5c9d-4464-bb2c-3325c32ad3bf admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:50.643150 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb6db1-f217-45c5-8cb1-261a85261360 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:50.643836 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb6db1-f217-45c5-8cb1-261a85261360 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:50.644124 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb6db1-f217-45c5-8cb1-261a85261360 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:50.644401 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb6db1-f217-45c5-8cb1-261a85261360 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:50.654132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb6db1-f217-45c5-8cb1-261a85261360 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:50.655846 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb6db1-f217-45c5-8cb1-261a85261360 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:50.665353 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1251/2499] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:50.936955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edaa88-78b5-4716-abf6-029f821994a6 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:50.938446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-b4edaa88-78b5-4716-abf6-029f821994a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:50.952033 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4edaa88-78b5-4716-abf6-029f821994a6 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:50.957305 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4619eaf-7582-4174-986e-c7a14d8b4bea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:50.958186 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4619eaf-7582-4174-986e-c7a14d8b4bea admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:50.958913 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4619eaf-7582-4174-986e-c7a14d8b4bea admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:50.958913 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4619eaf-7582-4174-986e-c7a14d8b4bea admin admin] PATH_INFO: `/v3/projects/e2060455267e465cabc2574cf5f8f57f` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:50.960011 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4619eaf-7582-4174-986e-c7a14d8b4bea admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2060455267e465cabc2574cf5f8f57f)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:50.961945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4619eaf-7582-4174-986e-c7a14d8b4bea admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:51.011275 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a4619eaf-7582-4174-986e-c7a14d8b4bea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2060455267e465cabc2574cf5f8f57f', 'request_id': 'req-a4619eaf-7582-4174-986e-c7a14d8b4bea'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:51.017035 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a4619eaf-7582-4174-986e-c7a14d8b4bea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2060455267e465cabc2574cf5f8f57f', 'request_id': 'req-a4619eaf-7582-4174-986e-c7a14d8b4bea'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:51.023175 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a4619eaf-7582-4174-986e-c7a14d8b4bea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2060455267e465cabc2574cf5f8f57f', 'request_id': 'req-a4619eaf-7582-4174-986e-c7a14d8b4bea'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:51.035244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a4619eaf-7582-4174-986e-c7a14d8b4bea admin admin] The token cache is being invalidate because project e2060455267e465cabc2574cf5f8f57f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:51.035550 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a4619eaf-7582-4174-986e-c7a14d8b4bea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:51.036184 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a4619eaf-7582-4174-986e-c7a14d8b4bea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:51.038591 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1249/2500] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:50 2022] DELETE /identity/v3/projects/e2060455267e465cabc2574cf5f8f57f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:51.042446 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb6db1-f217-45c5-8cb1-261a85261360 service neutron] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:51.053166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb6db1-f217-45c5-8cb1-261a85261360 service neutron] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:51.071751 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:51.111993 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7afc075-bd4d-4e6b-a0a0-fb185777aa64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:51.112885 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afc075-bd4d-4e6b-a0a0-fb185777aa64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:51.113164 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afc075-bd4d-4e6b-a0a0-fb185777aa64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:51.113455 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7afc075-bd4d-4e6b-a0a0-fb185777aa64 admin admin] PATH_INFO: `/v3/users/b107d3cf74ae47b0aed7ee28ed381517` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:51.114663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afc075-bd4d-4e6b-a0a0-fb185777aa64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b107d3cf74ae47b0aed7ee28ed381517)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:51.116686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7afc075-bd4d-4e6b-a0a0-fb185777aa64 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:51.161196 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-f7afc075-bd4d-4e6b-a0a0-fb185777aa64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b107d3cf74ae47b0aed7ee28ed381517'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:51.168097 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-f7afc075-bd4d-4e6b-a0a0-fb185777aa64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b107d3cf74ae47b0aed7ee28ed381517'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:51.168715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-f7afc075-bd4d-4e6b-a0a0-fb185777aa64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b107d3cf74ae47b0aed7ee28ed381517'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:51.169334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-f7afc075-bd4d-4e6b-a0a0-fb185777aa64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b107d3cf74ae47b0aed7ee28ed381517'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:51.181663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-f7afc075-bd4d-4e6b-a0a0-fb185777aa64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b107d3cf74ae47b0aed7ee28ed381517'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:51.193664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1252/2501] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:51 2022] DELETE /identity/v3/users/b107d3cf74ae47b0aed7ee28ed381517 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:37:51.457980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4619eaf-7582-4174-986e-c7a14d8b4bea admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:51.460721 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a4619eaf-7582-4174-986e-c7a14d8b4bea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:51.474684 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4619eaf-7582-4174-986e-c7a14d8b4bea admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:51.534364 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dfa813-33e3-4b33-b921-c8b0a42945fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:51.535152 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfa813-33e3-4b33-b921-c8b0a42945fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:51.535434 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfa813-33e3-4b33-b921-c8b0a42945fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:51.535765 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dfa813-33e3-4b33-b921-c8b0a42945fe admin admin] PATH_INFO: `/v3/projects/fcc6b4e020c1490b88b33e0289b16e1c` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:51.536950 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dfa813-33e3-4b33-b921-c8b0a42945fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcc6b4e020c1490b88b33e0289b16e1c)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:51.538920 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dfa813-33e3-4b33-b921-c8b0a42945fe admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:51.569110 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:51.588380 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d6dfa813-33e3-4b33-b921-c8b0a42945fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcc6b4e020c1490b88b33e0289b16e1c', 'request_id': 'req-d6dfa813-33e3-4b33-b921-c8b0a42945fe'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:51.594075 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d6dfa813-33e3-4b33-b921-c8b0a42945fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcc6b4e020c1490b88b33e0289b16e1c', 'request_id': 'req-d6dfa813-33e3-4b33-b921-c8b0a42945fe'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:51.600886 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d6dfa813-33e3-4b33-b921-c8b0a42945fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcc6b4e020c1490b88b33e0289b16e1c', 'request_id': 'req-d6dfa813-33e3-4b33-b921-c8b0a42945fe'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:51.614154 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d6dfa813-33e3-4b33-b921-c8b0a42945fe admin admin] The token cache is being invalidate because project fcc6b4e020c1490b88b33e0289b16e1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:51.614446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d6dfa813-33e3-4b33-b921-c8b0a42945fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:51.615089 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d6dfa813-33e3-4b33-b921-c8b0a42945fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:51.616750 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1250/2502] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:51 2022] DELETE /identity/v3/projects/fcc6b4e020c1490b88b33e0289b16e1c => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:51.621664 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdb9a7-b7a8-4985-b989-397ab399cb55 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:51.622127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdb9a7-b7a8-4985-b989-397ab399cb55 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:51.622243 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cdb9a7-b7a8-4985-b989-397ab399cb55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:51.640278 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-d8cdb9a7-b7a8-4985-b989-397ab399cb55 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:51.642334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-d8cdb9a7-b7a8-4985-b989-397ab399cb55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:51.711712 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1253/2503] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:51.719406 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2355a8-e616-4a54-9f81-b0bb768d3ca7 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:51.720326 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2355a8-e616-4a54-9f81-b0bb768d3ca7 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:51.720612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2355a8-e616-4a54-9f81-b0bb768d3ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:51.740542 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-dd2355a8-e616-4a54-9f81-b0bb768d3ca7 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:51.741761 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-dd2355a8-e616-4a54-9f81-b0bb768d3ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:51.749895 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1251/2504] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:51.754117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdb9a7-b7a8-4985-b989-397ab399cb55 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:51.764078 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cdb9a7-b7a8-4985-b989-397ab399cb55 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:51.769514 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3b81a-5ddf-4227-9b3b-7af21f74c272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:51.770163 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3b81a-5ddf-4227-9b3b-7af21f74c272 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:51.770449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3b81a-5ddf-4227-9b3b-7af21f74c272 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:51.770728 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc3b81a-5ddf-4227-9b3b-7af21f74c272 admin admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:51.771451 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3b81a-5ddf-4227-9b3b-7af21f74c272 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:37:51.771799 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3b81a-5ddf-4227-9b3b-7af21f74c272 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:51.773457 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc3b81a-5ddf-4227-9b3b-7af21f74c272 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:51.785634 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1254/2505] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:37:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:37:51.790024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2355a8-e616-4a54-9f81-b0bb768d3ca7 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:51.799331 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2355a8-e616-4a54-9f81-b0bb768d3ca7 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:51.803996 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa4585-273e-48b4-961b-5729f355b695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:51.804645 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa4585-273e-48b4-961b-5729f355b695 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:51.804928 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa4585-273e-48b4-961b-5729f355b695 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:51.805203 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66aa4585-273e-48b4-961b-5729f355b695 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:51.805880 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa4585-273e-48b4-961b-5729f355b695 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:51.807805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66aa4585-273e-48b4-961b-5729f355b695 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:51.832994 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1252/2506] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:51 2022] POST /identity/v3/projects => generated 387 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:51.837370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3b81a-5ddf-4227-9b3b-7af21f74c272 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:51.848304 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc3b81a-5ddf-4227-9b3b-7af21f74c272 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:51.876694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:51.909463 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e36136-3eb1-423d-83db-96ec12567711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:51.910134 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e36136-3eb1-423d-83db-96ec12567711 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:51.910417 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e36136-3eb1-423d-83db-96ec12567711 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:51.910695 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e36136-3eb1-423d-83db-96ec12567711 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:51.911402 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e36136-3eb1-423d-83db-96ec12567711 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:51.913369 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e36136-3eb1-423d-83db-96ec12567711 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:51.933028 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1255/2507] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:37:51 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:37:51.937068 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa4585-273e-48b4-961b-5729f355b695 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:51.947685 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66aa4585-273e-48b4-961b-5729f355b695 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:51.952915 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d362d-fe46-447f-9208-121324c54947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:51.953523 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d362d-fe46-447f-9208-121324c54947 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:51.953704 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d362d-fe46-447f-9208-121324c54947 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:51.954007 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d362d-fe46-447f-9208-121324c54947 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:51.955232 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d362d-fe46-447f-9208-121324c54947 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:51.956874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d362d-fe46-447f-9208-121324c54947 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:51.967959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1253/2508] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:37:51.973312 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e36136-3eb1-423d-83db-96ec12567711 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:51.983186 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e36136-3eb1-423d-83db-96ec12567711 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:51.988026 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa75b463-63d7-49a1-aa80-3d7969abfdf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:51.988833 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75b463-63d7-49a1-aa80-3d7969abfdf3 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:51.989115 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75b463-63d7-49a1-aa80-3d7969abfdf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:51.989388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa75b463-63d7-49a1-aa80-3d7969abfdf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:51.990109 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa75b463-63d7-49a1-aa80-3d7969abfdf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:51.991989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa75b463-63d7-49a1-aa80-3d7969abfdf3 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:52.003775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1256/2509] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:52.008267 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d362d-fe46-447f-9208-121324c54947 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:52.019989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d362d-fe46-447f-9208-121324c54947 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:52.026737 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34121ca6-3465-469d-9e0a-0a2d9930c6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:52.027672 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34121ca6-3465-469d-9e0a-0a2d9930c6e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:52.027957 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34121ca6-3465-469d-9e0a-0a2d9930c6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:52.028228 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34121ca6-3465-469d-9e0a-0a2d9930c6e4 admin admin] PATH_INFO: `/v3/projects/6eb9651003fe48d7b5f3d04ccade206f/users/8969c5cd1ffd47549d9a767c34a5ae44/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:52.044522 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34121ca6-3465-469d-9e0a-0a2d9930c6e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6eb9651003fe48d7b5f3d04ccade206f, user_id=8969c5cd1ffd47549d9a767c34a5ae44, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:52.047124 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34121ca6-3465-469d-9e0a-0a2d9930c6e4 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:52.060759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1254/2510] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:52 2022] PUT /identity/v3/projects/6eb9651003fe48d7b5f3d04ccade206f/users/8969c5cd1ffd47549d9a767c34a5ae44/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:52.072435 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ef693-e331-4194-9f55-afd1217e768b None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:52.072729 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ef693-e331-4194-9f55-afd1217e768b None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:52.073014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759ef693-e331-4194-9f55-afd1217e768b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:52.101989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-759ef693-e331-4194-9f55-afd1217e768b None None] MFA Rules not processed for user `8969c5cd1ffd47549d9a767c34a5ae44`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:52.103337 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-759ef693-e331-4194-9f55-afd1217e768b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:52.169713 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1257/2511] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:52.174072 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34121ca6-3465-469d-9e0a-0a2d9930c6e4 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:52.233987 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34121ca6-3465-469d-9e0a-0a2d9930c6e4 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:52.239150 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85613781-1887-4550-b032-7ec081f27b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:52.239833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85613781-1887-4550-b032-7ec081f27b36 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:52.240120 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85613781-1887-4550-b032-7ec081f27b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:52.240399 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85613781-1887-4550-b032-7ec081f27b36 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:52.241095 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85613781-1887-4550-b032-7ec081f27b36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:52.243012 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85613781-1887-4550-b032-7ec081f27b36 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:52.267823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1255/2512] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:52 2022] POST /identity/v3/projects => generated 387 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:52.271794 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ef693-e331-4194-9f55-afd1217e768b None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:52.282393 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759ef693-e331-4194-9f55-afd1217e768b None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:52.337963 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cff49e-b36b-4955-8217-056fce2e12dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:52.338616 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cff49e-b36b-4955-8217-056fce2e12dd admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:52.338906 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cff49e-b36b-4955-8217-056fce2e12dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:52.339185 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cff49e-b36b-4955-8217-056fce2e12dd admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:52.339939 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cff49e-b36b-4955-8217-056fce2e12dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:52.341948 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cff49e-b36b-4955-8217-056fce2e12dd admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:52.361642 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1258/2513] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:37:52 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:52.365631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85613781-1887-4550-b032-7ec081f27b36 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:52.377426 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85613781-1887-4550-b032-7ec081f27b36 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:52.382252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b13ae-88db-4c01-8caf-c138b8e8ad31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:52.382910 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b13ae-88db-4c01-8caf-c138b8e8ad31 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:52.383181 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b13ae-88db-4c01-8caf-c138b8e8ad31 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:52.383456 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781b13ae-88db-4c01-8caf-c138b8e8ad31 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:52.384213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b13ae-88db-4c01-8caf-c138b8e8ad31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:52.385802 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781b13ae-88db-4c01-8caf-c138b8e8ad31 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:52.396489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1256/2514] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:52.400588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cff49e-b36b-4955-8217-056fce2e12dd admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:52.411755 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cff49e-b36b-4955-8217-056fce2e12dd admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:52.416644 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe8c0a-e35c-4df8-981d-bcd7fc52229b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:52.417521 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe8c0a-e35c-4df8-981d-bcd7fc52229b admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:52.417800 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe8c0a-e35c-4df8-981d-bcd7fc52229b admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:52.418075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbe8c0a-e35c-4df8-981d-bcd7fc52229b admin admin] PATH_INFO: `/v3/projects/fe1e4f7e7fc545db92ec732bfef7a47f/users/f73443e6742549dd80c1bc597905bca7/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:52.433335 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe8c0a-e35c-4df8-981d-bcd7fc52229b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe1e4f7e7fc545db92ec732bfef7a47f, user_id=f73443e6742549dd80c1bc597905bca7, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:52.436040 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbe8c0a-e35c-4df8-981d-bcd7fc52229b admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:52.448849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1259/2515] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:52 2022] PUT /identity/v3/projects/fe1e4f7e7fc545db92ec732bfef7a47f/users/f73443e6742549dd80c1bc597905bca7/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:52.452956 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b13ae-88db-4c01-8caf-c138b8e8ad31 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:52.462847 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781b13ae-88db-4c01-8caf-c138b8e8ad31 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:52.481979 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:52.521155 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb33a4f-1346-42fe-81c2-cd99df1baeb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:52.521830 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb33a4f-1346-42fe-81c2-cd99df1baeb9 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:52.522119 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb33a4f-1346-42fe-81c2-cd99df1baeb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:52.522401 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb33a4f-1346-42fe-81c2-cd99df1baeb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:52.523136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb33a4f-1346-42fe-81c2-cd99df1baeb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:52.524790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb33a4f-1346-42fe-81c2-cd99df1baeb9 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:52.534625 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1257/2516] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:52.538690 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe8c0a-e35c-4df8-981d-bcd7fc52229b admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:52.544058 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:52.551079 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbe8c0a-e35c-4df8-981d-bcd7fc52229b admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:52.555886 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3b6e3-0984-44cf-bb6f-eba3f7194ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:52.556756 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3b6e3-0984-44cf-bb6f-eba3f7194ef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:52.557038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3b6e3-0984-44cf-bb6f-eba3f7194ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:52.557313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd3b6e3-0984-44cf-bb6f-eba3f7194ef8 admin admin] PATH_INFO: `/v3/projects/fe1e4f7e7fc545db92ec732bfef7a47f/users/f73443e6742549dd80c1bc597905bca7/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:52.559244 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3b6e3-0984-44cf-bb6f-eba3f7194ef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe1e4f7e7fc545db92ec732bfef7a47f, user_id=f73443e6742549dd80c1bc597905bca7, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:52.561937 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd3b6e3-0984-44cf-bb6f-eba3f7194ef8 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:52.572589 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1260/2517] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:52 2022] PUT /identity/v3/projects/fe1e4f7e7fc545db92ec732bfef7a47f/users/f73443e6742549dd80c1bc597905bca7/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:52.582515 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d4f53-9788-4866-8c9b-b8f644a3c6fb None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:52.582812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d4f53-9788-4866-8c9b-b8f644a3c6fb None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:52.583127 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742d4f53-9788-4866-8c9b-b8f644a3c6fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:52.609420 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-742d4f53-9788-4866-8c9b-b8f644a3c6fb None None] MFA Rules not processed for user `f73443e6742549dd80c1bc597905bca7`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:52.610570 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-742d4f53-9788-4866-8c9b-b8f644a3c6fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:52.677982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1258/2518] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:52.689284 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3b6e3-0984-44cf-bb6f-eba3f7194ef8 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:52.691149 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-fdd3b6e3-0984-44cf-bb6f-eba3f7194ef8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:52.747830 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd3b6e3-0984-44cf-bb6f-eba3f7194ef8 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:52.751848 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ddf9b-0a43-47d0-8ca5-7a21633e7ca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:52.752644 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ddf9b-0a43-47d0-8ca5-7a21633e7ca4 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:52.752766 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ddf9b-0a43-47d0-8ca5-7a21633e7ca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:52.753063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ddf9b-0a43-47d0-8ca5-7a21633e7ca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:52.762511 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ddf9b-0a43-47d0-8ca5-7a21633e7ca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:52.763988 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ddf9b-0a43-47d0-8ca5-7a21633e7ca4 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:52.774314 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1261/2519] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:52.851071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d4f53-9788-4866-8c9b-b8f644a3c6fb None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:52.916982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742d4f53-9788-4866-8c9b-b8f644a3c6fb None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:52.922128 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce2160a-e31f-433b-ab9b-ac9fd1d3904a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:52.923014 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ddf9b-0a43-47d0-8ca5-7a21633e7ca4 service cinder] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:52.923143 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2160a-e31f-433b-ab9b-ac9fd1d3904a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:52.923379 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2160a-e31f-433b-ab9b-ac9fd1d3904a admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:52.924284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce2160a-e31f-433b-ab9b-ac9fd1d3904a admin admin] PATH_INFO: `/v3/users/8969c5cd1ffd47549d9a767c34a5ae44` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:52.925037 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-247ddf9b-0a43-47d0-8ca5-7a21633e7ca4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:52.925523 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2160a-e31f-433b-ab9b-ac9fd1d3904a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8969c5cd1ffd47549d9a767c34a5ae44)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:52.927503 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce2160a-e31f-433b-ab9b-ac9fd1d3904a admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:52.938380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ddf9b-0a43-47d0-8ca5-7a21633e7ca4 service cinder] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:52.943047 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e25217-c2bc-4332-92dd-e00085833483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:52.943947 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e25217-c2bc-4332-92dd-e00085833483 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:52.944238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e25217-c2bc-4332-92dd-e00085833483 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:52.944639 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e25217-c2bc-4332-92dd-e00085833483 admin admin] PATH_INFO: `/v3/users/12f367ad9bc949598a839a7e2fbb1e2d` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:52.945856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e25217-c2bc-4332-92dd-e00085833483 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12f367ad9bc949598a839a7e2fbb1e2d)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:52.947820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e25217-c2bc-4332-92dd-e00085833483 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:52.976479 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-cce2160a-e31f-433b-ab9b-ac9fd1d3904a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8969c5cd1ffd47549d9a767c34a5ae44'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:52.978196 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:52.985179 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-cce2160a-e31f-433b-ab9b-ac9fd1d3904a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8969c5cd1ffd47549d9a767c34a5ae44'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:52.985830 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-cce2160a-e31f-433b-ab9b-ac9fd1d3904a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8969c5cd1ffd47549d9a767c34a5ae44'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:52.997208 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-72e25217-c2bc-4332-92dd-e00085833483 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12f367ad9bc949598a839a7e2fbb1e2d'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:52.998187 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-cce2160a-e31f-433b-ab9b-ac9fd1d3904a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8969c5cd1ffd47549d9a767c34a5ae44'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:52.998845 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-cce2160a-e31f-433b-ab9b-ac9fd1d3904a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8969c5cd1ffd47549d9a767c34a5ae44'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:53.004896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-72e25217-c2bc-4332-92dd-e00085833483 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12f367ad9bc949598a839a7e2fbb1e2d'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:53.005714 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-72e25217-c2bc-4332-92dd-e00085833483 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12f367ad9bc949598a839a7e2fbb1e2d'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:53.006349 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-72e25217-c2bc-4332-92dd-e00085833483 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12f367ad9bc949598a839a7e2fbb1e2d'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:53.011720 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1259/2520] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:52 2022] DELETE /identity/v3/users/8969c5cd1ffd47549d9a767c34a5ae44 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:37:53.016523 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee945ba-f08b-49f9-92c3-6e134e083a53 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:53.016817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee945ba-f08b-49f9-92c3-6e134e083a53 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:53.017654 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee945ba-f08b-49f9-92c3-6e134e083a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:53.019545 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-72e25217-c2bc-4332-92dd-e00085833483 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12f367ad9bc949598a839a7e2fbb1e2d'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:53.031913 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1262/2521] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:52 2022] DELETE /identity/v3/users/12f367ad9bc949598a839a7e2fbb1e2d => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:37:53.036034 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-eee945ba-f08b-49f9-92c3-6e134e083a53 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:53.036738 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d3955-5c4f-4e63-b63a-2dc37dbcccf6 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:53.037034 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d3955-5c4f-4e63-b63a-2dc37dbcccf6 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:53.037256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-eee945ba-f08b-49f9-92c3-6e134e083a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:53.037366 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d3955-5c4f-4e63-b63a-2dc37dbcccf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:53.054253 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-a01d3955-5c4f-4e63-b63a-2dc37dbcccf6 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:53.055454 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-a01d3955-5c4f-4e63-b63a-2dc37dbcccf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:53.098763 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1260/2522] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:37:53.108968 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee945ba-f08b-49f9-92c3-6e134e083a53 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:53.110386 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-eee945ba-f08b-49f9-92c3-6e134e083a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:53.117950 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1263/2523] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:37:53.127001 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d3955-5c4f-4e63-b63a-2dc37dbcccf6 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:53.128432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-a01d3955-5c4f-4e63-b63a-2dc37dbcccf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:53.135591 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:53.169772 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee945ba-f08b-49f9-92c3-6e134e083a53 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:53.173602 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c9e5c-31f3-4867-bfd3-a245be20bf27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:53.174251 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c9e5c-31f3-4867-bfd3-a245be20bf27 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:53.174539 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c9e5c-31f3-4867-bfd3-a245be20bf27 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:53.174821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3c9e5c-31f3-4867-bfd3-a245be20bf27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:53.184477 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c9e5c-31f3-4867-bfd3-a245be20bf27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:53.185972 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3c9e5c-31f3-4867-bfd3-a245be20bf27 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:53.196304 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1261/2524] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:37:53.196589 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d3955-5c4f-4e63-b63a-2dc37dbcccf6 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:53.200091 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb7168-21d5-4575-92fc-61f700f20d5a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:53.200740 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb7168-21d5-4575-92fc-61f700f20d5a service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:53.201032 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb7168-21d5-4575-92fc-61f700f20d5a service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:53.201317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bb7168-21d5-4575-92fc-61f700f20d5a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:53.212095 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb7168-21d5-4575-92fc-61f700f20d5a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:53.213617 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bb7168-21d5-4575-92fc-61f700f20d5a service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:53.224583 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1264/2525] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:37:53.600918 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c9e5c-31f3-4867-bfd3-a245be20bf27 service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:53.602464 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-3f3c9e5c-31f3-4867-bfd3-a245be20bf27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:53.621690 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3c9e5c-31f3-4867-bfd3-a245be20bf27 service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:53.628557 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82279290-870d-4f93-b087-4f63952daca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:53.629433 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82279290-870d-4f93-b087-4f63952daca2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:53.629719 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82279290-870d-4f93-b087-4f63952daca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:53.630000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82279290-870d-4f93-b087-4f63952daca2 admin admin] PATH_INFO: `/v3/projects/6eb9651003fe48d7b5f3d04ccade206f` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:53.639146 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82279290-870d-4f93-b087-4f63952daca2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6eb9651003fe48d7b5f3d04ccade206f)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:53.641442 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82279290-870d-4f93-b087-4f63952daca2 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:53.662354 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb7168-21d5-4575-92fc-61f700f20d5a service neutron] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:53.663918 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-68bb7168-21d5-4575-92fc-61f700f20d5a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:53.681812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bb7168-21d5-4575-92fc-61f700f20d5a service neutron] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:53.687768 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c8ab8-3d99-4527-960f-b02d571d4113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:53.689241 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c8ab8-3d99-4527-960f-b02d571d4113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:53.689535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c8ab8-3d99-4527-960f-b02d571d4113 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:53.690087 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c8ab8-3d99-4527-960f-b02d571d4113 admin admin] PATH_INFO: `/v3/projects/b826f9f752f64dc090c45c1ade5e9b35` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:53.691105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c8ab8-3d99-4527-960f-b02d571d4113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b826f9f752f64dc090c45c1ade5e9b35)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:53.693164 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c8ab8-3d99-4527-960f-b02d571d4113 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:53.697948 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-82279290-870d-4f93-b087-4f63952daca2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6eb9651003fe48d7b5f3d04ccade206f', 'request_id': 'req-82279290-870d-4f93-b087-4f63952daca2'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:53.704069 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-82279290-870d-4f93-b087-4f63952daca2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6eb9651003fe48d7b5f3d04ccade206f', 'request_id': 'req-82279290-870d-4f93-b087-4f63952daca2'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:53.711366 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-82279290-870d-4f93-b087-4f63952daca2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6eb9651003fe48d7b5f3d04ccade206f', 'request_id': 'req-82279290-870d-4f93-b087-4f63952daca2'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:53.712968 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:INSERT=1,keystone:DELETE=9,keystone:SELECT=90 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:53.726656 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-82279290-870d-4f93-b087-4f63952daca2 admin admin] The token cache is being invalidate because project 6eb9651003fe48d7b5f3d04ccade206f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:53.726943 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-82279290-870d-4f93-b087-4f63952daca2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:53.727669 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-82279290-870d-4f93-b087-4f63952daca2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:53.729236 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1262/2526] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:53 2022] DELETE /identity/v3/projects/6eb9651003fe48d7b5f3d04ccade206f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:53.733149 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82279290-870d-4f93-b087-4f63952daca2 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:53.734471 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-82279290-870d-4f93-b087-4f63952daca2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:53.746265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-a55c8ab8-3d99-4527-960f-b02d571d4113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b826f9f752f64dc090c45c1ade5e9b35', 'request_id': 'req-a55c8ab8-3d99-4527-960f-b02d571d4113'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:53.752708 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-a55c8ab8-3d99-4527-960f-b02d571d4113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b826f9f752f64dc090c45c1ade5e9b35', 'request_id': 'req-a55c8ab8-3d99-4527-960f-b02d571d4113'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:53.759035 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-a55c8ab8-3d99-4527-960f-b02d571d4113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b826f9f752f64dc090c45c1ade5e9b35', 'request_id': 'req-a55c8ab8-3d99-4527-960f-b02d571d4113'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:53.772155 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-a55c8ab8-3d99-4527-960f-b02d571d4113 admin admin] The token cache is being invalidate because project b826f9f752f64dc090c45c1ade5e9b35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:53.772456 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-a55c8ab8-3d99-4527-960f-b02d571d4113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:53.773102 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-a55c8ab8-3d99-4527-960f-b02d571d4113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:53.774692 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1265/2527] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:53 2022] DELETE /identity/v3/projects/b826f9f752f64dc090c45c1ade5e9b35 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:53.778546 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c8ab8-3d99-4527-960f-b02d571d4113 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:53.779956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-a55c8ab8-3d99-4527-960f-b02d571d4113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:53.808130 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82279290-870d-4f93-b087-4f63952daca2 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:53.845621 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c8ab8-3d99-4527-960f-b02d571d4113 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:53.850396 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6200e3-c686-4efc-bc5b-2ae6a7f46852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:53.851349 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6200e3-c686-4efc-bc5b-2ae6a7f46852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:53.851735 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6200e3-c686-4efc-bc5b-2ae6a7f46852 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:53.852199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6200e3-c686-4efc-bc5b-2ae6a7f46852 admin admin] PATH_INFO: `/v3/users/f41c4a05860347f6a8bf0e40dc4b4dce` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:53.853403 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6200e3-c686-4efc-bc5b-2ae6a7f46852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f41c4a05860347f6a8bf0e40dc4b4dce)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:53.855336 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6200e3-c686-4efc-bc5b-2ae6a7f46852 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:53.865223 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12481d3c-e9aa-437e-b8c4-0e59501ed3aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:53.866102 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12481d3c-e9aa-437e-b8c4-0e59501ed3aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:53.866383 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12481d3c-e9aa-437e-b8c4-0e59501ed3aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:53.866660 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12481d3c-e9aa-437e-b8c4-0e59501ed3aa admin admin] PATH_INFO: `/v3/users/f73443e6742549dd80c1bc597905bca7` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:53.868425 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12481d3c-e9aa-437e-b8c4-0e59501ed3aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=f73443e6742549dd80c1bc597905bca7)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:53.870954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12481d3c-e9aa-437e-b8c4-0e59501ed3aa admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:53.891628 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:53.906158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4f6200e3-c686-4efc-bc5b-2ae6a7f46852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f41c4a05860347f6a8bf0e40dc4b4dce'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:53.914797 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4f6200e3-c686-4efc-bc5b-2ae6a7f46852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f41c4a05860347f6a8bf0e40dc4b4dce'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:53.915932 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4f6200e3-c686-4efc-bc5b-2ae6a7f46852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f41c4a05860347f6a8bf0e40dc4b4dce'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:53.916642 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4f6200e3-c686-4efc-bc5b-2ae6a7f46852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f41c4a05860347f6a8bf0e40dc4b4dce'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:53.921070 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-12481d3c-e9aa-437e-b8c4-0e59501ed3aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f73443e6742549dd80c1bc597905bca7'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:53.928604 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-12481d3c-e9aa-437e-b8c4-0e59501ed3aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f73443e6742549dd80c1bc597905bca7'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:53.929274 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-12481d3c-e9aa-437e-b8c4-0e59501ed3aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f73443e6742549dd80c1bc597905bca7'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:53.930224 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4f6200e3-c686-4efc-bc5b-2ae6a7f46852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f41c4a05860347f6a8bf0e40dc4b4dce'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:53.942157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-12481d3c-e9aa-437e-b8c4-0e59501ed3aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f73443e6742549dd80c1bc597905bca7'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:53.942826 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-12481d3c-e9aa-437e-b8c4-0e59501ed3aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f73443e6742549dd80c1bc597905bca7'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:53.943369 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1266/2528] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:53 2022] DELETE /identity/v3/users/f41c4a05860347f6a8bf0e40dc4b4dce => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:37:53.959599 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1263/2529] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:53 2022] DELETE /identity/v3/users/f73443e6742549dd80c1bc597905bca7 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:37:54.216457 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6200e3-c686-4efc-bc5b-2ae6a7f46852 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:54.218146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-4f6200e3-c686-4efc-bc5b-2ae6a7f46852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:54.233115 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12481d3c-e9aa-437e-b8c4-0e59501ed3aa admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:54.238404 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-12481d3c-e9aa-437e-b8c4-0e59501ed3aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:54.270768 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:54.297392 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6200e3-c686-4efc-bc5b-2ae6a7f46852 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:54.319812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12481d3c-e9aa-437e-b8c4-0e59501ed3aa admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:54.324740 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd621e6-ac74-4db3-a35e-d7291a76bbd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:54.325591 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd621e6-ac74-4db3-a35e-d7291a76bbd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:54.325870 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd621e6-ac74-4db3-a35e-d7291a76bbd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:54.326146 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd621e6-ac74-4db3-a35e-d7291a76bbd2 admin admin] PATH_INFO: `/v3/projects/fe1e4f7e7fc545db92ec732bfef7a47f` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:54.327315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd621e6-ac74-4db3-a35e-d7291a76bbd2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe1e4f7e7fc545db92ec732bfef7a47f)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:54.329254 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd621e6-ac74-4db3-a35e-d7291a76bbd2 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:54.354104 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a13882d-f60e-477f-86a1-42bba9672e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:54.354965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13882d-f60e-477f-86a1-42bba9672e53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:54.355295 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13882d-f60e-477f-86a1-42bba9672e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:54.355665 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a13882d-f60e-477f-86a1-42bba9672e53 admin admin] PATH_INFO: `/v3/projects/8ba6210057534cafabd1f876a28bb879` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:54.356756 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13882d-f60e-477f-86a1-42bba9672e53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ba6210057534cafabd1f876a28bb879)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:54.358716 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a13882d-f60e-477f-86a1-42bba9672e53 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:54.381910 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2cd621e6-ac74-4db3-a35e-d7291a76bbd2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe1e4f7e7fc545db92ec732bfef7a47f', 'request_id': 'req-2cd621e6-ac74-4db3-a35e-d7291a76bbd2'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:54.389847 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2cd621e6-ac74-4db3-a35e-d7291a76bbd2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe1e4f7e7fc545db92ec732bfef7a47f', 'request_id': 'req-2cd621e6-ac74-4db3-a35e-d7291a76bbd2'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:54.397682 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2cd621e6-ac74-4db3-a35e-d7291a76bbd2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe1e4f7e7fc545db92ec732bfef7a47f', 'request_id': 'req-2cd621e6-ac74-4db3-a35e-d7291a76bbd2'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:54.412525 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2cd621e6-ac74-4db3-a35e-d7291a76bbd2 admin admin] The token cache is being invalidate because project fe1e4f7e7fc545db92ec732bfef7a47f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:54.412881 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2cd621e6-ac74-4db3-a35e-d7291a76bbd2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:54.413676 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0a13882d-f60e-477f-86a1-42bba9672e53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ba6210057534cafabd1f876a28bb879', 'request_id': 'req-0a13882d-f60e-477f-86a1-42bba9672e53'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:54.414655 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2cd621e6-ac74-4db3-a35e-d7291a76bbd2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:54.417012 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1264/2530] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:54 2022] DELETE /identity/v3/projects/fe1e4f7e7fc545db92ec732bfef7a47f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:54.421529 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e074f1-bafa-4dc2-bee8-6b0f8cabe22a None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:54.421931 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e074f1-bafa-4dc2-bee8-6b0f8cabe22a None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:54.422283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e074f1-bafa-4dc2-bee8-6b0f8cabe22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:54.425439 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0a13882d-f60e-477f-86a1-42bba9672e53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ba6210057534cafabd1f876a28bb879', 'request_id': 'req-0a13882d-f60e-477f-86a1-42bba9672e53'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:54.426903 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:54.435441 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0a13882d-f60e-477f-86a1-42bba9672e53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ba6210057534cafabd1f876a28bb879', 'request_id': 'req-0a13882d-f60e-477f-86a1-42bba9672e53'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:54.443528 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-15e074f1-bafa-4dc2-bee8-6b0f8cabe22a None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:54.445382 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-15e074f1-bafa-4dc2-bee8-6b0f8cabe22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:54.451625 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0a13882d-f60e-477f-86a1-42bba9672e53 admin admin] The token cache is being invalidate because project 8ba6210057534cafabd1f876a28bb879 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:54.451972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0a13882d-f60e-477f-86a1-42bba9672e53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:54.452619 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0a13882d-f60e-477f-86a1-42bba9672e53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:54.454911 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1267/2531] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:54 2022] DELETE /identity/v3/projects/8ba6210057534cafabd1f876a28bb879 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:37:54.459546 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d9671-080b-4be4-a771-b8ec2bbb5488 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:54.459890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d9671-080b-4be4-a771-b8ec2bbb5488 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:54.460176 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d9671-080b-4be4-a771-b8ec2bbb5488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:54.478942 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-118d9671-080b-4be4-a771-b8ec2bbb5488 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:54.480185 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-118d9671-080b-4be4-a771-b8ec2bbb5488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:54.520984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1265/2532] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:37:54.522583 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130daf65-9b68-42e3-a185-836eb29a7c06 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:54.522875 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130daf65-9b68-42e3-a185-836eb29a7c06 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:54.523156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130daf65-9b68-42e3-a185-836eb29a7c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:54.546054 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-130daf65-9b68-42e3-a185-836eb29a7c06 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:54.547392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-130daf65-9b68-42e3-a185-836eb29a7c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:54.550676 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1268/2533] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:37:54.555516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1266/2534] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:37:54.558083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82847a-9963-4e2c-ac0a-7e09812a8fa2 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:54.558380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82847a-9963-4e2c-ac0a-7e09812a8fa2 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:54.558663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82847a-9963-4e2c-ac0a-7e09812a8fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:54.559578 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130daf65-9b68-42e3-a185-836eb29a7c06 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:54.568946 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130daf65-9b68-42e3-a185-836eb29a7c06 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:54.573562 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e7979-4915-451b-84e5-a10b6ee71af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:54.574204 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e7979-4915-451b-84e5-a10b6ee71af9 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:54.574489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e7979-4915-451b-84e5-a10b6ee71af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:54.574764 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102e7979-4915-451b-84e5-a10b6ee71af9 admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:54.575482 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e7979-4915-451b-84e5-a10b6ee71af9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:37:54.575827 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e7979-4915-451b-84e5-a10b6ee71af9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:54.576596 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-de82847a-9963-4e2c-ac0a-7e09812a8fa2 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:54.577429 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102e7979-4915-451b-84e5-a10b6ee71af9 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:54.577777 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-de82847a-9963-4e2c-ac0a-7e09812a8fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:54.586646 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1269/2535] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:37:54.589878 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1267/2536] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:37:54.590797 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82847a-9963-4e2c-ac0a-7e09812a8fa2 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:54.593414 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e7979-4915-451b-84e5-a10b6ee71af9 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:54.601487 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82847a-9963-4e2c-ac0a-7e09812a8fa2 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:54.603561 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102e7979-4915-451b-84e5-a10b6ee71af9 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:54.606319 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0899a80-176a-4e6e-9d87-16d38cc26301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:54.607038 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0899a80-176a-4e6e-9d87-16d38cc26301 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:54.607263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0899a80-176a-4e6e-9d87-16d38cc26301 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:54.607552 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0899a80-176a-4e6e-9d87-16d38cc26301 admin admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:54.608290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc01492-2fb9-414c-9cac-ed948d214eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:54.608422 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0899a80-176a-4e6e-9d87-16d38cc26301 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:37:54.608639 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0899a80-176a-4e6e-9d87-16d38cc26301 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:54.608916 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc01492-2fb9-414c-9cac-ed948d214eb2 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:54.609202 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc01492-2fb9-414c-9cac-ed948d214eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:54.609478 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc01492-2fb9-414c-9cac-ed948d214eb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:54.610158 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc01492-2fb9-414c-9cac-ed948d214eb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:54.610283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0899a80-176a-4e6e-9d87-16d38cc26301 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:54.612127 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc01492-2fb9-414c-9cac-ed948d214eb2 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:54.622697 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1270/2537] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:37:54.627031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0899a80-176a-4e6e-9d87-16d38cc26301 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:54.636853 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0899a80-176a-4e6e-9d87-16d38cc26301 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:54.637863 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1268/2538] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:54 2022] POST /identity/v3/projects => generated 399 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:37:54.643167 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc01492-2fb9-414c-9cac-ed948d214eb2 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:54.652100 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:54.695176 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a7f80-7616-4b59-bf45-8d28bc3e5929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:54.695813 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a7f80-7616-4b59-bf45-8d28bc3e5929 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:54.696104 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a7f80-7616-4b59-bf45-8d28bc3e5929 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:54.696388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160a7f80-7616-4b59-bf45-8d28bc3e5929 admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:54.697133 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a7f80-7616-4b59-bf45-8d28bc3e5929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:54.699036 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160a7f80-7616-4b59-bf45-8d28bc3e5929 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:54.709584 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc01492-2fb9-414c-9cac-ed948d214eb2 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:54.714253 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4878320-c7a2-47ff-bad2-37b266fbfe5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:54.714961 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4878320-c7a2-47ff-bad2-37b266fbfe5e admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:54.715311 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4878320-c7a2-47ff-bad2-37b266fbfe5e admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:54.715665 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4878320-c7a2-47ff-bad2-37b266fbfe5e admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:54.716529 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4878320-c7a2-47ff-bad2-37b266fbfe5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:54.718770 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4878320-c7a2-47ff-bad2-37b266fbfe5e admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:54.728764 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1271/2539] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:54 2022] POST /identity/v3/projects => generated 363 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:37:54.729768 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a7f80-7616-4b59-bf45-8d28bc3e5929 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:54.745899 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1269/2540] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:37:54 2022] POST /identity/v3/users => generated 300 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:37:54.746910 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4878320-c7a2-47ff-bad2-37b266fbfe5e admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:54.756490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4878320-c7a2-47ff-bad2-37b266fbfe5e admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:54.787737 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:54.802240 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160a7f80-7616-4b59-bf45-8d28bc3e5929 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:54.807056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ef287-dbaf-441f-9ef6-7c1ac8cf0bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:54.807777 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ef287-dbaf-441f-9ef6-7c1ac8cf0bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:54.808067 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ef287-dbaf-441f-9ef6-7c1ac8cf0bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:54.808349 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981ef287-dbaf-441f-9ef6-7c1ac8cf0bf5 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:54.809059 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ef287-dbaf-441f-9ef6-7c1ac8cf0bf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:54.810984 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981ef287-dbaf-441f-9ef6-7c1ac8cf0bf5 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:54.817168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e670e5-ebf6-4ecd-aa3b-452bff929cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:54.817831 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e670e5-ebf6-4ecd-aa3b-452bff929cf2 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:54.818115 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e670e5-ebf6-4ecd-aa3b-452bff929cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:54.818388 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e670e5-ebf6-4ecd-aa3b-452bff929cf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:54.819108 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e670e5-ebf6-4ecd-aa3b-452bff929cf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:54.820726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e670e5-ebf6-4ecd-aa3b-452bff929cf2 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:54.832052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1270/2541] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:37:54.832522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1272/2542] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:37:54 2022] POST /identity/v3/users => generated 282 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:37:54.836220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ef287-dbaf-441f-9ef6-7c1ac8cf0bf5 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:54.836356 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e670e5-ebf6-4ecd-aa3b-452bff929cf2 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:54.846268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e670e5-ebf6-4ecd-aa3b-452bff929cf2 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:54.846633 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981ef287-dbaf-441f-9ef6-7c1ac8cf0bf5 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:54.850992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1beed2f-a642-41a7-bf6d-2d28f11ef670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:54.851305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801b8c2-3f64-44a0-bb6f-c3c6610d429a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:54.851702 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1beed2f-a642-41a7-bf6d-2d28f11ef670 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:54.851994 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1beed2f-a642-41a7-bf6d-2d28f11ef670 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:54.852097 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801b8c2-3f64-44a0-bb6f-c3c6610d429a admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:54.852279 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1beed2f-a642-41a7-bf6d-2d28f11ef670 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:54.852391 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801b8c2-3f64-44a0-bb6f-c3c6610d429a admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:54.852606 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c801b8c2-3f64-44a0-bb6f-c3c6610d429a admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:54.853000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1beed2f-a642-41a7-bf6d-2d28f11ef670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:54.853332 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801b8c2-3f64-44a0-bb6f-c3c6610d429a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:54.854632 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1beed2f-a642-41a7-bf6d-2d28f11ef670 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:54.854906 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c801b8c2-3f64-44a0-bb6f-c3c6610d429a admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:54.865152 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1273/2543] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:54.865439 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1271/2544] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:54.869221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801b8c2-3f64-44a0-bb6f-c3c6610d429a admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:54.871891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1beed2f-a642-41a7-bf6d-2d28f11ef670 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:54.879349 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c801b8c2-3f64-44a0-bb6f-c3c6610d429a admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:54.882556 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1beed2f-a642-41a7-bf6d-2d28f11ef670 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:54.884108 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fc96d6-ebd6-4d37-a163-65cb403ab9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:54.884980 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc96d6-ebd6-4d37-a163-65cb403ab9a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:54.885268 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc96d6-ebd6-4d37-a163-65cb403ab9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:54.885550 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fc96d6-ebd6-4d37-a163-65cb403ab9a3 admin admin] PATH_INFO: `/v3/projects/5eaf2a66bac4410dab960144def89dfb/users/9f492427c3d54b4390224b8cef69fece/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:54.887260 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d4b18-d912-419f-8015-2d461b00ddc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:54.887941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d4b18-d912-419f-8015-2d461b00ddc7 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:54.888226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d4b18-d912-419f-8015-2d461b00ddc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:54.888508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d4b18-d912-419f-8015-2d461b00ddc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:54.889229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d4b18-d912-419f-8015-2d461b00ddc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:54.890817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d4b18-d912-419f-8015-2d461b00ddc7 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:54.901040 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc96d6-ebd6-4d37-a163-65cb403ab9a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5eaf2a66bac4410dab960144def89dfb, user_id=9f492427c3d54b4390224b8cef69fece, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:54.902373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1272/2545] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:37:54.903724 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fc96d6-ebd6-4d37-a163-65cb403ab9a3 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:54.906127 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d4b18-d912-419f-8015-2d461b00ddc7 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:54.916114 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d4b18-d912-419f-8015-2d461b00ddc7 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:54.916655 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1274/2546] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:54 2022] PUT /identity/v3/projects/5eaf2a66bac4410dab960144def89dfb/users/9f492427c3d54b4390224b8cef69fece/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:54.927810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab5bb3-ed37-47b6-b854-01bad2a2735a None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:54.928107 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab5bb3-ed37-47b6-b854-01bad2a2735a None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:54.928393 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab5bb3-ed37-47b6-b854-01bad2a2735a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:54.955041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-89ab5bb3-ed37-47b6-b854-01bad2a2735a None None] MFA Rules not processed for user `9f492427c3d54b4390224b8cef69fece`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:54.956094 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-89ab5bb3-ed37-47b6-b854-01bad2a2735a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:54.974146 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dafb006-a22d-4db0-9964-1ff68ea5a55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:54.975125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafb006-a22d-4db0-9964-1ff68ea5a55a admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:54.975350 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafb006-a22d-4db0-9964-1ff68ea5a55a admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:54.975764 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dafb006-a22d-4db0-9964-1ff68ea5a55a admin admin] PATH_INFO: `/v3/projects/f97df3b216344ed48158dc5f4993ce77/users/0865dadb76294b3b9d73b37829d9d70c/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:54.990022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafb006-a22d-4db0-9964-1ff68ea5a55a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f97df3b216344ed48158dc5f4993ce77, user_id=0865dadb76294b3b9d73b37829d9d70c, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:54.992744 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dafb006-a22d-4db0-9964-1ff68ea5a55a admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:54.995069 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:55.008243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1273/2547] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:54 2022] PUT /identity/v3/projects/f97df3b216344ed48158dc5f4993ce77/users/0865dadb76294b3b9d73b37829d9d70c/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:37:55.019117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fe7ee-38e3-410e-9d03-22ed262e0ee0 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:55.019407 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fe7ee-38e3-410e-9d03-22ed262e0ee0 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:55.019725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fe7ee-38e3-410e-9d03-22ed262e0ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:55.023835 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1275/2548] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:37:55.028194 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab5bb3-ed37-47b6-b854-01bad2a2735a None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:55.038502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab5bb3-ed37-47b6-b854-01bad2a2735a None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:55.045052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-3f8fe7ee-38e3-410e-9d03-22ed262e0ee0 None None] MFA Rules not processed for user `0865dadb76294b3b9d73b37829d9d70c`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:55.046254 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-3f8fe7ee-38e3-410e-9d03-22ed262e0ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:55.095250 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0479a69-b754-4ea8-b79d-195490ef146e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:55.095954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0479a69-b754-4ea8-b79d-195490ef146e admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:55.096247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0479a69-b754-4ea8-b79d-195490ef146e admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:55.096531 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0479a69-b754-4ea8-b79d-195490ef146e admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:55.097231 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0479a69-b754-4ea8-b79d-195490ef146e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:55.099206 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0479a69-b754-4ea8-b79d-195490ef146e admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:55.110070 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1274/2549] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:55 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:37:55.114474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fe7ee-38e3-410e-9d03-22ed262e0ee0 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:55.128382 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fe7ee-38e3-410e-9d03-22ed262e0ee0 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:55.128559 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1276/2550] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:55 2022] POST /identity/v3/projects => generated 399 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:37:55.129797 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0479a69-b754-4ea8-b79d-195490ef146e admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:55.155502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:55.183754 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b10cd-319d-4a3e-97d3-3d111f248df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:55.184418 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b10cd-319d-4a3e-97d3-3d111f248df8 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:55.184702 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b10cd-319d-4a3e-97d3-3d111f248df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:55.184981 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726b10cd-319d-4a3e-97d3-3d111f248df8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:55.185670 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b10cd-319d-4a3e-97d3-3d111f248df8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:55.187593 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726b10cd-319d-4a3e-97d3-3d111f248df8 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:55.199599 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0479a69-b754-4ea8-b79d-195490ef146e admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:55.205727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac04e70-2bb0-4716-b1dd-9525b2e97213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:55.206418 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac04e70-2bb0-4716-b1dd-9525b2e97213 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:55.206622 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac04e70-2bb0-4716-b1dd-9525b2e97213 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:55.206926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac04e70-2bb0-4716-b1dd-9525b2e97213 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:55.207580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac04e70-2bb0-4716-b1dd-9525b2e97213 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:55.209531 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac04e70-2bb0-4716-b1dd-9525b2e97213 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:55.215348 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1275/2551] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:37:55 2022] POST /identity/v3/projects => generated 365 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:37:55.219665 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b10cd-319d-4a3e-97d3-3d111f248df8 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:55.230590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1277/2552] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:37:55 2022] POST /identity/v3/users => generated 306 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:37:55.234247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac04e70-2bb0-4716-b1dd-9525b2e97213 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:55.244443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac04e70-2bb0-4716-b1dd-9525b2e97213 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:55.281855 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726b10cd-319d-4a3e-97d3-3d111f248df8 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:55.286710 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b26fec-3848-497d-9325-426442dae293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:55.287378 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b26fec-3848-497d-9325-426442dae293 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:55.287690 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b26fec-3848-497d-9325-426442dae293 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:55.287974 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b26fec-3848-497d-9325-426442dae293 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:55.288653 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b26fec-3848-497d-9325-426442dae293 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:55.290617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b26fec-3848-497d-9325-426442dae293 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:55.302554 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338208a9-84cf-4587-bd0b-5d2646b893e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:55.303361 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338208a9-84cf-4587-bd0b-5d2646b893e9 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:55.303775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338208a9-84cf-4587-bd0b-5d2646b893e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:55.304128 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338208a9-84cf-4587-bd0b-5d2646b893e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:55.304886 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338208a9-84cf-4587-bd0b-5d2646b893e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:55.305584 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:55.306738 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338208a9-84cf-4587-bd0b-5d2646b893e9 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:55.312934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1276/2553] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:37:55 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:37:55.316752 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b26fec-3848-497d-9325-426442dae293 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:55.320942 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1278/2554] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:37:55.321870 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338208a9-84cf-4587-bd0b-5d2646b893e9 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:55.326792 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b26fec-3848-497d-9325-426442dae293 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:55.331471 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338208a9-84cf-4587-bd0b-5d2646b893e9 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:55.331980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596600f-56a6-489f-987f-7df3c7103e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:55.332636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596600f-56a6-489f-987f-7df3c7103e18 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:55.332922 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596600f-56a6-489f-987f-7df3c7103e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:55.333203 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596600f-56a6-489f-987f-7df3c7103e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:55.333930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596600f-56a6-489f-987f-7df3c7103e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:55.335540 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c596600f-56a6-489f-987f-7df3c7103e18 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:55.336266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfbfbb-ef40-495c-b98f-582ca3064f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:55.337130 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfbfbb-ef40-495c-b98f-582ca3064f49 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:55.337416 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfbfbb-ef40-495c-b98f-582ca3064f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:55.337699 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edfbfbb-ef40-495c-b98f-582ca3064f49 admin admin] PATH_INFO: `/v3/projects/20c523f3419f4c22bb5aefbdbf15834f/users/cd59dcfb24b04ec78622a23f45b1b93d/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:55.349216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1277/2555] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:37:55.350240 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596600f-56a6-489f-987f-7df3c7103e18 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:55.353122 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfbfbb-ef40-495c-b98f-582ca3064f49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20c523f3419f4c22bb5aefbdbf15834f, user_id=cd59dcfb24b04ec78622a23f45b1b93d, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:55.355829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edfbfbb-ef40-495c-b98f-582ca3064f49 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:55.360052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596600f-56a6-489f-987f-7df3c7103e18 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:55.365498 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc04ea-4c92-4adf-bbab-8ab4fb57d421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:55.366371 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc04ea-4c92-4adf-bbab-8ab4fb57d421 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:55.366661 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc04ea-4c92-4adf-bbab-8ab4fb57d421 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:55.366940 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc04ea-4c92-4adf-bbab-8ab4fb57d421 admin admin] PATH_INFO: `/v3/projects/650815cf47074195aa238db9c8babfba/users/8b2c1f20e63d48f2b350f1aefbdb2721/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:55.369177 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1279/2556] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:55 2022] PUT /identity/v3/projects/20c523f3419f4c22bb5aefbdbf15834f/users/cd59dcfb24b04ec78622a23f45b1b93d/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:55.373004 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfbfbb-ef40-495c-b98f-582ca3064f49 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:55.385401 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc04ea-4c92-4adf-bbab-8ab4fb57d421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=650815cf47074195aa238db9c8babfba, user_id=8b2c1f20e63d48f2b350f1aefbdb2721, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:55.388169 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc04ea-4c92-4adf-bbab-8ab4fb57d421 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:55.401954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1278/2557] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:55 2022] PUT /identity/v3/projects/650815cf47074195aa238db9c8babfba/users/8b2c1f20e63d48f2b350f1aefbdb2721/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:55.406386 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc04ea-4c92-4adf-bbab-8ab4fb57d421 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:55.438097 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edfbfbb-ef40-495c-b98f-582ca3064f49 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:55.467491 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:55.469345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc04ea-4c92-4adf-bbab-8ab4fb57d421 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:55.474655 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61a7e5-1aa1-4236-acf0-23f0ea13e96c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:55.475341 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61a7e5-1aa1-4236-acf0-23f0ea13e96c admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:55.475635 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61a7e5-1aa1-4236-acf0-23f0ea13e96c admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:55.475934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd61a7e5-1aa1-4236-acf0-23f0ea13e96c admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:55.476656 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61a7e5-1aa1-4236-acf0-23f0ea13e96c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:55.478259 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd61a7e5-1aa1-4236-acf0-23f0ea13e96c admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:55.489382 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1279/2558] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:37:55.493257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61a7e5-1aa1-4236-acf0-23f0ea13e96c admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:55.496166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5f249-c075-43cb-9290-99f185b46e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:55.496843 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5f249-c075-43cb-9290-99f185b46e5b admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:55.497127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5f249-c075-43cb-9290-99f185b46e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:55.497403 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5f249-c075-43cb-9290-99f185b46e5b admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:55.498209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5f249-c075-43cb-9290-99f185b46e5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:55.499860 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5f249-c075-43cb-9290-99f185b46e5b admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:55.503890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd61a7e5-1aa1-4236-acf0-23f0ea13e96c admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:55.508574 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293f3a7c-c8e5-4ddd-853a-3d7280864d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:55.509427 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f3a7c-c8e5-4ddd-853a-3d7280864d62 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:55.509711 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f3a7c-c8e5-4ddd-853a-3d7280864d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:55.509986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293f3a7c-c8e5-4ddd-853a-3d7280864d62 admin admin] PATH_INFO: `/v3/projects/650815cf47074195aa238db9c8babfba/users/8b2c1f20e63d48f2b350f1aefbdb2721/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:55.510443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1280/2559] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:37:55.512014 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f3a7c-c8e5-4ddd-853a-3d7280864d62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=650815cf47074195aa238db9c8babfba, user_id=8b2c1f20e63d48f2b350f1aefbdb2721, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:55.514290 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5f249-c075-43cb-9290-99f185b46e5b admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:55.514653 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293f3a7c-c8e5-4ddd-853a-3d7280864d62 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:55.523957 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5f249-c075-43cb-9290-99f185b46e5b admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:55.525110 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1280/2560] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:55 2022] PUT /identity/v3/projects/650815cf47074195aa238db9c8babfba/users/8b2c1f20e63d48f2b350f1aefbdb2721/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:37:55.535589 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf56c6-4600-4cb4-a910-2df7dddc6b60 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:55.535943 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf56c6-4600-4cb4-a910-2df7dddc6b60 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:55.536224 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf56c6-4600-4cb4-a910-2df7dddc6b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:55.565762 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-dcaf56c6-4600-4cb4-a910-2df7dddc6b60 None None] MFA Rules not processed for user `8b2c1f20e63d48f2b350f1aefbdb2721`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:55.567213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-dcaf56c6-4600-4cb4-a910-2df7dddc6b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:55.583055 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789b029-6fc2-467b-847b-15a6af51f3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:55.584091 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789b029-6fc2-467b-847b-15a6af51f3b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:55.584450 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789b029-6fc2-467b-847b-15a6af51f3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:55.584802 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789b029-6fc2-467b-847b-15a6af51f3b2 admin admin] PATH_INFO: `/v3/projects/20c523f3419f4c22bb5aefbdbf15834f/users/cd59dcfb24b04ec78622a23f45b1b93d/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:55.587168 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789b029-6fc2-467b-847b-15a6af51f3b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20c523f3419f4c22bb5aefbdbf15834f, user_id=cd59dcfb24b04ec78622a23f45b1b93d, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:55.589780 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1789b029-6fc2-467b-847b-15a6af51f3b2 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:55.601278 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1281/2561] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:37:55 2022] PUT /identity/v3/projects/20c523f3419f4c22bb5aefbdbf15834f/users/cd59dcfb24b04ec78622a23f45b1b93d/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:37:55.612414 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d817769-a8ce-41f2-a832-2087bd0bf345 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:55.612744 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d817769-a8ce-41f2-a832-2087bd0bf345 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:55.612988 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d817769-a8ce-41f2-a832-2087bd0bf345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:55.641566 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-4d817769-a8ce-41f2-a832-2087bd0bf345 None None] MFA Rules not processed for user `cd59dcfb24b04ec78622a23f45b1b93d`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:55.642889 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-4d817769-a8ce-41f2-a832-2087bd0bf345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:55.644930 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1281/2562] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:55 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:37:55.656692 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf56c6-4600-4cb4-a910-2df7dddc6b60 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:55.658848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-dcaf56c6-4600-4cb4-a910-2df7dddc6b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:55.696339 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:55.728358 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1282/2563] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:55 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:37:55.730055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf56c6-4600-4cb4-a910-2df7dddc6b60 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:55.739641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d817769-a8ce-41f2-a832-2087bd0bf345 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:55.741016 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-4d817769-a8ce-41f2-a832-2087bd0bf345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:55.779367 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc632807-f98e-4264-8a2c-14310591ac7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:55.780126 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc632807-f98e-4264-8a2c-14310591ac7a service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:55.780411 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc632807-f98e-4264-8a2c-14310591ac7a service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:55.780686 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc632807-f98e-4264-8a2c-14310591ac7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:55.797730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:55.804745 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d817769-a8ce-41f2-a832-2087bd0bf345 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:55.808739 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13604d5c-6eeb-4e57-b048-a62d8517dfbe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:55.809498 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13604d5c-6eeb-4e57-b048-a62d8517dfbe service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:55.809855 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13604d5c-6eeb-4e57-b048-a62d8517dfbe service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:55.810142 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13604d5c-6eeb-4e57-b048-a62d8517dfbe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:55.819536 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13604d5c-6eeb-4e57-b048-a62d8517dfbe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:55.821184 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13604d5c-6eeb-4e57-b048-a62d8517dfbe service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:55.831143 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1283/2564] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:55 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:37:55.845778 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc632807-f98e-4264-8a2c-14310591ac7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:55.847356 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc632807-f98e-4264-8a2c-14310591ac7a service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:55.858602 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1282/2565] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:55 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:37:55.903196 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13604d5c-6eeb-4e57-b048-a62d8517dfbe service cinder] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:55.913287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13604d5c-6eeb-4e57-b048-a62d8517dfbe service cinder] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:55.917082 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e095f-e88e-433d-a6c9-abb4af5f2c1b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:55.917725 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e095f-e88e-433d-a6c9-abb4af5f2c1b service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:55.918015 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e095f-e88e-433d-a6c9-abb4af5f2c1b service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:55.918298 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e095f-e88e-433d-a6c9-abb4af5f2c1b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:55.931184 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc632807-f98e-4264-8a2c-14310591ac7a service cinder] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:55.939846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc632807-f98e-4264-8a2c-14310591ac7a service cinder] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:55.943641 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce6d43f-d024-405a-b74f-580fce07b6dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:55.944293 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6d43f-d024-405a-b74f-580fce07b6dc service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:55.944704 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6d43f-d024-405a-b74f-580fce07b6dc service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:55.944995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce6d43f-d024-405a-b74f-580fce07b6dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:55.987936 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e095f-e88e-433d-a6c9-abb4af5f2c1b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:55.989494 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e095f-e88e-433d-a6c9-abb4af5f2c1b service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:55.999043 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1284/2566] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:55 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:56.013204 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce6d43f-d024-405a-b74f-580fce07b6dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:56.014636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce6d43f-d024-405a-b74f-580fce07b6dc service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:56.024290 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1283/2567] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:55 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:37:58.741588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e095f-e88e-433d-a6c9-abb4af5f2c1b service cinder] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:58.815951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e095f-e88e-433d-a6c9-abb4af5f2c1b service cinder] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:58.820505 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cc698-e49a-42eb-9902-b39c38a48418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:58.821372 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cc698-e49a-42eb-9902-b39c38a48418 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:58.821736 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cc698-e49a-42eb-9902-b39c38a48418 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:58.821938 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3cc698-e49a-42eb-9902-b39c38a48418 admin admin] PATH_INFO: `/v3/users/0865dadb76294b3b9d73b37829d9d70c` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:58.823214 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cc698-e49a-42eb-9902-b39c38a48418 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0865dadb76294b3b9d73b37829d9d70c)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:58.825389 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3cc698-e49a-42eb-9902-b39c38a48418 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:58.877242 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2e3cc698-e49a-42eb-9902-b39c38a48418 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0865dadb76294b3b9d73b37829d9d70c'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:58.884166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2e3cc698-e49a-42eb-9902-b39c38a48418 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0865dadb76294b3b9d73b37829d9d70c'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:58.884828 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2e3cc698-e49a-42eb-9902-b39c38a48418 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0865dadb76294b3b9d73b37829d9d70c'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:58.885483 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2e3cc698-e49a-42eb-9902-b39c38a48418 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0865dadb76294b3b9d73b37829d9d70c'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:58.903457 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2e3cc698-e49a-42eb-9902-b39c38a48418 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0865dadb76294b3b9d73b37829d9d70c'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:58.915976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1285/2568] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:58 2022] DELETE /identity/v3/users/0865dadb76294b3b9d73b37829d9d70c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:58.920522 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a88346-9f78-413d-9a55-b287b1725415 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:58.921011 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a88346-9f78-413d-9a55-b287b1725415 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:58.921120 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a88346-9f78-413d-9a55-b287b1725415 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:58.937824 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-e3a88346-9f78-413d-9a55-b287b1725415 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:37:58.939557 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e3a88346-9f78-413d-9a55-b287b1725415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:58.970203 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=100 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:58.999280 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1284/2569] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:37:59.009597 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cc698-e49a-42eb-9902-b39c38a48418 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:59.011081 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-2e3cc698-e49a-42eb-9902-b39c38a48418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:59.021903 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:37:59.071379 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3cc698-e49a-42eb-9902-b39c38a48418 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:59.074999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f93d9-60f4-4064-8e84-56eb114b5422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:59.075784 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f93d9-60f4-4064-8e84-56eb114b5422 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:59.076066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f93d9-60f4-4064-8e84-56eb114b5422 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:59.076323 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f93d9-60f4-4064-8e84-56eb114b5422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:59.085448 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f93d9-60f4-4064-8e84-56eb114b5422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:59.086885 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f93d9-60f4-4064-8e84-56eb114b5422 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:59.096307 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1286/2570] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:37:59.371222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a88346-9f78-413d-9a55-b287b1725415 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:59.372808 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e3a88346-9f78-413d-9a55-b287b1725415 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:59.386123 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a88346-9f78-413d-9a55-b287b1725415 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:59.393251 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e862b66-66c5-49d2-9d3b-d16cfba477f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:59.394278 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e862b66-66c5-49d2-9d3b-d16cfba477f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:59.394564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e862b66-66c5-49d2-9d3b-d16cfba477f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:59.394922 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e862b66-66c5-49d2-9d3b-d16cfba477f6 admin admin] PATH_INFO: `/v3/projects/f97df3b216344ed48158dc5f4993ce77` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:59.396360 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e862b66-66c5-49d2-9d3b-d16cfba477f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f97df3b216344ed48158dc5f4993ce77)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:59.398450 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e862b66-66c5-49d2-9d3b-d16cfba477f6 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:59.449445 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-7e862b66-66c5-49d2-9d3b-d16cfba477f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f97df3b216344ed48158dc5f4993ce77', 'request_id': 'req-7e862b66-66c5-49d2-9d3b-d16cfba477f6'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:59.455185 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-7e862b66-66c5-49d2-9d3b-d16cfba477f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f97df3b216344ed48158dc5f4993ce77', 'request_id': 'req-7e862b66-66c5-49d2-9d3b-d16cfba477f6'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:59.462499 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-7e862b66-66c5-49d2-9d3b-d16cfba477f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f97df3b216344ed48158dc5f4993ce77', 'request_id': 'req-7e862b66-66c5-49d2-9d3b-d16cfba477f6'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:59.476607 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-7e862b66-66c5-49d2-9d3b-d16cfba477f6 admin admin] The token cache is being invalidate because project f97df3b216344ed48158dc5f4993ce77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:37:59.476954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-7e862b66-66c5-49d2-9d3b-d16cfba477f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:59.477540 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-7e862b66-66c5-49d2-9d3b-d16cfba477f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:59.479517 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1285/2571] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:59 2022] DELETE /identity/v3/projects/f97df3b216344ed48158dc5f4993ce77 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:59.483384 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f93d9-60f4-4064-8e84-56eb114b5422 service neutron] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:59.493888 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f93d9-60f4-4064-8e84-56eb114b5422 service neutron] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:59.550164 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdda4c4-71b5-4ba3-b795-5b82736e7cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:59.551061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdda4c4-71b5-4ba3-b795-5b82736e7cff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:59.551342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdda4c4-71b5-4ba3-b795-5b82736e7cff admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:59.551641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdda4c4-71b5-4ba3-b795-5b82736e7cff admin admin] PATH_INFO: `/v3/users/8b2c1f20e63d48f2b350f1aefbdb2721` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:59.552824 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdda4c4-71b5-4ba3-b795-5b82736e7cff admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b2c1f20e63d48f2b350f1aefbdb2721)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:59.554732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdda4c4-71b5-4ba3-b795-5b82736e7cff admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:37:59.599765 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4fdda4c4-71b5-4ba3-b795-5b82736e7cff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b2c1f20e63d48f2b350f1aefbdb2721'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:59.606844 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4fdda4c4-71b5-4ba3-b795-5b82736e7cff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b2c1f20e63d48f2b350f1aefbdb2721'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:59.607455 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4fdda4c4-71b5-4ba3-b795-5b82736e7cff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b2c1f20e63d48f2b350f1aefbdb2721'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:59.608093 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4fdda4c4-71b5-4ba3-b795-5b82736e7cff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b2c1f20e63d48f2b350f1aefbdb2721'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:59.620677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4fdda4c4-71b5-4ba3-b795-5b82736e7cff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b2c1f20e63d48f2b350f1aefbdb2721'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:37:59.632772 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1287/2572] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:37:59 2022] DELETE /identity/v3/users/8b2c1f20e63d48f2b350f1aefbdb2721 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:37:59.911551 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e862b66-66c5-49d2-9d3b-d16cfba477f6 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:37:59.913671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-7e862b66-66c5-49d2-9d3b-d16cfba477f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:37:59.927668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e862b66-66c5-49d2-9d3b-d16cfba477f6 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:37:59.991374 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f665b4ac-5c61-4fae-8276-b81b5848fcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:37:59.992209 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665b4ac-5c61-4fae-8276-b81b5848fcab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:37:59.992492 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665b4ac-5c61-4fae-8276-b81b5848fcab admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:37:59.992772 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f665b4ac-5c61-4fae-8276-b81b5848fcab admin admin] PATH_INFO: `/v3/projects/650815cf47074195aa238db9c8babfba` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:37:59.993965 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665b4ac-5c61-4fae-8276-b81b5848fcab admin admin] RBAC: Authorizing `identity:delete_project(project_id=650815cf47074195aa238db9c8babfba)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:37:59.995927 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f665b4ac-5c61-4fae-8276-b81b5848fcab admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:00.046446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-f665b4ac-5c61-4fae-8276-b81b5848fcab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '650815cf47074195aa238db9c8babfba', 'request_id': 'req-f665b4ac-5c61-4fae-8276-b81b5848fcab'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:00.052241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-f665b4ac-5c61-4fae-8276-b81b5848fcab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '650815cf47074195aa238db9c8babfba', 'request_id': 'req-f665b4ac-5c61-4fae-8276-b81b5848fcab'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:00.054560 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:00.061022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-f665b4ac-5c61-4fae-8276-b81b5848fcab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '650815cf47074195aa238db9c8babfba', 'request_id': 'req-f665b4ac-5c61-4fae-8276-b81b5848fcab'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:00.067492 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdda4c4-71b5-4ba3-b795-5b82736e7cff admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:00.069156 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-4fdda4c4-71b5-4ba3-b795-5b82736e7cff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:00.076430 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-f665b4ac-5c61-4fae-8276-b81b5848fcab admin admin] The token cache is being invalidate because project 650815cf47074195aa238db9c8babfba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:38:00.076879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-f665b4ac-5c61-4fae-8276-b81b5848fcab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:00.077386 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-f665b4ac-5c61-4fae-8276-b81b5848fcab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:00.078993 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1286/2573] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:37:59 2022] DELETE /identity/v3/projects/650815cf47074195aa238db9c8babfba => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:00.082278 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdda4c4-71b5-4ba3-b795-5b82736e7cff admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:00.083582 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e443f-c3d9-49f6-b322-db36d8cdd9ec None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:00.083891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e443f-c3d9-49f6-b322-db36d8cdd9ec None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:00.084236 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28e443f-c3d9-49f6-b322-db36d8cdd9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:00.102428 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-c28e443f-c3d9-49f6-b322-db36d8cdd9ec None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:00.103636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-c28e443f-c3d9-49f6-b322-db36d8cdd9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:00.108083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:00.138983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c4dc8-1234-430f-a5b3-a3bfaa93b169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:00.139882 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c4dc8-1234-430f-a5b3-a3bfaa93b169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:00.140186 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c4dc8-1234-430f-a5b3-a3bfaa93b169 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:00.140450 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c4dc8-1234-430f-a5b3-a3bfaa93b169 admin admin] PATH_INFO: `/v3/users/9f492427c3d54b4390224b8cef69fece` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:00.141915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c4dc8-1234-430f-a5b3-a3bfaa93b169 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f492427c3d54b4390224b8cef69fece)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:00.143877 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c4dc8-1234-430f-a5b3-a3bfaa93b169 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:00.165255 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1287/2574] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:00.173646 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741a2e8-af84-471a-8212-b272c9ad7315 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:00.173939 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741a2e8-af84-471a-8212-b272c9ad7315 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:00.174490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741a2e8-af84-471a-8212-b272c9ad7315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:00.190966 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7c6c4dc8-1234-430f-a5b3-a3bfaa93b169 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f492427c3d54b4390224b8cef69fece'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:00.193608 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-b741a2e8-af84-471a-8212-b272c9ad7315 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:00.194819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-b741a2e8-af84-471a-8212-b272c9ad7315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:00.198594 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7c6c4dc8-1234-430f-a5b3-a3bfaa93b169 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f492427c3d54b4390224b8cef69fece'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:00.199235 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7c6c4dc8-1234-430f-a5b3-a3bfaa93b169 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f492427c3d54b4390224b8cef69fece'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:00.199895 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7c6c4dc8-1234-430f-a5b3-a3bfaa93b169 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f492427c3d54b4390224b8cef69fece'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:00.204751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1288/2575] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:38:00.208834 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741a2e8-af84-471a-8212-b272c9ad7315 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:00.212323 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7c6c4dc8-1234-430f-a5b3-a3bfaa93b169 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f492427c3d54b4390224b8cef69fece'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:00.217780 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741a2e8-af84-471a-8212-b272c9ad7315 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:00.222934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7930f-2aea-4c1a-8fbb-4987e28df5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:00.223567 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7930f-2aea-4c1a-8fbb-4987e28df5fe admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:00.223884 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7930f-2aea-4c1a-8fbb-4987e28df5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:00.224162 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba7930f-2aea-4c1a-8fbb-4987e28df5fe admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:00.224877 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7930f-2aea-4c1a-8fbb-4987e28df5fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:38:00.225185 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7930f-2aea-4c1a-8fbb-4987e28df5fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:00.225992 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1288/2576] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:38:00 2022] DELETE /identity/v3/users/9f492427c3d54b4390224b8cef69fece => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:38:00.226946 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba7930f-2aea-4c1a-8fbb-4987e28df5fe admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:00.230204 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c24a5-4d34-42ba-be71-ab8bf54878ef None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:00.230537 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c24a5-4d34-42ba-be71-ab8bf54878ef None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:00.230835 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348c24a5-4d34-42ba-be71-ab8bf54878ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:00.240012 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1289/2577] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:38:00.244106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7930f-2aea-4c1a-8fbb-4987e28df5fe admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:00.248933 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-348c24a5-4d34-42ba-be71-ab8bf54878ef None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:00.250273 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-348c24a5-4d34-42ba-be71-ab8bf54878ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:00.253605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba7930f-2aea-4c1a-8fbb-4987e28df5fe admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:00.309908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4308d-5e2c-411f-a09b-86b9e22f46dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:00.310568 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4308d-5e2c-411f-a09b-86b9e22f46dd admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:00.310861 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4308d-5e2c-411f-a09b-86b9e22f46dd admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:00.311015 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1289/2578] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:38:00.311172 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e4308d-5e2c-411f-a09b-86b9e22f46dd admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:00.311915 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4308d-5e2c-411f-a09b-86b9e22f46dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:00.313968 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e4308d-5e2c-411f-a09b-86b9e22f46dd admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:00.320727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c24a5-4d34-42ba-be71-ab8bf54878ef None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:00.322066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-348c24a5-4d34-42ba-be71-ab8bf54878ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:00.342312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1290/2579] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:38:00 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:38:00.347055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4308d-5e2c-411f-a09b-86b9e22f46dd admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:00.376868 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:00.380856 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348c24a5-4d34-42ba-be71-ab8bf54878ef None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:00.406715 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:00.413887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e4308d-5e2c-411f-a09b-86b9e22f46dd admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:00.420873 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a136d8-31d6-4ff1-a3c6-f3a699eb8926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:00.421545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a136d8-31d6-4ff1-a3c6-f3a699eb8926 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:00.421835 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a136d8-31d6-4ff1-a3c6-f3a699eb8926 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:00.422251 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a136d8-31d6-4ff1-a3c6-f3a699eb8926 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:00.423540 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a136d8-31d6-4ff1-a3c6-f3a699eb8926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:00.425533 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a136d8-31d6-4ff1-a3c6-f3a699eb8926 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:00.434759 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf346c2b-1efe-4fdf-8ce2-33b291898ddf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:00.435407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf346c2b-1efe-4fdf-8ce2-33b291898ddf service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:00.435713 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf346c2b-1efe-4fdf-8ce2-33b291898ddf service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:00.435991 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf346c2b-1efe-4fdf-8ce2-33b291898ddf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:00.445887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1291/2580] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:38:00 2022] POST /identity/v3/users => generated 292 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:38:00.446067 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf346c2b-1efe-4fdf-8ce2-33b291898ddf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:00.447384 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf346c2b-1efe-4fdf-8ce2-33b291898ddf service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:00.449804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a136d8-31d6-4ff1-a3c6-f3a699eb8926 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:00.457538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1290/2581] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:38:00.460197 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a136d8-31d6-4ff1-a3c6-f3a699eb8926 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:00.465283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d229b24-e311-4000-81a4-e021c2d63e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:00.465953 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d229b24-e311-4000-81a4-e021c2d63e9d admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:00.466244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d229b24-e311-4000-81a4-e021c2d63e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:00.466545 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d229b24-e311-4000-81a4-e021c2d63e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:00.467281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d229b24-e311-4000-81a4-e021c2d63e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:00.469260 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d229b24-e311-4000-81a4-e021c2d63e9d admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:00.480281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1292/2582] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:38:00.484215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf346c2b-1efe-4fdf-8ce2-33b291898ddf service neutron] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:00.495042 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf346c2b-1efe-4fdf-8ce2-33b291898ddf service neutron] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:00.499802 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df33fbe4-3e43-4cc6-bcc7-fc915dec6213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:00.500465 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33fbe4-3e43-4cc6-bcc7-fc915dec6213 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:00.500746 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33fbe4-3e43-4cc6-bcc7-fc915dec6213 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:00.501047 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df33fbe4-3e43-4cc6-bcc7-fc915dec6213 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:00.501767 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33fbe4-3e43-4cc6-bcc7-fc915dec6213 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:00.503359 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df33fbe4-3e43-4cc6-bcc7-fc915dec6213 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:00.515362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1291/2583] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:38:00.520940 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d229b24-e311-4000-81a4-e021c2d63e9d admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:00.534398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d229b24-e311-4000-81a4-e021c2d63e9d admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:00.539243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a7634-7cba-4e99-92e8-c6224a9a25ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:00.540173 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a7634-7cba-4e99-92e8-c6224a9a25ca admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:00.540456 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a7634-7cba-4e99-92e8-c6224a9a25ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:00.540731 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3a7634-7cba-4e99-92e8-c6224a9a25ca admin admin] PATH_INFO: `/v3/projects/c4be2cb366374f6b8448a4147d630a35/users/af521435cc8545b3adbe195da2d44979/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:00.558176 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a7634-7cba-4e99-92e8-c6224a9a25ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4be2cb366374f6b8448a4147d630a35, user_id=af521435cc8545b3adbe195da2d44979, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:00.561020 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3a7634-7cba-4e99-92e8-c6224a9a25ca admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:00.574631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1293/2584] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:38:00 2022] PUT /identity/v3/projects/c4be2cb366374f6b8448a4147d630a35/users/af521435cc8545b3adbe195da2d44979/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:00.586148 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237d5cf-5cfc-441a-91c0-e1e7198465f6 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:00.586435 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237d5cf-5cfc-441a-91c0-e1e7198465f6 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:00.586714 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9237d5cf-5cfc-441a-91c0-e1e7198465f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:00.613398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-9237d5cf-5cfc-441a-91c0-e1e7198465f6 None None] MFA Rules not processed for user `af521435cc8545b3adbe195da2d44979`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:00.614601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-9237d5cf-5cfc-441a-91c0-e1e7198465f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:00.692299 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1292/2585] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:00.693037 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a7634-7cba-4e99-92e8-c6224a9a25ca admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:00.771571 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3a7634-7cba-4e99-92e8-c6224a9a25ca admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:00.776621 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af15e00-a772-4301-8672-a6a84552af43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:00.777280 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af15e00-a772-4301-8672-a6a84552af43 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:00.777561 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af15e00-a772-4301-8672-a6a84552af43 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:00.777832 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af15e00-a772-4301-8672-a6a84552af43 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:00.778514 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af15e00-a772-4301-8672-a6a84552af43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:00.780448 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af15e00-a772-4301-8672-a6a84552af43 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:00.802086 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237d5cf-5cfc-441a-91c0-e1e7198465f6 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:00.804181 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-9237d5cf-5cfc-441a-91c0-e1e7198465f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:00.812195 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1294/2586] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:38:00 2022] POST /identity/v3/projects => generated 383 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:38:00.816974 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af15e00-a772-4301-8672-a6a84552af43 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:00.818911 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9237d5cf-5cfc-441a-91c0-e1e7198465f6 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:00.880983 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af15e00-a772-4301-8672-a6a84552af43 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:00.885870 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3746c9-0553-4233-98a8-5e6af87bf7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:00.886540 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3746c9-0553-4233-98a8-5e6af87bf7aa admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:00.886820 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3746c9-0553-4233-98a8-5e6af87bf7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:00.887119 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3746c9-0553-4233-98a8-5e6af87bf7aa admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:00.887838 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3746c9-0553-4233-98a8-5e6af87bf7aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:00.889575 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebed98-49c8-4f55-aa16-caee0a7c9038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:00.889750 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3746c9-0553-4233-98a8-5e6af87bf7aa admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:00.890448 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebed98-49c8-4f55-aa16-caee0a7c9038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:00.890733 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebed98-49c8-4f55-aa16-caee0a7c9038 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:00.891256 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebebed98-49c8-4f55-aa16-caee0a7c9038 admin admin] PATH_INFO: `/v3/projects/5eaf2a66bac4410dab960144def89dfb` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:00.892519 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebebed98-49c8-4f55-aa16-caee0a7c9038 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5eaf2a66bac4410dab960144def89dfb)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:00.894457 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebebed98-49c8-4f55-aa16-caee0a7c9038 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:00.914516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1295/2587] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:38:00 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:38:00.915805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3746c9-0553-4233-98a8-5e6af87bf7aa admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:00.927222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3746c9-0553-4233-98a8-5e6af87bf7aa admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:00.927769 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:00.932462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fce2e-482f-471f-95c2-58f8cc52cc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:00.933198 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fce2e-482f-471f-95c2-58f8cc52cc7d admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:00.933534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fce2e-482f-471f-95c2-58f8cc52cc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:00.933820 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252fce2e-482f-471f-95c2-58f8cc52cc7d admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:00.934549 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252fce2e-482f-471f-95c2-58f8cc52cc7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:00.936301 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252fce2e-482f-471f-95c2-58f8cc52cc7d admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:00.944325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-ebebed98-49c8-4f55-aa16-caee0a7c9038 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5eaf2a66bac4410dab960144def89dfb', 'request_id': 'req-ebebed98-49c8-4f55-aa16-caee0a7c9038'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:00.947642 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1296/2588] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:38:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:38:00.950892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fce2e-482f-471f-95c2-58f8cc52cc7d admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:00.953375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-ebebed98-49c8-4f55-aa16-caee0a7c9038 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5eaf2a66bac4410dab960144def89dfb', 'request_id': 'req-ebebed98-49c8-4f55-aa16-caee0a7c9038'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:00.959588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-ebebed98-49c8-4f55-aa16-caee0a7c9038 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5eaf2a66bac4410dab960144def89dfb', 'request_id': 'req-ebebed98-49c8-4f55-aa16-caee0a7c9038'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:00.960625 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252fce2e-482f-471f-95c2-58f8cc52cc7d admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:00.971749 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:00.973233 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-ebebed98-49c8-4f55-aa16-caee0a7c9038 admin admin] The token cache is being invalidate because project 5eaf2a66bac4410dab960144def89dfb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:38:00.973528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-ebebed98-49c8-4f55-aa16-caee0a7c9038 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:00.974167 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-ebebed98-49c8-4f55-aa16-caee0a7c9038 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:00.975849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1293/2589] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:38:00 2022] DELETE /identity/v3/projects/5eaf2a66bac4410dab960144def89dfb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:00.979825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebed98-49c8-4f55-aa16-caee0a7c9038 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:00.981163 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-ebebed98-49c8-4f55-aa16-caee0a7c9038 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:01.021909 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668f3c8-8a58-40c8-9bb9-d537a627904f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:01.022793 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668f3c8-8a58-40c8-9bb9-d537a627904f admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:01.023076 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668f3c8-8a58-40c8-9bb9-d537a627904f admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:01.023352 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668f3c8-8a58-40c8-9bb9-d537a627904f admin admin] PATH_INFO: `/v3/projects/592193a31e85403692ecf745a67c8e00/users/26bf829b2a7e4a96b3218bd925a42adc/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:01.038077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668f3c8-8a58-40c8-9bb9-d537a627904f admin admin] RBAC: Authorizing `identity:create_grant(project_id=592193a31e85403692ecf745a67c8e00, user_id=26bf829b2a7e4a96b3218bd925a42adc, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:01.040833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668f3c8-8a58-40c8-9bb9-d537a627904f admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:01.046048 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebebed98-49c8-4f55-aa16-caee0a7c9038 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:01.052302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58e6fa-5ccb-4fb7-bf2e-d287b82015ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:01.053194 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58e6fa-5ccb-4fb7-bf2e-d287b82015ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:01.053476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58e6fa-5ccb-4fb7-bf2e-d287b82015ab admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:01.053816 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a58e6fa-5ccb-4fb7-bf2e-d287b82015ab admin admin] PATH_INFO: `/v3/users/cd59dcfb24b04ec78622a23f45b1b93d` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:01.055049 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58e6fa-5ccb-4fb7-bf2e-d287b82015ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd59dcfb24b04ec78622a23f45b1b93d)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:01.057015 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a58e6fa-5ccb-4fb7-bf2e-d287b82015ab admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:01.058246 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1297/2590] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:38:00 2022] PUT /identity/v3/projects/592193a31e85403692ecf745a67c8e00/users/26bf829b2a7e4a96b3218bd925a42adc/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:38:01.061986 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668f3c8-8a58-40c8-9bb9-d537a627904f admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:01.064160 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-3668f3c8-8a58-40c8-9bb9-d537a627904f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:01.106094 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2a58e6fa-5ccb-4fb7-bf2e-d287b82015ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd59dcfb24b04ec78622a23f45b1b93d'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:01.114666 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2a58e6fa-5ccb-4fb7-bf2e-d287b82015ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd59dcfb24b04ec78622a23f45b1b93d'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:01.115406 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2a58e6fa-5ccb-4fb7-bf2e-d287b82015ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd59dcfb24b04ec78622a23f45b1b93d'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:01.116058 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2a58e6fa-5ccb-4fb7-bf2e-d287b82015ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd59dcfb24b04ec78622a23f45b1b93d'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:01.128279 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2a58e6fa-5ccb-4fb7-bf2e-d287b82015ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd59dcfb24b04ec78622a23f45b1b93d'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:01.133064 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668f3c8-8a58-40c8-9bb9-d537a627904f admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:01.138117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b1fd2-c99d-470d-9f6f-d829c06fdfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:01.138782 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b1fd2-c99d-470d-9f6f-d829c06fdfd5 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:01.139063 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b1fd2-c99d-470d-9f6f-d829c06fdfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:01.139336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b1fd2-c99d-470d-9f6f-d829c06fdfd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:01.140122 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b1fd2-c99d-470d-9f6f-d829c06fdfd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:01.140958 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1294/2591] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:38:00 2022] DELETE /identity/v3/users/cd59dcfb24b04ec78622a23f45b1b93d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:38:01.142028 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83b1fd2-c99d-470d-9f6f-d829c06fdfd5 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:01.155910 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1298/2592] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:38:01.160526 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58e6fa-5ccb-4fb7-bf2e-d287b82015ab admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:01.161993 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-2a58e6fa-5ccb-4fb7-bf2e-d287b82015ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:01.203273 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:01.232589 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a58e6fa-5ccb-4fb7-bf2e-d287b82015ab admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:01.237529 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2091b74-356b-46b6-ae87-2064dbe47141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:01.238482 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2091b74-356b-46b6-ae87-2064dbe47141 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:01.238768 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2091b74-356b-46b6-ae87-2064dbe47141 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:01.239259 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2091b74-356b-46b6-ae87-2064dbe47141 admin admin] PATH_INFO: `/v3/projects/592193a31e85403692ecf745a67c8e00/users/26bf829b2a7e4a96b3218bd925a42adc/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:01.241323 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2091b74-356b-46b6-ae87-2064dbe47141 admin admin] RBAC: Authorizing `identity:create_grant(project_id=592193a31e85403692ecf745a67c8e00, user_id=26bf829b2a7e4a96b3218bd925a42adc, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:01.244097 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2091b74-356b-46b6-ae87-2064dbe47141 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:01.264111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1295/2593] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:38:01 2022] PUT /identity/v3/projects/592193a31e85403692ecf745a67c8e00/users/26bf829b2a7e4a96b3218bd925a42adc/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:38:01.266269 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca5b48-7bff-4da7-886d-843ca9ac696e None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:01.267122 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca5b48-7bff-4da7-886d-843ca9ac696e None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:01.267413 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca5b48-7bff-4da7-886d-843ca9ac696e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:01.297707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-52ca5b48-7bff-4da7-886d-843ca9ac696e None None] MFA Rules not processed for user `26bf829b2a7e4a96b3218bd925a42adc`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:01.299052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-52ca5b48-7bff-4da7-886d-843ca9ac696e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:01.369958 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1299/2594] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:01.381248 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2091b74-356b-46b6-ae87-2064dbe47141 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:01.383021 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-d2091b74-356b-46b6-ae87-2064dbe47141 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:01.417082 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca5b48-7bff-4da7-886d-843ca9ac696e None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:01.418566 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-52ca5b48-7bff-4da7-886d-843ca9ac696e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:01.449182 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:01.450999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2091b74-356b-46b6-ae87-2064dbe47141 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:01.456138 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84422d70-2287-49ec-8439-eff9748f51ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:01.456866 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84422d70-2287-49ec-8439-eff9748f51ed service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:01.457174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84422d70-2287-49ec-8439-eff9748f51ed service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:01.457438 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84422d70-2287-49ec-8439-eff9748f51ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:01.467696 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84422d70-2287-49ec-8439-eff9748f51ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:01.469201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84422d70-2287-49ec-8439-eff9748f51ed service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:01.480436 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1296/2595] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:38:01.498131 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca5b48-7bff-4da7-886d-843ca9ac696e None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:01.503295 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d61fa3-0168-4b2d-ac5d-f80834f2d1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:01.503926 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d61fa3-0168-4b2d-ac5d-f80834f2d1cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:01.504284 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d61fa3-0168-4b2d-ac5d-f80834f2d1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:01.504633 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d61fa3-0168-4b2d-ac5d-f80834f2d1cf admin admin] PATH_INFO: `/v3/projects/20c523f3419f4c22bb5aefbdbf15834f` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:01.505948 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d61fa3-0168-4b2d-ac5d-f80834f2d1cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=20c523f3419f4c22bb5aefbdbf15834f)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:01.508126 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d61fa3-0168-4b2d-ac5d-f80834f2d1cf admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:01.557365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-e9d61fa3-0168-4b2d-ac5d-f80834f2d1cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20c523f3419f4c22bb5aefbdbf15834f', 'request_id': 'req-e9d61fa3-0168-4b2d-ac5d-f80834f2d1cf'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:01.563843 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-e9d61fa3-0168-4b2d-ac5d-f80834f2d1cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20c523f3419f4c22bb5aefbdbf15834f', 'request_id': 'req-e9d61fa3-0168-4b2d-ac5d-f80834f2d1cf'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:01.570083 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-e9d61fa3-0168-4b2d-ac5d-f80834f2d1cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20c523f3419f4c22bb5aefbdbf15834f', 'request_id': 'req-e9d61fa3-0168-4b2d-ac5d-f80834f2d1cf'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:01.578515 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84422d70-2287-49ec-8439-eff9748f51ed service cinder] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:01.583566 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-e9d61fa3-0168-4b2d-ac5d-f80834f2d1cf admin admin] The token cache is being invalidate because project 20c523f3419f4c22bb5aefbdbf15834f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:38:01.583908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-e9d61fa3-0168-4b2d-ac5d-f80834f2d1cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:01.585286 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-e9d61fa3-0168-4b2d-ac5d-f80834f2d1cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:01.586896 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1300/2596] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:38:01 2022] DELETE /identity/v3/projects/20c523f3419f4c22bb5aefbdbf15834f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:01.588016 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84422d70-2287-49ec-8439-eff9748f51ed service cinder] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:01.591463 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d238a2-5f5c-4f5a-9773-f3964b379450 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:01.591795 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d238a2-5f5c-4f5a-9773-f3964b379450 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:01.592083 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d238a2-5f5c-4f5a-9773-f3964b379450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:01.611527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-36d238a2-5f5c-4f5a-9773-f3964b379450 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:01.612773 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-36d238a2-5f5c-4f5a-9773-f3964b379450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:01.639828 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f962de5-8172-4c61-b56c-d78f3c8e9fbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:01.640479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f962de5-8172-4c61-b56c-d78f3c8e9fbd service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:01.640785 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f962de5-8172-4c61-b56c-d78f3c8e9fbd service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:01.641342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f962de5-8172-4c61-b56c-d78f3c8e9fbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:01.643821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-5f962de5-8172-4c61-b56c-d78f3c8e9fbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:01.674796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1301/2597] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:01.682540 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdccb3-edbd-484e-8cc2-7488ef490dbb None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:01.682892 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdccb3-edbd-484e-8cc2-7488ef490dbb None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:01.683247 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cdccb3-edbd-484e-8cc2-7488ef490dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:01.702711 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-72cdccb3-edbd-484e-8cc2-7488ef490dbb None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:01.704007 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-72cdccb3-edbd-484e-8cc2-7488ef490dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:01.705078 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f962de5-8172-4c61-b56c-d78f3c8e9fbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:01.706602 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f962de5-8172-4c61-b56c-d78f3c8e9fbd service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:01.712715 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1302/2598] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:38:01.715503 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1297/2599] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:38:01.718064 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdccb3-edbd-484e-8cc2-7488ef490dbb None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:01.727193 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cdccb3-edbd-484e-8cc2-7488ef490dbb None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:01.731972 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545957d-9a49-49b5-acc0-1d8867bc350f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:01.732624 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545957d-9a49-49b5-acc0-1d8867bc350f admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:01.732911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545957d-9a49-49b5-acc0-1d8867bc350f admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:01.733190 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6545957d-9a49-49b5-acc0-1d8867bc350f admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:01.733918 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545957d-9a49-49b5-acc0-1d8867bc350f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:38:01.734230 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545957d-9a49-49b5-acc0-1d8867bc350f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:01.735886 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6545957d-9a49-49b5-acc0-1d8867bc350f admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:01.747500 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1303/2600] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:38:01.752259 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f962de5-8172-4c61-b56c-d78f3c8e9fbd service cinder] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:01.763349 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f962de5-8172-4c61-b56c-d78f3c8e9fbd service cinder] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:01.768903 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44453cd1-df5f-4817-a4d9-61d79c31d84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:01.769569 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44453cd1-df5f-4817-a4d9-61d79c31d84e admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:01.769861 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44453cd1-df5f-4817-a4d9-61d79c31d84e admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:01.770145 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44453cd1-df5f-4817-a4d9-61d79c31d84e admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:01.770887 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44453cd1-df5f-4817-a4d9-61d79c31d84e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:01.772863 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44453cd1-df5f-4817-a4d9-61d79c31d84e admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:01.802604 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1298/2601] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:38:01 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:38:01.806659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545957d-9a49-49b5-acc0-1d8867bc350f admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:01.817322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6545957d-9a49-49b5-acc0-1d8867bc350f admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:01.844644 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:01.878917 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e88ba-e93f-4a0c-bf54-faef3d738b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:01.879639 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e88ba-e93f-4a0c-bf54-faef3d738b87 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:01.879943 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e88ba-e93f-4a0c-bf54-faef3d738b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:01.880227 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e88ba-e93f-4a0c-bf54-faef3d738b87 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:01.880936 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e88ba-e93f-4a0c-bf54-faef3d738b87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:01.882947 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e88ba-e93f-4a0c-bf54-faef3d738b87 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:01.906419 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1304/2602] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:38:01 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:38:01.906911 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44453cd1-df5f-4817-a4d9-61d79c31d84e admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:01.913780 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:01.918015 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44453cd1-df5f-4817-a4d9-61d79c31d84e admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:01.925530 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39809efe-85ef-4d86-a3b1-44c9dfd0b254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:01.927132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39809efe-85ef-4d86-a3b1-44c9dfd0b254 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:01.927425 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39809efe-85ef-4d86-a3b1-44c9dfd0b254 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:01.927802 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39809efe-85ef-4d86-a3b1-44c9dfd0b254 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:01.928681 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39809efe-85ef-4d86-a3b1-44c9dfd0b254 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:01.930517 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39809efe-85ef-4d86-a3b1-44c9dfd0b254 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:01.943644 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1299/2603] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:38:01.947972 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e88ba-e93f-4a0c-bf54-faef3d738b87 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:01.959399 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e88ba-e93f-4a0c-bf54-faef3d738b87 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:01.968231 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7344eb6-7299-4797-9985-8889868a9f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:01.968919 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7344eb6-7299-4797-9985-8889868a9f9d admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:01.969212 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7344eb6-7299-4797-9985-8889868a9f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:01.969525 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7344eb6-7299-4797-9985-8889868a9f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:01.970332 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7344eb6-7299-4797-9985-8889868a9f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:01.972010 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7344eb6-7299-4797-9985-8889868a9f9d admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:01.986741 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1305/2604] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:38:01.988270 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39809efe-85ef-4d86-a3b1-44c9dfd0b254 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:01.999191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39809efe-85ef-4d86-a3b1-44c9dfd0b254 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:02.004820 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55508221-b769-44d5-a1fb-47dad5167fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:02.005904 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55508221-b769-44d5-a1fb-47dad5167fdf admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:02.006286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55508221-b769-44d5-a1fb-47dad5167fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:02.006685 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55508221-b769-44d5-a1fb-47dad5167fdf admin admin] PATH_INFO: `/v3/projects/d41f1d9c222744ef91ea63cd7d3ba33e/users/ddd0f1160b4446c2baa3e3ec0080b490/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:02.026422 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55508221-b769-44d5-a1fb-47dad5167fdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d41f1d9c222744ef91ea63cd7d3ba33e, user_id=ddd0f1160b4446c2baa3e3ec0080b490, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:02.029502 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55508221-b769-44d5-a1fb-47dad5167fdf admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:02.042772 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1300/2605] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:38:01 2022] PUT /identity/v3/projects/d41f1d9c222744ef91ea63cd7d3ba33e/users/ddd0f1160b4446c2baa3e3ec0080b490/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:02.053935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77328595-64b0-47ee-bd25-e2e8d5545f4f None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:02.054252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77328595-64b0-47ee-bd25-e2e8d5545f4f None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:02.054522 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77328595-64b0-47ee-bd25-e2e8d5545f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:02.082927 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-77328595-64b0-47ee-bd25-e2e8d5545f4f None None] MFA Rules not processed for user `ddd0f1160b4446c2baa3e3ec0080b490`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:02.084166 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-77328595-64b0-47ee-bd25-e2e8d5545f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:02.147177 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1306/2606] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:02.151627 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55508221-b769-44d5-a1fb-47dad5167fdf admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:02.212942 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55508221-b769-44d5-a1fb-47dad5167fdf admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:02.218052 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10375d6e-a7e5-425b-8df4-fb28b93df5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:02.218699 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10375d6e-a7e5-425b-8df4-fb28b93df5ae admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:02.218983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10375d6e-a7e5-425b-8df4-fb28b93df5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:02.219260 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10375d6e-a7e5-425b-8df4-fb28b93df5ae admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:02.220547 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10375d6e-a7e5-425b-8df4-fb28b93df5ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:02.222447 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10375d6e-a7e5-425b-8df4-fb28b93df5ae admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:02.246070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1301/2607] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:38:02 2022] POST /identity/v3/projects => generated 373 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:38:02.249981 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77328595-64b0-47ee-bd25-e2e8d5545f4f None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:02.260327 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77328595-64b0-47ee-bd25-e2e8d5545f4f None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:02.316848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e39acf-79b6-4308-95ee-98be1e06d622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:02.317511 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e39acf-79b6-4308-95ee-98be1e06d622 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:02.317798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e39acf-79b6-4308-95ee-98be1e06d622 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:02.318077 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e39acf-79b6-4308-95ee-98be1e06d622 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:02.318776 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e39acf-79b6-4308-95ee-98be1e06d622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:02.320735 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e39acf-79b6-4308-95ee-98be1e06d622 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:02.341308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1307/2608] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:38:02 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:38:02.345085 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10375d6e-a7e5-425b-8df4-fb28b93df5ae admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:02.355100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10375d6e-a7e5-425b-8df4-fb28b93df5ae admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:02.359653 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e130206-8f78-4290-859f-7ef4708d8970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:02.360357 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e130206-8f78-4290-859f-7ef4708d8970 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:02.360643 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e130206-8f78-4290-859f-7ef4708d8970 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:02.360916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e130206-8f78-4290-859f-7ef4708d8970 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:02.361628 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e130206-8f78-4290-859f-7ef4708d8970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:02.363233 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e130206-8f78-4290-859f-7ef4708d8970 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:02.376565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1302/2609] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:38:02.381124 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e39acf-79b6-4308-95ee-98be1e06d622 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:02.391448 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e39acf-79b6-4308-95ee-98be1e06d622 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:02.396588 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56bd0c-282e-49d0-bd29-febf8917958a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:02.397445 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56bd0c-282e-49d0-bd29-febf8917958a admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:02.397758 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56bd0c-282e-49d0-bd29-febf8917958a admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:02.398030 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56bd0c-282e-49d0-bd29-febf8917958a admin admin] PATH_INFO: `/v3/projects/6ae4ad77e40544b6bb530721ba175c54/users/4a08f32e63b241e5b065c813e3d961bb/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:02.412312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56bd0c-282e-49d0-bd29-febf8917958a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae4ad77e40544b6bb530721ba175c54, user_id=4a08f32e63b241e5b065c813e3d961bb, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:02.414962 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56bd0c-282e-49d0-bd29-febf8917958a admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:02.427353 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1308/2610] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:38:02 2022] PUT /identity/v3/projects/6ae4ad77e40544b6bb530721ba175c54/users/4a08f32e63b241e5b065c813e3d961bb/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:02.431211 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e130206-8f78-4290-859f-7ef4708d8970 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:02.441482 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e130206-8f78-4290-859f-7ef4708d8970 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:02.496290 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b34f22-01cb-4c1d-8e34-0130f5fca9bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:02.496894 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b34f22-01cb-4c1d-8e34-0130f5fca9bc admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:02.497159 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b34f22-01cb-4c1d-8e34-0130f5fca9bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:02.497441 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b34f22-01cb-4c1d-8e34-0130f5fca9bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:02.498160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b34f22-01cb-4c1d-8e34-0130f5fca9bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:02.499768 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b34f22-01cb-4c1d-8e34-0130f5fca9bc admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:02.509711 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1303/2611] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:38:02.513792 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56bd0c-282e-49d0-bd29-febf8917958a admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:02.520107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:02.526199 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56bd0c-282e-49d0-bd29-febf8917958a admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:02.531146 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1aaed7-a45a-46e9-aeb1-14c4edbe4cdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:02.532061 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1aaed7-a45a-46e9-aeb1-14c4edbe4cdc admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:02.532344 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1aaed7-a45a-46e9-aeb1-14c4edbe4cdc admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:02.532619 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1aaed7-a45a-46e9-aeb1-14c4edbe4cdc admin admin] PATH_INFO: `/v3/projects/6ae4ad77e40544b6bb530721ba175c54/users/4a08f32e63b241e5b065c813e3d961bb/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:02.534618 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1aaed7-a45a-46e9-aeb1-14c4edbe4cdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae4ad77e40544b6bb530721ba175c54, user_id=4a08f32e63b241e5b065c813e3d961bb, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:02.537303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1aaed7-a45a-46e9-aeb1-14c4edbe4cdc admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:02.547546 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1309/2612] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:38:02 2022] PUT /identity/v3/projects/6ae4ad77e40544b6bb530721ba175c54/users/4a08f32e63b241e5b065c813e3d961bb/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:02.557503 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837d7bd-4bb9-48c6-8588-299fc4999790 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:02.557797 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837d7bd-4bb9-48c6-8588-299fc4999790 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:02.558080 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837d7bd-4bb9-48c6-8588-299fc4999790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:02.584816 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-d837d7bd-4bb9-48c6-8588-299fc4999790 None None] MFA Rules not processed for user `4a08f32e63b241e5b065c813e3d961bb`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:02.585997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-d837d7bd-4bb9-48c6-8588-299fc4999790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:02.613179 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:02.653040 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1304/2613] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:02 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:02.664041 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1aaed7-a45a-46e9-aeb1-14c4edbe4cdc admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:02.665955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-ef1aaed7-a45a-46e9-aeb1-14c4edbe4cdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:02.724049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1aaed7-a45a-46e9-aeb1-14c4edbe4cdc admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:02.727781 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7de828-44cb-4229-8b87-366917d79707 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:02.728428 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7de828-44cb-4229-8b87-366917d79707 service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:02.728717 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7de828-44cb-4229-8b87-366917d79707 service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:02.728999 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7de828-44cb-4229-8b87-366917d79707 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:02.785061 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7de828-44cb-4229-8b87-366917d79707 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:02.786437 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7de828-44cb-4229-8b87-366917d79707 service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:02.795762 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1310/2614] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:38:04.287204 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837d7bd-4bb9-48c6-8588-299fc4999790 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:04.288648 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-d837d7bd-4bb9-48c6-8588-299fc4999790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:04.351279 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837d7bd-4bb9-48c6-8588-299fc4999790 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:04.355776 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aafe08-71a0-4ca2-ac2f-3de2870c27d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:04.356636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aafe08-71a0-4ca2-ac2f-3de2870c27d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:04.356920 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aafe08-71a0-4ca2-ac2f-3de2870c27d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:04.357199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aafe08-71a0-4ca2-ac2f-3de2870c27d2 admin admin] PATH_INFO: `/v3/users/af521435cc8545b3adbe195da2d44979` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:04.358383 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aafe08-71a0-4ca2-ac2f-3de2870c27d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af521435cc8545b3adbe195da2d44979)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:04.360376 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aafe08-71a0-4ca2-ac2f-3de2870c27d2 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:04.404921 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c7aafe08-71a0-4ca2-ac2f-3de2870c27d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af521435cc8545b3adbe195da2d44979'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:04.412551 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c7aafe08-71a0-4ca2-ac2f-3de2870c27d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af521435cc8545b3adbe195da2d44979'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:04.413178 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c7aafe08-71a0-4ca2-ac2f-3de2870c27d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af521435cc8545b3adbe195da2d44979'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:04.413788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c7aafe08-71a0-4ca2-ac2f-3de2870c27d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af521435cc8545b3adbe195da2d44979'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:04.426027 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c7aafe08-71a0-4ca2-ac2f-3de2870c27d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af521435cc8545b3adbe195da2d44979'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:04.438492 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1305/2615] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:38:04 2022] DELETE /identity/v3/users/af521435cc8545b3adbe195da2d44979 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:04.443104 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9be9b8-9e4f-485d-8b54-8a98e77be304 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:04.443588 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9be9b8-9e4f-485d-8b54-8a98e77be304 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:04.443733 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9be9b8-9e4f-485d-8b54-8a98e77be304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:04.460949 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-6e9be9b8-9e4f-485d-8b54-8a98e77be304 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:04.462146 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-6e9be9b8-9e4f-485d-8b54-8a98e77be304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:04.525035 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1311/2616] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:04.535850 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aafe08-71a0-4ca2-ac2f-3de2870c27d2 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:04.537299 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-c7aafe08-71a0-4ca2-ac2f-3de2870c27d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:04.583569 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:04.594952 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aafe08-71a0-4ca2-ac2f-3de2870c27d2 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:04.598776 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975536f6-c537-4ef4-ad5b-57d181170b95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:04.599460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975536f6-c537-4ef4-ad5b-57d181170b95 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:04.599817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975536f6-c537-4ef4-ad5b-57d181170b95 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:04.600099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975536f6-c537-4ef4-ad5b-57d181170b95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:04.609286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975536f6-c537-4ef4-ad5b-57d181170b95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:04.610674 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975536f6-c537-4ef4-ad5b-57d181170b95 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:04.620151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1306/2617] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:38:04.881845 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9be9b8-9e4f-485d-8b54-8a98e77be304 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:04.883373 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-6e9be9b8-9e4f-485d-8b54-8a98e77be304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:04.896360 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9be9b8-9e4f-485d-8b54-8a98e77be304 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:04.901350 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009552e4-0ebe-41e6-b7de-04caf7f4d9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:04.903020 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009552e4-0ebe-41e6-b7de-04caf7f4d9e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:04.903316 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009552e4-0ebe-41e6-b7de-04caf7f4d9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:04.903598 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009552e4-0ebe-41e6-b7de-04caf7f4d9e4 admin admin] PATH_INFO: `/v3/projects/c4be2cb366374f6b8448a4147d630a35` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:04.904861 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009552e4-0ebe-41e6-b7de-04caf7f4d9e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4be2cb366374f6b8448a4147d630a35)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:04.906830 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009552e4-0ebe-41e6-b7de-04caf7f4d9e4 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:04.946722 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:04.955898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-009552e4-0ebe-41e6-b7de-04caf7f4d9e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4be2cb366374f6b8448a4147d630a35', 'request_id': 'req-009552e4-0ebe-41e6-b7de-04caf7f4d9e4'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:04.961558 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-009552e4-0ebe-41e6-b7de-04caf7f4d9e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4be2cb366374f6b8448a4147d630a35', 'request_id': 'req-009552e4-0ebe-41e6-b7de-04caf7f4d9e4'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:04.967781 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-009552e4-0ebe-41e6-b7de-04caf7f4d9e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4be2cb366374f6b8448a4147d630a35', 'request_id': 'req-009552e4-0ebe-41e6-b7de-04caf7f4d9e4'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:04.980281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-009552e4-0ebe-41e6-b7de-04caf7f4d9e4 admin admin] The token cache is being invalidate because project c4be2cb366374f6b8448a4147d630a35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:38:04.980601 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-009552e4-0ebe-41e6-b7de-04caf7f4d9e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:04.981218 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-009552e4-0ebe-41e6-b7de-04caf7f4d9e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:04.982745 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1312/2618] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:38:04 2022] DELETE /identity/v3/projects/c4be2cb366374f6b8448a4147d630a35 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:04.987189 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975536f6-c537-4ef4-ad5b-57d181170b95 service neutron] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:04.996673 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975536f6-c537-4ef4-ad5b-57d181170b95 service neutron] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:05.053116 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84f0d1-bad2-4218-96bf-2d1039bae695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:05.053983 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84f0d1-bad2-4218-96bf-2d1039bae695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:05.054273 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84f0d1-bad2-4218-96bf-2d1039bae695 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:05.054556 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f84f0d1-bad2-4218-96bf-2d1039bae695 admin admin] PATH_INFO: `/v3/users/26bf829b2a7e4a96b3218bd925a42adc` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:05.055786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84f0d1-bad2-4218-96bf-2d1039bae695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26bf829b2a7e4a96b3218bd925a42adc)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:05.057724 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f84f0d1-bad2-4218-96bf-2d1039bae695 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:05.102666 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-6f84f0d1-bad2-4218-96bf-2d1039bae695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26bf829b2a7e4a96b3218bd925a42adc'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:05.109636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-6f84f0d1-bad2-4218-96bf-2d1039bae695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26bf829b2a7e4a96b3218bd925a42adc'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:05.110557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-6f84f0d1-bad2-4218-96bf-2d1039bae695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26bf829b2a7e4a96b3218bd925a42adc'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:05.111178 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-6f84f0d1-bad2-4218-96bf-2d1039bae695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26bf829b2a7e4a96b3218bd925a42adc'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:05.123287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-6f84f0d1-bad2-4218-96bf-2d1039bae695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26bf829b2a7e4a96b3218bd925a42adc'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:05.135765 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1307/2619] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:38:04 2022] DELETE /identity/v3/users/26bf829b2a7e4a96b3218bd925a42adc => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:05.307515 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009552e4-0ebe-41e6-b7de-04caf7f4d9e4 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:05.309170 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-009552e4-0ebe-41e6-b7de-04caf7f4d9e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:05.322524 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009552e4-0ebe-41e6-b7de-04caf7f4d9e4 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:05.390341 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0aaf7b0-09c3-4dd0-b6bc-3bbc4dcf2bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:05.392121 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aaf7b0-09c3-4dd0-b6bc-3bbc4dcf2bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:05.392485 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aaf7b0-09c3-4dd0-b6bc-3bbc4dcf2bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:05.392837 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0aaf7b0-09c3-4dd0-b6bc-3bbc4dcf2bc0 admin admin] PATH_INFO: `/v3/users/ddd0f1160b4446c2baa3e3ec0080b490` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:05.394248 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aaf7b0-09c3-4dd0-b6bc-3bbc4dcf2bc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddd0f1160b4446c2baa3e3ec0080b490)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:05.396342 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0aaf7b0-09c3-4dd0-b6bc-3bbc4dcf2bc0 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:05.419717 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84f0d1-bad2-4218-96bf-2d1039bae695 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:05.421520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-6f84f0d1-bad2-4218-96bf-2d1039bae695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:05.440070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f84f0d1-bad2-4218-96bf-2d1039bae695 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:05.445859 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd7fed-10bd-486b-9ce9-3e4f2c697901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:05.446773 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd7fed-10bd-486b-9ce9-3e4f2c697901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:05.447068 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd7fed-10bd-486b-9ce9-3e4f2c697901 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:05.447338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd7fed-10bd-486b-9ce9-3e4f2c697901 admin admin] PATH_INFO: `/v3/projects/592193a31e85403692ecf745a67c8e00` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:05.448610 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd7fed-10bd-486b-9ce9-3e4f2c697901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=592193a31e85403692ecf745a67c8e00)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:05.450749 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd7fed-10bd-486b-9ce9-3e4f2c697901 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:05.456969 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-f0aaf7b0-09c3-4dd0-b6bc-3bbc4dcf2bc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddd0f1160b4446c2baa3e3ec0080b490'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:05.466311 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-f0aaf7b0-09c3-4dd0-b6bc-3bbc4dcf2bc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddd0f1160b4446c2baa3e3ec0080b490'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:05.467220 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-f0aaf7b0-09c3-4dd0-b6bc-3bbc4dcf2bc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddd0f1160b4446c2baa3e3ec0080b490'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:05.482415 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-f0aaf7b0-09c3-4dd0-b6bc-3bbc4dcf2bc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddd0f1160b4446c2baa3e3ec0080b490'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:05.483270 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-f0aaf7b0-09c3-4dd0-b6bc-3bbc4dcf2bc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddd0f1160b4446c2baa3e3ec0080b490'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:05.496404 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1313/2620] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:38:05 2022] DELETE /identity/v3/users/ddd0f1160b4446c2baa3e3ec0080b490 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:05.501421 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3f9ae-16cd-4b32-853e-668a309d78e7 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:05.501824 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3f9ae-16cd-4b32-853e-668a309d78e7 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:05.502174 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed3f9ae-16cd-4b32-853e-668a309d78e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:05.512781 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2edd7fed-10bd-486b-9ce9-3e4f2c697901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '592193a31e85403692ecf745a67c8e00', 'request_id': 'req-2edd7fed-10bd-486b-9ce9-3e4f2c697901'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:05.519249 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2edd7fed-10bd-486b-9ce9-3e4f2c697901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '592193a31e85403692ecf745a67c8e00', 'request_id': 'req-2edd7fed-10bd-486b-9ce9-3e4f2c697901'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:05.521213 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:05.521992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-aed3f9ae-16cd-4b32-853e-668a309d78e7 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:05.523009 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-aed3f9ae-16cd-4b32-853e-668a309d78e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:05.526316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2edd7fed-10bd-486b-9ce9-3e4f2c697901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '592193a31e85403692ecf745a67c8e00', 'request_id': 'req-2edd7fed-10bd-486b-9ce9-3e4f2c697901'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:05.541237 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2edd7fed-10bd-486b-9ce9-3e4f2c697901 admin admin] The token cache is being invalidate because project 592193a31e85403692ecf745a67c8e00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:38:05.541529 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2edd7fed-10bd-486b-9ce9-3e4f2c697901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:05.542146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-2edd7fed-10bd-486b-9ce9-3e4f2c697901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:05.543727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1308/2621] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:38:05 2022] DELETE /identity/v3/projects/592193a31e85403692ecf745a67c8e00 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:05.548566 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540af1e7-f491-467c-b4db-aef571a6568d None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:05.549279 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540af1e7-f491-467c-b4db-aef571a6568d None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:05.549569 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540af1e7-f491-467c-b4db-aef571a6568d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:05.566784 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:05.568817 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-540af1e7-f491-467c-b4db-aef571a6568d None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:05.570320 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-540af1e7-f491-467c-b4db-aef571a6568d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:05.587501 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1314/2622] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:38:05.597046 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3f9ae-16cd-4b32-853e-668a309d78e7 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:05.598412 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-aed3f9ae-16cd-4b32-853e-668a309d78e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:05.631231 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1309/2623] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:38:05.638923 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e423004-c0b7-436c-8d42-04dfcb49c77b None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:05.639217 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e423004-c0b7-436c-8d42-04dfcb49c77b None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:05.639500 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e423004-c0b7-436c-8d42-04dfcb49c77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:05.657286 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed3f9ae-16cd-4b32-853e-668a309d78e7 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:05.659178 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-5e423004-c0b7-436c-8d42-04dfcb49c77b None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:05.660437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-5e423004-c0b7-436c-8d42-04dfcb49c77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:05.660901 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f23427-b8dc-492e-a3cd-48bbcd4d509a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:05.661555 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f23427-b8dc-492e-a3cd-48bbcd4d509a service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:05.661846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f23427-b8dc-492e-a3cd-48bbcd4d509a service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:05.662132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f23427-b8dc-492e-a3cd-48bbcd4d509a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:05.668390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1310/2624] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:38:05.671798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f23427-b8dc-492e-a3cd-48bbcd4d509a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:05.672330 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e423004-c0b7-436c-8d42-04dfcb49c77b None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:05.673268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f23427-b8dc-492e-a3cd-48bbcd4d509a service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:05.680926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e423004-c0b7-436c-8d42-04dfcb49c77b None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:05.682802 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1315/2625] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:38:05.685698 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295bce6-b837-477c-ae82-958a31f29bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:05.686341 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295bce6-b837-477c-ae82-958a31f29bf1 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:05.686623 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295bce6-b837-477c-ae82-958a31f29bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:05.686899 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2295bce6-b837-477c-ae82-958a31f29bf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:05.687625 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295bce6-b837-477c-ae82-958a31f29bf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:38:05.687951 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295bce6-b837-477c-ae82-958a31f29bf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:05.690100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2295bce6-b837-477c-ae82-958a31f29bf1 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:05.706201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1311/2626] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:38:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:38:05.708093 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f23427-b8dc-492e-a3cd-48bbcd4d509a service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:05.717799 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f23427-b8dc-492e-a3cd-48bbcd4d509a service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:05.722480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518839d2-d8e4-47e2-89c9-ae92e501a3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:05.723363 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518839d2-d8e4-47e2-89c9-ae92e501a3c4 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:05.723487 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518839d2-d8e4-47e2-89c9-ae92e501a3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:05.723712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518839d2-d8e4-47e2-89c9-ae92e501a3c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:05.724446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518839d2-d8e4-47e2-89c9-ae92e501a3c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:05.726419 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518839d2-d8e4-47e2-89c9-ae92e501a3c4 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:05.755088 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1316/2627] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:38:05 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:38:05.759535 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295bce6-b837-477c-ae82-958a31f29bf1 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:05.770153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2295bce6-b837-477c-ae82-958a31f29bf1 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:05.836368 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a2be8-257d-4016-9c01-41667a61accc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:05.837069 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a2be8-257d-4016-9c01-41667a61accc admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:05.837360 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a2be8-257d-4016-9c01-41667a61accc admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:05.837636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a2be8-257d-4016-9c01-41667a61accc admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:05.838337 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a2be8-257d-4016-9c01-41667a61accc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:05.840382 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0a2be8-257d-4016-9c01-41667a61accc admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:05.864801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1312/2628] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:38:05 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:38:05.865985 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518839d2-d8e4-47e2-89c9-ae92e501a3c4 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:05.876982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518839d2-d8e4-47e2-89c9-ae92e501a3c4 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:05.881832 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbf253-29d6-43d6-a03e-fbe3d2a19531 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:05.882501 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbf253-29d6-43d6-a03e-fbe3d2a19531 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:05.882978 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbf253-29d6-43d6-a03e-fbe3d2a19531 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:05.883379 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbbf253-29d6-43d6-a03e-fbe3d2a19531 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:05.884144 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbf253-29d6-43d6-a03e-fbe3d2a19531 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:05.885938 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbbf253-29d6-43d6-a03e-fbe3d2a19531 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:05.897699 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1317/2629] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:38:05.901737 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a2be8-257d-4016-9c01-41667a61accc admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:05.913840 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a2be8-257d-4016-9c01-41667a61accc admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:05.919031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e0d5e-58be-4f3e-9aba-1a088b7bcc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:05.919736 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e0d5e-58be-4f3e-9aba-1a088b7bcc80 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:05.920027 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e0d5e-58be-4f3e-9aba-1a088b7bcc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:05.920308 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e0d5e-58be-4f3e-9aba-1a088b7bcc80 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:05.921045 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e0d5e-58be-4f3e-9aba-1a088b7bcc80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:05.922922 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e0d5e-58be-4f3e-9aba-1a088b7bcc80 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:05.933732 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1313/2630] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:38:05.938056 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbf253-29d6-43d6-a03e-fbe3d2a19531 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:05.949501 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbbf253-29d6-43d6-a03e-fbe3d2a19531 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:05.954907 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb58d8fb-46e6-4a3c-be53-2258c798c408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:05.955859 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58d8fb-46e6-4a3c-be53-2258c798c408 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:05.956144 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58d8fb-46e6-4a3c-be53-2258c798c408 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:05.956483 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb58d8fb-46e6-4a3c-be53-2258c798c408 admin admin] PATH_INFO: `/v3/projects/f7185ca4ce174508b802092400264f4e/users/32ecc48d090444efb0c4dbe5bfd67316/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:05.964780 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e0d5e-58be-4f3e-9aba-1a088b7bcc80 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:05.968312 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-e17e0d5e-58be-4f3e-9aba-1a088b7bcc80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:05.978590 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58d8fb-46e6-4a3c-be53-2258c798c408 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7185ca4ce174508b802092400264f4e, user_id=32ecc48d090444efb0c4dbe5bfd67316, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:05.981747 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb58d8fb-46e6-4a3c-be53-2258c798c408 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:05.988629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e0d5e-58be-4f3e-9aba-1a088b7bcc80 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:05.995718 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d49c78-ff4a-45ec-b434-5791e5144f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:05.996495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d49c78-ff4a-45ec-b434-5791e5144f26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:05.996789 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d49c78-ff4a-45ec-b434-5791e5144f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:05.997100 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d49c78-ff4a-45ec-b434-5791e5144f26 admin admin] PATH_INFO: `/v3/projects/d41f1d9c222744ef91ea63cd7d3ba33e` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:05.998269 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d49c78-ff4a-45ec-b434-5791e5144f26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d41f1d9c222744ef91ea63cd7d3ba33e)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:05.998380 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1318/2631] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:38:05 2022] PUT /identity/v3/projects/f7185ca4ce174508b802092400264f4e/users/32ecc48d090444efb0c4dbe5bfd67316/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:38:06.000310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d49c78-ff4a-45ec-b434-5791e5144f26 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:06.009497 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50dd59-a1fd-4d6d-a431-db77f8d0d67d None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:06.009792 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50dd59-a1fd-4d6d-a431-db77f8d0d67d None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:06.010078 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af50dd59-a1fd-4d6d-a431-db77f8d0d67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:06.037574 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-af50dd59-a1fd-4d6d-a431-db77f8d0d67d None None] MFA Rules not processed for user `32ecc48d090444efb0c4dbe5bfd67316`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:06.038977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-af50dd59-a1fd-4d6d-a431-db77f8d0d67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:06.047601 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:06.052122 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-b8d49c78-ff4a-45ec-b434-5791e5144f26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd41f1d9c222744ef91ea63cd7d3ba33e', 'request_id': 'req-b8d49c78-ff4a-45ec-b434-5791e5144f26'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:06.058865 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-b8d49c78-ff4a-45ec-b434-5791e5144f26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd41f1d9c222744ef91ea63cd7d3ba33e', 'request_id': 'req-b8d49c78-ff4a-45ec-b434-5791e5144f26'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:06.066384 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-b8d49c78-ff4a-45ec-b434-5791e5144f26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd41f1d9c222744ef91ea63cd7d3ba33e', 'request_id': 'req-b8d49c78-ff4a-45ec-b434-5791e5144f26'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:06.080509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-b8d49c78-ff4a-45ec-b434-5791e5144f26 admin admin] The token cache is being invalidate because project d41f1d9c222744ef91ea63cd7d3ba33e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:38:06.080802 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-b8d49c78-ff4a-45ec-b434-5791e5144f26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:06.081449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-b8d49c78-ff4a-45ec-b434-5791e5144f26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:06.083215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1314/2632] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:38:05 2022] DELETE /identity/v3/projects/d41f1d9c222744ef91ea63cd7d3ba33e => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:38:06.086929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d49c78-ff4a-45ec-b434-5791e5144f26 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:06.088339 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-b8d49c78-ff4a-45ec-b434-5791e5144f26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:06.104484 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1319/2633] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:38:06.108846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50dd59-a1fd-4d6d-a431-db77f8d0d67d None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:06.110257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-af50dd59-a1fd-4d6d-a431-db77f8d0d67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:06.137307 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:06.154231 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d49c78-ff4a-45ec-b434-5791e5144f26 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:06.158913 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2a137-09e1-4fd7-a8c1-1296c39d58a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:06.159819 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2a137-09e1-4fd7-a8c1-1296c39d58a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:06.160108 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2a137-09e1-4fd7-a8c1-1296c39d58a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:06.160385 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c2a137-09e1-4fd7-a8c1-1296c39d58a9 admin admin] PATH_INFO: `/v3/users/4a08f32e63b241e5b065c813e3d961bb` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:06.161588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2a137-09e1-4fd7-a8c1-1296c39d58a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a08f32e63b241e5b065c813e3d961bb)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:06.163519 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c2a137-09e1-4fd7-a8c1-1296c39d58a9 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:06.177626 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af50dd59-a1fd-4d6d-a431-db77f8d0d67d None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:06.182303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa256341-f984-480f-8d3f-4a490d66e5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:06.182983 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa256341-f984-480f-8d3f-4a490d66e5d8 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:06.183252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa256341-f984-480f-8d3f-4a490d66e5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:06.183537 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa256341-f984-480f-8d3f-4a490d66e5d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:06.184263 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa256341-f984-480f-8d3f-4a490d66e5d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:06.186202 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa256341-f984-480f-8d3f-4a490d66e5d8 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:06.210321 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-83c2a137-09e1-4fd7-a8c1-1296c39d58a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a08f32e63b241e5b065c813e3d961bb'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:06.214640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1320/2634] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:38:06 2022] POST /identity/v3/projects => generated 365 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:38:06.218204 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-83c2a137-09e1-4fd7-a8c1-1296c39d58a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a08f32e63b241e5b065c813e3d961bb'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:06.218404 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa256341-f984-480f-8d3f-4a490d66e5d8 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:06.218900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-83c2a137-09e1-4fd7-a8c1-1296c39d58a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a08f32e63b241e5b065c813e3d961bb'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:06.219556 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-83c2a137-09e1-4fd7-a8c1-1296c39d58a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a08f32e63b241e5b065c813e3d961bb'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:06.220096 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-aa256341-f984-480f-8d3f-4a490d66e5d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:06.232561 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-83c2a137-09e1-4fd7-a8c1-1296c39d58a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a08f32e63b241e5b065c813e3d961bb'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:06.245083 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1315/2635] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:38:06 2022] DELETE /identity/v3/users/4a08f32e63b241e5b065c813e3d961bb => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:06.289632 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa256341-f984-480f-8d3f-4a490d66e5d8 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:06.348488 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4280448-da39-40ba-8e59-ddf38f16ff64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:06.349294 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4280448-da39-40ba-8e59-ddf38f16ff64 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:06.349711 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4280448-da39-40ba-8e59-ddf38f16ff64 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:06.350001 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4280448-da39-40ba-8e59-ddf38f16ff64 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:06.350732 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4280448-da39-40ba-8e59-ddf38f16ff64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:06.352723 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4280448-da39-40ba-8e59-ddf38f16ff64 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:06.377475 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1321/2636] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:38:06 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:38:06.378691 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2a137-09e1-4fd7-a8c1-1296c39d58a9 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:06.388987 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c2a137-09e1-4fd7-a8c1-1296c39d58a9 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:06.394952 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843bb8d-8d65-4ee3-956f-2d76be7331b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:06.395843 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843bb8d-8d65-4ee3-956f-2d76be7331b1 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:06.396113 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843bb8d-8d65-4ee3-956f-2d76be7331b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:06.396412 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843bb8d-8d65-4ee3-956f-2d76be7331b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:06.397132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843bb8d-8d65-4ee3-956f-2d76be7331b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:06.398990 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843bb8d-8d65-4ee3-956f-2d76be7331b1 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:06.410264 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1316/2637] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:38:06.414343 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4280448-da39-40ba-8e59-ddf38f16ff64 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:06.425082 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4280448-da39-40ba-8e59-ddf38f16ff64 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:06.430088 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb741a-2cdf-4e65-a4ed-e50e0360f7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:06.430964 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb741a-2cdf-4e65-a4ed-e50e0360f7c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:06.431249 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb741a-2cdf-4e65-a4ed-e50e0360f7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:06.431524 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb741a-2cdf-4e65-a4ed-e50e0360f7c3 admin admin] PATH_INFO: `/v3/projects/6147f478bbcb4ac491b510fd2014a957/users/a28956fa1a42424da509c8096665fd2a/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:06.446897 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb741a-2cdf-4e65-a4ed-e50e0360f7c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6147f478bbcb4ac491b510fd2014a957, user_id=a28956fa1a42424da509c8096665fd2a, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:06.449682 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb741a-2cdf-4e65-a4ed-e50e0360f7c3 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:06.463326 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1322/2638] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:38:06 2022] PUT /identity/v3/projects/6147f478bbcb4ac491b510fd2014a957/users/a28956fa1a42424da509c8096665fd2a/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:06.467119 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843bb8d-8d65-4ee3-956f-2d76be7331b1 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:06.477890 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843bb8d-8d65-4ee3-956f-2d76be7331b1 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:06.518164 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:06.523092 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb741a-2cdf-4e65-a4ed-e50e0360f7c3 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:06.524982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-56bb741a-2cdf-4e65-a4ed-e50e0360f7c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:06.548879 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae55d30-34b1-4e2d-868e-68b4b246e7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:06.549573 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae55d30-34b1-4e2d-868e-68b4b246e7fe admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:06.549864 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae55d30-34b1-4e2d-868e-68b4b246e7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:06.550242 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae55d30-34b1-4e2d-868e-68b4b246e7fe admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:06.550877 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:06.551074 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae55d30-34b1-4e2d-868e-68b4b246e7fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:06.553438 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae55d30-34b1-4e2d-868e-68b4b246e7fe admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:06.567651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1317/2639] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:38:06.568764 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae55d30-34b1-4e2d-868e-68b4b246e7fe admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:06.579139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae55d30-34b1-4e2d-868e-68b4b246e7fe admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:06.584099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78d9851-0ba7-42ef-a939-b0cab4340c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:06.585003 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d9851-0ba7-42ef-a939-b0cab4340c2c admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:06.585287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d9851-0ba7-42ef-a939-b0cab4340c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:06.585692 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78d9851-0ba7-42ef-a939-b0cab4340c2c admin admin] PATH_INFO: `/v3/projects/6147f478bbcb4ac491b510fd2014a957/users/a28956fa1a42424da509c8096665fd2a/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:06.587706 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d9851-0ba7-42ef-a939-b0cab4340c2c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6147f478bbcb4ac491b510fd2014a957, user_id=a28956fa1a42424da509c8096665fd2a, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:06.590358 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78d9851-0ba7-42ef-a939-b0cab4340c2c admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:06.597867 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb741a-2cdf-4e65-a4ed-e50e0360f7c3 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:06.602369 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1318/2640] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:38:06 2022] PUT /identity/v3/projects/6147f478bbcb4ac491b510fd2014a957/users/a28956fa1a42424da509c8096665fd2a/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:06.612433 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794838ac-7987-4a1c-9e67-5b87dab5db63 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:06.612741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794838ac-7987-4a1c-9e67-5b87dab5db63 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:06.613024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794838ac-7987-4a1c-9e67-5b87dab5db63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:06.638812 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-794838ac-7987-4a1c-9e67-5b87dab5db63 None None] MFA Rules not processed for user `a28956fa1a42424da509c8096665fd2a`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:06.640066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-794838ac-7987-4a1c-9e67-5b87dab5db63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:06.657444 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34d657c-a06f-4c1b-a95c-d02460e6d3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:06.658703 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d657c-a06f-4c1b-a95c-d02460e6d3ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:06.659040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d657c-a06f-4c1b-a95c-d02460e6d3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:06.659325 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34d657c-a06f-4c1b-a95c-d02460e6d3ee admin admin] PATH_INFO: `/v3/projects/6ae4ad77e40544b6bb530721ba175c54` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:06.660585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d657c-a06f-4c1b-a95c-d02460e6d3ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ae4ad77e40544b6bb530721ba175c54)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:06.663033 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34d657c-a06f-4c1b-a95c-d02460e6d3ee admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:06.712401 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a34d657c-a06f-4c1b-a95c-d02460e6d3ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ae4ad77e40544b6bb530721ba175c54', 'request_id': 'req-a34d657c-a06f-4c1b-a95c-d02460e6d3ee'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:06.715453 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1319/2641] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:06 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:38:06.718074 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a34d657c-a06f-4c1b-a95c-d02460e6d3ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ae4ad77e40544b6bb530721ba175c54', 'request_id': 'req-a34d657c-a06f-4c1b-a95c-d02460e6d3ee'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:06.724971 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a34d657c-a06f-4c1b-a95c-d02460e6d3ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ae4ad77e40544b6bb530721ba175c54', 'request_id': 'req-a34d657c-a06f-4c1b-a95c-d02460e6d3ee'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:06.727020 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794838ac-7987-4a1c-9e67-5b87dab5db63 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:06.728405 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-794838ac-7987-4a1c-9e67-5b87dab5db63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:06.738085 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a34d657c-a06f-4c1b-a95c-d02460e6d3ee admin admin] The token cache is being invalidate because project 6ae4ad77e40544b6bb530721ba175c54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:38:06.738376 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a34d657c-a06f-4c1b-a95c-d02460e6d3ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:06.739020 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a34d657c-a06f-4c1b-a95c-d02460e6d3ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:06.740628 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1323/2642] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:38:06 2022] DELETE /identity/v3/projects/6ae4ad77e40544b6bb530721ba175c54 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:06.745335 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710f3b7-5ff7-4168-844d-8182a513f93f None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:06.745630 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710f3b7-5ff7-4168-844d-8182a513f93f None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:06.745914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c710f3b7-5ff7-4168-844d-8182a513f93f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:06.763453 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-c710f3b7-5ff7-4168-844d-8182a513f93f None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:06.764760 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-c710f3b7-5ff7-4168-844d-8182a513f93f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:06.787538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794838ac-7987-4a1c-9e67-5b87dab5db63 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:06.821753 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:06.835904 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1324/2643] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:38:06.839074 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab408d-e6d8-4ca5-bcf8-208efd029760 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:06.839833 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab408d-e6d8-4ca5-bcf8-208efd029760 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:06.840476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab408d-e6d8-4ca5-bcf8-208efd029760 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:06.840598 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ab408d-e6d8-4ca5-bcf8-208efd029760 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:06.841821 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c146a7-664d-47a7-ad05-0f73813c1dbc None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:06.842113 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c146a7-664d-47a7-ad05-0f73813c1dbc None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:06.842395 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c146a7-664d-47a7-ad05-0f73813c1dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:06.842497 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-21ab408d-e6d8-4ca5-bcf8-208efd029760 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:06.860338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-72c146a7-664d-47a7-ad05-0f73813c1dbc None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:06.861202 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:06.861536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-72c146a7-664d-47a7-ad05-0f73813c1dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:06.869723 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1325/2644] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:38:06.873793 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c146a7-664d-47a7-ad05-0f73813c1dbc None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:06.883338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c146a7-664d-47a7-ad05-0f73813c1dbc None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:06.888101 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0eb7bb-5f02-4b6b-8b11-7d7c23ceeffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:06.888740 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0eb7bb-5f02-4b6b-8b11-7d7c23ceeffb admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:06.889036 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0eb7bb-5f02-4b6b-8b11-7d7c23ceeffb admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:06.889320 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0eb7bb-5f02-4b6b-8b11-7d7c23ceeffb admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:06.890045 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0eb7bb-5f02-4b6b-8b11-7d7c23ceeffb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:38:06.890358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0eb7bb-5f02-4b6b-8b11-7d7c23ceeffb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:06.892798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0eb7bb-5f02-4b6b-8b11-7d7c23ceeffb admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:06.907640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1326/2645] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:38:06.908752 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0eb7bb-5f02-4b6b-8b11-7d7c23ceeffb admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:06.911348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab408d-e6d8-4ca5-bcf8-208efd029760 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:06.912829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ab408d-e6d8-4ca5-bcf8-208efd029760 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:06.918625 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0eb7bb-5f02-4b6b-8b11-7d7c23ceeffb admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:06.922325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1320/2646] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:06 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:38:06.923638 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8acf5f-43e7-4849-aad4-fb653191e039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:06.924298 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8acf5f-43e7-4849-aad4-fb653191e039 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:06.924580 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8acf5f-43e7-4849-aad4-fb653191e039 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:06.924857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8acf5f-43e7-4849-aad4-fb653191e039 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:06.925535 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8acf5f-43e7-4849-aad4-fb653191e039 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:06.927458 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8acf5f-43e7-4849-aad4-fb653191e039 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:06.955197 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1327/2647] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:38:06 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:38:06.959373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab408d-e6d8-4ca5-bcf8-208efd029760 service cinder] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:06.969627 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ab408d-e6d8-4ca5-bcf8-208efd029760 service cinder] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:06.998675 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8acf5f-43e7-4849-aad4-fb653191e039 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:07.001069 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-9e8acf5f-43e7-4849-aad4-fb653191e039 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:07.029675 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9a929-61c2-4380-adfe-13d2f6d6933d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:07.030613 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9a929-61c2-4380-adfe-13d2f6d6933d admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:07.030906 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9a929-61c2-4380-adfe-13d2f6d6933d admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:07.031184 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed9a929-61c2-4380-adfe-13d2f6d6933d admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:07.032437 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9a929-61c2-4380-adfe-13d2f6d6933d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:07.034726 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed9a929-61c2-4380-adfe-13d2f6d6933d admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:07.057744 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1321/2648] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:38:06 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:38:07.058766 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9a929-61c2-4380-adfe-13d2f6d6933d admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:07.061729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8acf5f-43e7-4849-aad4-fb653191e039 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:07.065503 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0c6a49-0f5a-4820-9398-a787f4ca532b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:07.066155 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c6a49-0f5a-4820-9398-a787f4ca532b service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:07.066446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c6a49-0f5a-4820-9398-a787f4ca532b service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:07.066728 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0c6a49-0f5a-4820-9398-a787f4ca532b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:07.068403 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed9a929-61c2-4380-adfe-13d2f6d6933d admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:07.068537 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-ff0c6a49-0f5a-4820-9398-a787f4ca532b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:07.073288 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010435cd-2620-47df-8737-02a920dd14c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:07.073932 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010435cd-2620-47df-8737-02a920dd14c0 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:07.074239 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010435cd-2620-47df-8737-02a920dd14c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:07.074504 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010435cd-2620-47df-8737-02a920dd14c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:07.075224 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010435cd-2620-47df-8737-02a920dd14c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:07.076851 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010435cd-2620-47df-8737-02a920dd14c0 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:07.087457 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1322/2649] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:38:07.091373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010435cd-2620-47df-8737-02a920dd14c0 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:07.101457 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010435cd-2620-47df-8737-02a920dd14c0 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:07.106047 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241b5fc-2d52-4b93-b62e-1df53f2c3779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:07.106672 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241b5fc-2d52-4b93-b62e-1df53f2c3779 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:07.106960 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241b5fc-2d52-4b93-b62e-1df53f2c3779 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:07.107242 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241b5fc-2d52-4b93-b62e-1df53f2c3779 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:07.107981 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241b5fc-2d52-4b93-b62e-1df53f2c3779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:07.109537 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241b5fc-2d52-4b93-b62e-1df53f2c3779 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:07.120335 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1323/2650] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:38:07.124320 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241b5fc-2d52-4b93-b62e-1df53f2c3779 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:07.128944 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c6a49-0f5a-4820-9398-a787f4ca532b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:07.130380 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0c6a49-0f5a-4820-9398-a787f4ca532b service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:07.133544 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241b5fc-2d52-4b93-b62e-1df53f2c3779 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:07.138201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c7d2f-be9d-4210-b6af-8bc8aaf2f2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:07.139066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c7d2f-be9d-4210-b6af-8bc8aaf2f2b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:07.139342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c7d2f-be9d-4210-b6af-8bc8aaf2f2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:07.139466 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1328/2651] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:38:07.139721 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82c7d2f-be9d-4210-b6af-8bc8aaf2f2b6 admin admin] PATH_INFO: `/v3/projects/56a2961e651642e091265bcb980a4d17/users/0484a18c223840b8ae66faa6c0765065/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:07.154830 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c7d2f-be9d-4210-b6af-8bc8aaf2f2b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=56a2961e651642e091265bcb980a4d17, user_id=0484a18c223840b8ae66faa6c0765065, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:07.158061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82c7d2f-be9d-4210-b6af-8bc8aaf2f2b6 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:07.170614 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1324/2652] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:38:07 2022] PUT /identity/v3/projects/56a2961e651642e091265bcb980a4d17/users/0484a18c223840b8ae66faa6c0765065/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:38:07.181657 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e183c-5409-4d4d-b486-8ec20190c9ae None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:07.182059 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e183c-5409-4d4d-b486-8ec20190c9ae None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:07.182431 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e183c-5409-4d4d-b486-8ec20190c9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:07.209273 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-eb8e183c-5409-4d4d-b486-8ec20190c9ae None None] MFA Rules not processed for user `0484a18c223840b8ae66faa6c0765065`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:07.210494 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-eb8e183c-5409-4d4d-b486-8ec20190c9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:07.274612 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:07.281385 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1329/2653] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:07.298313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c7d2f-be9d-4210-b6af-8bc8aaf2f2b6 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:07.300231 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-b82c7d2f-be9d-4210-b6af-8bc8aaf2f2b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:07.369944 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82c7d2f-be9d-4210-b6af-8bc8aaf2f2b6 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:07.374072 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bb1332-2753-4ec4-abad-0d72ef1d8ff6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:07.374705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb1332-2753-4ec4-abad-0d72ef1d8ff6 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:07.374999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb1332-2753-4ec4-abad-0d72ef1d8ff6 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:07.375277 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bb1332-2753-4ec4-abad-0d72ef1d8ff6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:07.390748 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb1332-2753-4ec4-abad-0d72ef1d8ff6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:07.392988 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bb1332-2753-4ec4-abad-0d72ef1d8ff6 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:07.398271 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:07.404168 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1325/2654] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:38:07.429585 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e183c-5409-4d4d-b486-8ec20190c9ae None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:07.497587 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e183c-5409-4d4d-b486-8ec20190c9ae None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:07.502371 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200eabb-e5b3-4b1e-b958-98d86e1a5f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:07.503252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200eabb-e5b3-4b1e-b958-98d86e1a5f3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:07.503539 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200eabb-e5b3-4b1e-b958-98d86e1a5f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:07.503848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200eabb-e5b3-4b1e-b958-98d86e1a5f3b admin admin] PATH_INFO: `/v3/users/0484a18c223840b8ae66faa6c0765065` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:07.505049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0200eabb-e5b3-4b1e-b958-98d86e1a5f3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0484a18c223840b8ae66faa6c0765065)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:07.507057 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0200eabb-e5b3-4b1e-b958-98d86e1a5f3b admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:07.554184 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-0200eabb-e5b3-4b1e-b958-98d86e1a5f3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0484a18c223840b8ae66faa6c0765065'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:07.561042 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-0200eabb-e5b3-4b1e-b958-98d86e1a5f3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0484a18c223840b8ae66faa6c0765065'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:07.561668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-0200eabb-e5b3-4b1e-b958-98d86e1a5f3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0484a18c223840b8ae66faa6c0765065'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:07.574494 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-0200eabb-e5b3-4b1e-b958-98d86e1a5f3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0484a18c223840b8ae66faa6c0765065'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:07.575153 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-0200eabb-e5b3-4b1e-b958-98d86e1a5f3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0484a18c223840b8ae66faa6c0765065'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:07.587893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1330/2655] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:38:07 2022] DELETE /identity/v3/users/0484a18c223840b8ae66faa6c0765065 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:07.592473 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97082754-2f5b-4738-b5cb-40864136a920 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:07.592932 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97082754-2f5b-4738-b5cb-40864136a920 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:07.593052 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97082754-2f5b-4738-b5cb-40864136a920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:07.609864 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-97082754-2f5b-4738-b5cb-40864136a920 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:07.611081 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-97082754-2f5b-4738-b5cb-40864136a920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:07.668055 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1326/2656] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:07.677479 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200eabb-e5b3-4b1e-b958-98d86e1a5f3b admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:07.678950 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-0200eabb-e5b3-4b1e-b958-98d86e1a5f3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:07.735687 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200eabb-e5b3-4b1e-b958-98d86e1a5f3b admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:07.739258 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedaa56e-a431-4bc8-a270-63af0920dd36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:07.739924 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedaa56e-a431-4bc8-a270-63af0920dd36 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:07.740208 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedaa56e-a431-4bc8-a270-63af0920dd36 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:07.740500 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedaa56e-a431-4bc8-a270-63af0920dd36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:07.749807 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedaa56e-a431-4bc8-a270-63af0920dd36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:07.751702 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedaa56e-a431-4bc8-a270-63af0920dd36 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:07.761202 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1331/2657] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:38:08.028805 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97082754-2f5b-4738-b5cb-40864136a920 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:08.030257 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-97082754-2f5b-4738-b5cb-40864136a920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:08.048363 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97082754-2f5b-4738-b5cb-40864136a920 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:08.053106 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0301534c-72b5-4947-8887-87dff89ecb10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:08.053985 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301534c-72b5-4947-8887-87dff89ecb10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:08.054708 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301534c-72b5-4947-8887-87dff89ecb10 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:08.054708 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0301534c-72b5-4947-8887-87dff89ecb10 admin admin] PATH_INFO: `/v3/projects/56a2961e651642e091265bcb980a4d17` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:08.055786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301534c-72b5-4947-8887-87dff89ecb10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=56a2961e651642e091265bcb980a4d17)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:08.057715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0301534c-72b5-4947-8887-87dff89ecb10 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:08.104351 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0301534c-72b5-4947-8887-87dff89ecb10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56a2961e651642e091265bcb980a4d17', 'request_id': 'req-0301534c-72b5-4947-8887-87dff89ecb10'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:08.110390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0301534c-72b5-4947-8887-87dff89ecb10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56a2961e651642e091265bcb980a4d17', 'request_id': 'req-0301534c-72b5-4947-8887-87dff89ecb10'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:08.116422 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0301534c-72b5-4947-8887-87dff89ecb10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56a2961e651642e091265bcb980a4d17', 'request_id': 'req-0301534c-72b5-4947-8887-87dff89ecb10'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:08.128966 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0301534c-72b5-4947-8887-87dff89ecb10 admin admin] The token cache is being invalidate because project 56a2961e651642e091265bcb980a4d17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:38:08.129257 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0301534c-72b5-4947-8887-87dff89ecb10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:08.129878 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0301534c-72b5-4947-8887-87dff89ecb10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:08.131444 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1327/2658] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:38:08 2022] DELETE /identity/v3/projects/56a2961e651642e091265bcb980a4d17 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:08.136387 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cb4d3-5a0f-4738-b329-ccdcc758d497 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:08.136671 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cb4d3-5a0f-4738-b329-ccdcc758d497 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:08.136952 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6cb4d3-5a0f-4738-b329-ccdcc758d497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:08.154408 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-1c6cb4d3-5a0f-4738-b329-ccdcc758d497 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:08.155632 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-1c6cb4d3-5a0f-4738-b329-ccdcc758d497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:08.172937 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:08.218494 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1332/2659] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:08.226275 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b72f1e-114a-41d3-9a36-7500c4291b2b None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:08.226565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b72f1e-114a-41d3-9a36-7500c4291b2b None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:08.226871 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b72f1e-114a-41d3-9a36-7500c4291b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:08.245177 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-01b72f1e-114a-41d3-9a36-7500c4291b2b None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:08.246367 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-01b72f1e-114a-41d3-9a36-7500c4291b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:08.255026 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1328/2660] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:08.258994 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cb4d3-5a0f-4738-b329-ccdcc758d497 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:08.269553 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6cb4d3-5a0f-4738-b329-ccdcc758d497 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:08.274226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d83cf5-6932-4f29-844e-124e07ef29d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:08.274817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d83cf5-6932-4f29-844e-124e07ef29d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:08.275098 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d83cf5-6932-4f29-844e-124e07ef29d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:08.275372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d83cf5-6932-4f29-844e-124e07ef29d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:08.276131 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d83cf5-6932-4f29-844e-124e07ef29d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:38:08.276440 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d83cf5-6932-4f29-844e-124e07ef29d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:08.278038 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d83cf5-6932-4f29-844e-124e07ef29d8 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:08.289789 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1333/2661] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:38:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:38:08.293901 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b72f1e-114a-41d3-9a36-7500c4291b2b None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:08.303634 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b72f1e-114a-41d3-9a36-7500c4291b2b None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:08.308482 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ae728-6a48-4e0a-b305-10a4a75bc4e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:08.309125 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ae728-6a48-4e0a-b305-10a4a75bc4e1 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:08.309409 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ae728-6a48-4e0a-b305-10a4a75bc4e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:08.309688 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ae728-6a48-4e0a-b305-10a4a75bc4e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:08.310388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ae728-6a48-4e0a-b305-10a4a75bc4e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:08.312316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1ae728-6a48-4e0a-b305-10a4a75bc4e1 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:08.337208 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1329/2662] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:38:08 2022] POST /identity/v3/projects => generated 389 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:38:08.341160 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d83cf5-6932-4f29-844e-124e07ef29d8 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:08.351452 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d83cf5-6932-4f29-844e-124e07ef29d8 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:08.407792 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235fe97-b3ef-4fd7-a150-7a7e3bbf6584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:08.408450 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235fe97-b3ef-4fd7-a150-7a7e3bbf6584 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:08.408737 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235fe97-b3ef-4fd7-a150-7a7e3bbf6584 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:08.409044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235fe97-b3ef-4fd7-a150-7a7e3bbf6584 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:08.409725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235fe97-b3ef-4fd7-a150-7a7e3bbf6584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:08.411660 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235fe97-b3ef-4fd7-a150-7a7e3bbf6584 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:08.431125 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1334/2663] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:38:08 2022] POST /identity/v3/users => generated 295 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:38:08.435027 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ae728-6a48-4e0a-b305-10a4a75bc4e1 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:08.445209 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ae728-6a48-4e0a-b305-10a4a75bc4e1 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:08.449868 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74210d-14fc-4e46-85b5-57d84a9361ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:08.450520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74210d-14fc-4e46-85b5-57d84a9361ef admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:08.450803 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74210d-14fc-4e46-85b5-57d84a9361ef admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:08.451085 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d74210d-14fc-4e46-85b5-57d84a9361ef admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:08.451833 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74210d-14fc-4e46-85b5-57d84a9361ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:08.453416 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d74210d-14fc-4e46-85b5-57d84a9361ef admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:08.464058 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1330/2664] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:38:08.467736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235fe97-b3ef-4fd7-a150-7a7e3bbf6584 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:08.478491 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235fe97-b3ef-4fd7-a150-7a7e3bbf6584 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:08.483562 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297845b1-238b-48fd-ac9c-15fe5935edc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:08.484398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297845b1-238b-48fd-ac9c-15fe5935edc1 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:08.484688 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297845b1-238b-48fd-ac9c-15fe5935edc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:08.487774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297845b1-238b-48fd-ac9c-15fe5935edc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:08.488640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297845b1-238b-48fd-ac9c-15fe5935edc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:08.490469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297845b1-238b-48fd-ac9c-15fe5935edc1 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:08.501130 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1335/2665] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:38:08.505151 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74210d-14fc-4e46-85b5-57d84a9361ef admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:08.515076 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d74210d-14fc-4e46-85b5-57d84a9361ef admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:08.520261 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b11a6e-a064-4bd1-bcf7-bc0c10bb0768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:08.520953 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b11a6e-a064-4bd1-bcf7-bc0c10bb0768 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:08.521238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b11a6e-a064-4bd1-bcf7-bc0c10bb0768 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:08.521515 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b11a6e-a064-4bd1-bcf7-bc0c10bb0768 admin admin] PATH_INFO: `/v3/projects/697744afbdf04464b45a77f4136a9771/users/211fd0d8218c4916a9bd29d64038db74/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:08.536508 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b11a6e-a064-4bd1-bcf7-bc0c10bb0768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=697744afbdf04464b45a77f4136a9771, user_id=211fd0d8218c4916a9bd29d64038db74, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:08.539160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b11a6e-a064-4bd1-bcf7-bc0c10bb0768 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:08.554352 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1331/2666] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:38:08 2022] PUT /identity/v3/projects/697744afbdf04464b45a77f4136a9771/users/211fd0d8218c4916a9bd29d64038db74/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:08.619736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf2a38-f67c-451e-9ef3-7fd5eee92d6e None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:08.620252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf2a38-f67c-451e-9ef3-7fd5eee92d6e None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:08.620547 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccaf2a38-f67c-451e-9ef3-7fd5eee92d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:08.649240 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-ccaf2a38-f67c-451e-9ef3-7fd5eee92d6e None None] MFA Rules not processed for user `211fd0d8218c4916a9bd29d64038db74`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:08.650490 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-ccaf2a38-f67c-451e-9ef3-7fd5eee92d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:08.722918 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1336/2667] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:08.735313 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b11a6e-a064-4bd1-bcf7-bc0c10bb0768 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:08.737483 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-c2b11a6e-a064-4bd1-bcf7-bc0c10bb0768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:08.761410 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:08.804369 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b11a6e-a064-4bd1-bcf7-bc0c10bb0768 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:08.808028 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e7d65e-da33-4fde-a0f1-19fd38d0859e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:08.808675 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7d65e-da33-4fde-a0f1-19fd38d0859e service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:08.808959 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7d65e-da33-4fde-a0f1-19fd38d0859e service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:08.809269 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e7d65e-da33-4fde-a0f1-19fd38d0859e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:08.818550 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7d65e-da33-4fde-a0f1-19fd38d0859e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:08.820062 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e7d65e-da33-4fde-a0f1-19fd38d0859e service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:08.828775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1332/2668] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:08 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:38:14.968882 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf2a38-f67c-451e-9ef3-7fd5eee92d6e None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:14.970830 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-ccaf2a38-f67c-451e-9ef3-7fd5eee92d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:14.990843 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:15.035661 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccaf2a38-f67c-451e-9ef3-7fd5eee92d6e None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:15.040221 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8e05e-a866-4043-bc35-9e59597e2c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:15.041093 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8e05e-a866-4043-bc35-9e59597e2c16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:15.041380 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8e05e-a866-4043-bc35-9e59597e2c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:15.041658 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8e05e-a866-4043-bc35-9e59597e2c16 admin admin] PATH_INFO: `/v3/users/32ecc48d090444efb0c4dbe5bfd67316` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:15.042837 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8e05e-a866-4043-bc35-9e59597e2c16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32ecc48d090444efb0c4dbe5bfd67316)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:15.044908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8e05e-a866-4043-bc35-9e59597e2c16 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:15.090148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-7ed8e05e-a866-4043-bc35-9e59597e2c16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32ecc48d090444efb0c4dbe5bfd67316'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:15.097581 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-7ed8e05e-a866-4043-bc35-9e59597e2c16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32ecc48d090444efb0c4dbe5bfd67316'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:15.098410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-7ed8e05e-a866-4043-bc35-9e59597e2c16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32ecc48d090444efb0c4dbe5bfd67316'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:15.110203 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-7ed8e05e-a866-4043-bc35-9e59597e2c16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32ecc48d090444efb0c4dbe5bfd67316'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:15.110837 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-7ed8e05e-a866-4043-bc35-9e59597e2c16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32ecc48d090444efb0c4dbe5bfd67316'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:15.122995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1337/2669] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:38:14 2022] DELETE /identity/v3/users/32ecc48d090444efb0c4dbe5bfd67316 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:15.127591 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e1b6d-af46-489c-9495-222dfa2f2ca5 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:15.128086 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e1b6d-af46-489c-9495-222dfa2f2ca5 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:15.128207 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78e1b6d-af46-489c-9495-222dfa2f2ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:15.145640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-f78e1b6d-af46-489c-9495-222dfa2f2ca5 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:15.146859 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-f78e1b6d-af46-489c-9495-222dfa2f2ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:15.206097 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1333/2670] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:38:15.215791 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8e05e-a866-4043-bc35-9e59597e2c16 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:15.217191 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-7ed8e05e-a866-4043-bc35-9e59597e2c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:15.273931 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8e05e-a866-4043-bc35-9e59597e2c16 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:15.277523 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc29ee5-ba1f-47e1-8638-eaa2e6e03dce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:15.278162 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc29ee5-ba1f-47e1-8638-eaa2e6e03dce service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:15.278445 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc29ee5-ba1f-47e1-8638-eaa2e6e03dce service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:15.278721 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc29ee5-ba1f-47e1-8638-eaa2e6e03dce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:15.288479 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc29ee5-ba1f-47e1-8638-eaa2e6e03dce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:15.289920 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc29ee5-ba1f-47e1-8638-eaa2e6e03dce service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:15.299312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1338/2671] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:38:15.565617 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e1b6d-af46-489c-9495-222dfa2f2ca5 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:15.567210 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-f78e1b6d-af46-489c-9495-222dfa2f2ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:15.579831 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78e1b6d-af46-489c-9495-222dfa2f2ca5 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:15.584760 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259599dc-94aa-4d05-aef6-654e51e212c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:15.585635 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259599dc-94aa-4d05-aef6-654e51e212c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:15.585918 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259599dc-94aa-4d05-aef6-654e51e212c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:15.586199 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259599dc-94aa-4d05-aef6-654e51e212c3 admin admin] PATH_INFO: `/v3/projects/f7185ca4ce174508b802092400264f4e` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:15.587390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259599dc-94aa-4d05-aef6-654e51e212c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7185ca4ce174508b802092400264f4e)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:15.589343 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259599dc-94aa-4d05-aef6-654e51e212c3 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:15.641206 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-259599dc-94aa-4d05-aef6-654e51e212c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7185ca4ce174508b802092400264f4e', 'request_id': 'req-259599dc-94aa-4d05-aef6-654e51e212c3'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:15.650306 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-259599dc-94aa-4d05-aef6-654e51e212c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7185ca4ce174508b802092400264f4e', 'request_id': 'req-259599dc-94aa-4d05-aef6-654e51e212c3'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:15.656544 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-259599dc-94aa-4d05-aef6-654e51e212c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7185ca4ce174508b802092400264f4e', 'request_id': 'req-259599dc-94aa-4d05-aef6-654e51e212c3'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:15.670298 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-259599dc-94aa-4d05-aef6-654e51e212c3 admin admin] The token cache is being invalidate because project f7185ca4ce174508b802092400264f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:38:15.670585 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-259599dc-94aa-4d05-aef6-654e51e212c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:15.671223 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-259599dc-94aa-4d05-aef6-654e51e212c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:15.672814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1334/2672] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:38:15 2022] DELETE /identity/v3/projects/f7185ca4ce174508b802092400264f4e => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:15.676958 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc29ee5-ba1f-47e1-8638-eaa2e6e03dce service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:15.686714 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc29ee5-ba1f-47e1-8638-eaa2e6e03dce service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:15.726410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:15.747038 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d889954-5ad6-4921-85c9-9e4f1318aeff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:15.748050 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d889954-5ad6-4921-85c9-9e4f1318aeff admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:15.748336 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d889954-5ad6-4921-85c9-9e4f1318aeff admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:15.748611 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d889954-5ad6-4921-85c9-9e4f1318aeff admin admin] PATH_INFO: `/v3/users/a28956fa1a42424da509c8096665fd2a` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:15.749826 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d889954-5ad6-4921-85c9-9e4f1318aeff admin admin] RBAC: Authorizing `identity:delete_user(user_id=a28956fa1a42424da509c8096665fd2a)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:15.752312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d889954-5ad6-4921-85c9-9e4f1318aeff admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:15.799675 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-6d889954-5ad6-4921-85c9-9e4f1318aeff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a28956fa1a42424da509c8096665fd2a'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:15.806870 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-6d889954-5ad6-4921-85c9-9e4f1318aeff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a28956fa1a42424da509c8096665fd2a'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:15.807518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-6d889954-5ad6-4921-85c9-9e4f1318aeff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a28956fa1a42424da509c8096665fd2a'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:15.820001 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-6d889954-5ad6-4921-85c9-9e4f1318aeff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a28956fa1a42424da509c8096665fd2a'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:15.820642 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-6d889954-5ad6-4921-85c9-9e4f1318aeff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a28956fa1a42424da509c8096665fd2a'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:15.832752 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1339/2673] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:38:15 2022] DELETE /identity/v3/users/a28956fa1a42424da509c8096665fd2a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:16.098693 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259599dc-94aa-4d05-aef6-654e51e212c3 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:16.100166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-259599dc-94aa-4d05-aef6-654e51e212c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:16.113756 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259599dc-94aa-4d05-aef6-654e51e212c3 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:16.164964 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:16.179186 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba98685-746f-4d47-97bc-4f1eaeab388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:16.180066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba98685-746f-4d47-97bc-4f1eaeab388a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:16.180343 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba98685-746f-4d47-97bc-4f1eaeab388a admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:16.180650 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba98685-746f-4d47-97bc-4f1eaeab388a admin admin] PATH_INFO: `/v3/projects/6147f478bbcb4ac491b510fd2014a957` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:16.181839 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba98685-746f-4d47-97bc-4f1eaeab388a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6147f478bbcb4ac491b510fd2014a957)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:16.183818 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba98685-746f-4d47-97bc-4f1eaeab388a admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:16.228806 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-bba98685-746f-4d47-97bc-4f1eaeab388a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6147f478bbcb4ac491b510fd2014a957', 'request_id': 'req-bba98685-746f-4d47-97bc-4f1eaeab388a'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:16.234166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-bba98685-746f-4d47-97bc-4f1eaeab388a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6147f478bbcb4ac491b510fd2014a957', 'request_id': 'req-bba98685-746f-4d47-97bc-4f1eaeab388a'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:16.240748 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-bba98685-746f-4d47-97bc-4f1eaeab388a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6147f478bbcb4ac491b510fd2014a957', 'request_id': 'req-bba98685-746f-4d47-97bc-4f1eaeab388a'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:16.253679 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-bba98685-746f-4d47-97bc-4f1eaeab388a admin admin] The token cache is being invalidate because project 6147f478bbcb4ac491b510fd2014a957 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:38:16.253971 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-bba98685-746f-4d47-97bc-4f1eaeab388a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:16.254602 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-bba98685-746f-4d47-97bc-4f1eaeab388a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:16.256190 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1335/2674] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:38:16 2022] DELETE /identity/v3/projects/6147f478bbcb4ac491b510fd2014a957 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:16.261084 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3208f4-4084-4b77-9d38-1977ddd40f14 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:16.261542 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3208f4-4084-4b77-9d38-1977ddd40f14 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:16.261640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3208f4-4084-4b77-9d38-1977ddd40f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:16.279391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-7a3208f4-4084-4b77-9d38-1977ddd40f14 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:16.280613 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-7a3208f4-4084-4b77-9d38-1977ddd40f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:16.340882 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1340/2675] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:16.349055 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afc2ee-6cdc-41d8-b167-115e47583455 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:16.349351 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afc2ee-6cdc-41d8-b167-115e47583455 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:16.349636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90afc2ee-6cdc-41d8-b167-115e47583455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:16.368098 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-90afc2ee-6cdc-41d8-b167-115e47583455 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:16.369300 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-90afc2ee-6cdc-41d8-b167-115e47583455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:16.377388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1336/2676] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:16.381474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3208f4-4084-4b77-9d38-1977ddd40f14 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:16.391198 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3208f4-4084-4b77-9d38-1977ddd40f14 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:16.395786 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d68651-8287-44f6-ad70-e41e1ba63a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:16.396432 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d68651-8287-44f6-ad70-e41e1ba63a8a admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:16.396720 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d68651-8287-44f6-ad70-e41e1ba63a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:16.396995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d68651-8287-44f6-ad70-e41e1ba63a8a admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:16.397706 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d68651-8287-44f6-ad70-e41e1ba63a8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:38:16.398041 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d68651-8287-44f6-ad70-e41e1ba63a8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:16.399655 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d68651-8287-44f6-ad70-e41e1ba63a8a admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:16.411317 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1341/2677] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:38:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:38:16.415344 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afc2ee-6cdc-41d8-b167-115e47583455 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:16.425054 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90afc2ee-6cdc-41d8-b167-115e47583455 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:16.429749 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f23c76-959e-47c3-b83b-8e5fca635bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:16.430341 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f23c76-959e-47c3-b83b-8e5fca635bff admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:16.430634 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f23c76-959e-47c3-b83b-8e5fca635bff admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:16.430914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f23c76-959e-47c3-b83b-8e5fca635bff admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:16.431602 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f23c76-959e-47c3-b83b-8e5fca635bff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:16.433540 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f23c76-959e-47c3-b83b-8e5fca635bff admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:16.458120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1337/2678] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:38:16 2022] POST /identity/v3/projects => generated 375 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:38:16.462202 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d68651-8287-44f6-ad70-e41e1ba63a8a admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:16.472937 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d68651-8287-44f6-ad70-e41e1ba63a8a admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:16.516044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:16.530441 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1043d-8c6a-47ed-906d-1827eadec567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:16.531108 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1043d-8c6a-47ed-906d-1827eadec567 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:16.531391 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1043d-8c6a-47ed-906d-1827eadec567 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:16.531700 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c1043d-8c6a-47ed-906d-1827eadec567 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:16.532900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1043d-8c6a-47ed-906d-1827eadec567 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:16.534819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c1043d-8c6a-47ed-906d-1827eadec567 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:16.554221 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1342/2679] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:38:16 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:38:16.558243 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f23c76-959e-47c3-b83b-8e5fca635bff admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:16.568509 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f23c76-959e-47c3-b83b-8e5fca635bff admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:16.573102 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8215501-4618-4e31-9123-f67bf60ce7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:16.573753 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8215501-4618-4e31-9123-f67bf60ce7eb admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:16.574039 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8215501-4618-4e31-9123-f67bf60ce7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:16.574318 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8215501-4618-4e31-9123-f67bf60ce7eb admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:16.575043 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8215501-4618-4e31-9123-f67bf60ce7eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:16.576670 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8215501-4618-4e31-9123-f67bf60ce7eb admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:16.587487 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1338/2680] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:38:16.591404 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1043d-8c6a-47ed-906d-1827eadec567 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:16.601886 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c1043d-8c6a-47ed-906d-1827eadec567 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:16.606470 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a4c5b9-2ec3-43d9-acbf-1696871b0d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:16.607118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4c5b9-2ec3-43d9-acbf-1696871b0d92 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:16.607405 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4c5b9-2ec3-43d9-acbf-1696871b0d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:16.607721 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a4c5b9-2ec3-43d9-acbf-1696871b0d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:16.608442 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4c5b9-2ec3-43d9-acbf-1696871b0d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:16.610085 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a4c5b9-2ec3-43d9-acbf-1696871b0d92 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:16.619968 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1343/2681] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:38:16 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:38:16.624112 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8215501-4618-4e31-9123-f67bf60ce7eb admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:16.634362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8215501-4618-4e31-9123-f67bf60ce7eb admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:16.639026 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cef14a-2bf0-46a2-a3b0-9eabb3fcaeb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:16.639972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cef14a-2bf0-46a2-a3b0-9eabb3fcaeb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:16.640261 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cef14a-2bf0-46a2-a3b0-9eabb3fcaeb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:16.640571 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cef14a-2bf0-46a2-a3b0-9eabb3fcaeb1 admin admin] PATH_INFO: `/v3/projects/5b9ac26fe297412d901a726508e231d4/users/a5f5428cd91c4b21bf43e6fae79ef210/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:16.658670 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cef14a-2bf0-46a2-a3b0-9eabb3fcaeb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b9ac26fe297412d901a726508e231d4, user_id=a5f5428cd91c4b21bf43e6fae79ef210, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:16.661484 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cef14a-2bf0-46a2-a3b0-9eabb3fcaeb1 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:16.675773 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1339/2682] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:38:16 2022] PUT /identity/v3/projects/5b9ac26fe297412d901a726508e231d4/users/a5f5428cd91c4b21bf43e6fae79ef210/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:38:16.686952 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c500c02-3686-43ef-97fc-59ca6c5f4843 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:16.687203 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c500c02-3686-43ef-97fc-59ca6c5f4843 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:16.687536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c500c02-3686-43ef-97fc-59ca6c5f4843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:16.715332 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-9c500c02-3686-43ef-97fc-59ca6c5f4843 None None] MFA Rules not processed for user `a5f5428cd91c4b21bf43e6fae79ef210`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:16.716580 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-9c500c02-3686-43ef-97fc-59ca6c5f4843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:16.779276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1344/2683] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:16.791178 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cef14a-2bf0-46a2-a3b0-9eabb3fcaeb1 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:16.792921 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-f2cef14a-2bf0-46a2-a3b0-9eabb3fcaeb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:16.848612 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cef14a-2bf0-46a2-a3b0-9eabb3fcaeb1 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:16.852325 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86dee125-bca3-499b-a5cd-452925912dcd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faaab5440b7041faa5a6f9ea18c188c4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:16.852965 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dee125-bca3-499b-a5cd-452925912dcd service glance] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:16.853252 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dee125-bca3-499b-a5cd-452925912dcd service glance] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:16.853530 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86dee125-bca3-499b-a5cd-452925912dcd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:16.861764 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dee125-bca3-499b-a5cd-452925912dcd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:16.863185 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86dee125-bca3-499b-a5cd-452925912dcd service glance] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:16.871921 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1340/2684] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:16 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:38:26.776149 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:26.867974 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:33.189819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c500c02-3686-43ef-97fc-59ca6c5f4843 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:33.191333 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-9c500c02-3686-43ef-97fc-59ca6c5f4843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:33.255496 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c500c02-3686-43ef-97fc-59ca6c5f4843 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:33.260052 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040d203-50b3-4778-a7b8-d3a3092cb889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:33.260912 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040d203-50b3-4778-a7b8-d3a3092cb889 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:33.261198 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040d203-50b3-4778-a7b8-d3a3092cb889 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:33.261624 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040d203-50b3-4778-a7b8-d3a3092cb889 admin admin] PATH_INFO: `/v3/users/211fd0d8218c4916a9bd29d64038db74` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:33.262804 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040d203-50b3-4778-a7b8-d3a3092cb889 admin admin] RBAC: Authorizing `identity:delete_user(user_id=211fd0d8218c4916a9bd29d64038db74)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:33.264758 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a040d203-50b3-4778-a7b8-d3a3092cb889 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:33.309528 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a040d203-50b3-4778-a7b8-d3a3092cb889 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '211fd0d8218c4916a9bd29d64038db74'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:33.316024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a040d203-50b3-4778-a7b8-d3a3092cb889 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '211fd0d8218c4916a9bd29d64038db74'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:33.317324 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a040d203-50b3-4778-a7b8-d3a3092cb889 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '211fd0d8218c4916a9bd29d64038db74'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:33.329154 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a040d203-50b3-4778-a7b8-d3a3092cb889 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '211fd0d8218c4916a9bd29d64038db74'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:33.329793 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a040d203-50b3-4778-a7b8-d3a3092cb889 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '211fd0d8218c4916a9bd29d64038db74'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:33.341833 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1345/2685] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:38:33 2022] DELETE /identity/v3/users/211fd0d8218c4916a9bd29d64038db74 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:33.346422 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb1cb4-39d1-49ef-896e-477560967cf8 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:33.346979 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb1cb4-39d1-49ef-896e-477560967cf8 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:33.346979 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb1cb4-39d1-49ef-896e-477560967cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:33.365210 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-4deb1cb4-39d1-49ef-896e-477560967cf8 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:33.366411 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-4deb1cb4-39d1-49ef-896e-477560967cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:33.427179 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1341/2686] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:33.436793 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040d203-50b3-4778-a7b8-d3a3092cb889 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:33.438213 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a040d203-50b3-4778-a7b8-d3a3092cb889 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:33.497067 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040d203-50b3-4778-a7b8-d3a3092cb889 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:33.500704 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ceb157-6bd7-40ce-9383-2187015a5c03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:33.501355 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceb157-6bd7-40ce-9383-2187015a5c03 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:33.501640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceb157-6bd7-40ce-9383-2187015a5c03 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:33.501921 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ceb157-6bd7-40ce-9383-2187015a5c03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:33.511026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ceb157-6bd7-40ce-9383-2187015a5c03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:33.512493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ceb157-6bd7-40ce-9383-2187015a5c03 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:33.522086 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1346/2687] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:38:33.783633 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb1cb4-39d1-49ef-896e-477560967cf8 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:33.786202 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-4deb1cb4-39d1-49ef-896e-477560967cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:33.800474 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb1cb4-39d1-49ef-896e-477560967cf8 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:33.805633 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc510b9-7ccd-4257-874e-4631482759ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:33.806538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc510b9-7ccd-4257-874e-4631482759ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:33.806842 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc510b9-7ccd-4257-874e-4631482759ed admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:33.807123 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc510b9-7ccd-4257-874e-4631482759ed admin admin] PATH_INFO: `/v3/projects/697744afbdf04464b45a77f4136a9771` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:33.808359 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc510b9-7ccd-4257-874e-4631482759ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=697744afbdf04464b45a77f4136a9771)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:33.810281 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc510b9-7ccd-4257-874e-4631482759ed admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:33.856409 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0bc510b9-7ccd-4257-874e-4631482759ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '697744afbdf04464b45a77f4136a9771', 'request_id': 'req-0bc510b9-7ccd-4257-874e-4631482759ed'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:33.861859 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0bc510b9-7ccd-4257-874e-4631482759ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '697744afbdf04464b45a77f4136a9771', 'request_id': 'req-0bc510b9-7ccd-4257-874e-4631482759ed'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:33.868004 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0bc510b9-7ccd-4257-874e-4631482759ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '697744afbdf04464b45a77f4136a9771', 'request_id': 'req-0bc510b9-7ccd-4257-874e-4631482759ed'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:33.879845 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0bc510b9-7ccd-4257-874e-4631482759ed admin admin] The token cache is being invalidate because project 697744afbdf04464b45a77f4136a9771 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:38:33.880169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0bc510b9-7ccd-4257-874e-4631482759ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:33.880796 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0bc510b9-7ccd-4257-874e-4631482759ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:33.882314 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1342/2688] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:38:33 2022] DELETE /identity/v3/projects/697744afbdf04464b45a77f4136a9771 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:33.887267 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254c0e5-0efd-4c68-92d0-939623bc6d8b None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:33.887560 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254c0e5-0efd-4c68-92d0-939623bc6d8b None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:33.887875 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254c0e5-0efd-4c68-92d0-939623bc6d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:33.906020 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-5254c0e5-0efd-4c68-92d0-939623bc6d8b None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:33.907255 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-5254c0e5-0efd-4c68-92d0-939623bc6d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:33.924527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:33.967319 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1347/2689] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:33.975799 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f884e-af09-4738-a8e8-15d3a58baec3 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:33.976098 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f884e-af09-4738-a8e8-15d3a58baec3 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:33.976367 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681f884e-af09-4738-a8e8-15d3a58baec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:33.994724 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-681f884e-af09-4738-a8e8-15d3a58baec3 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:34.002139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-681f884e-af09-4738-a8e8-15d3a58baec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:34.010164 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1343/2690] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:34.014692 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254c0e5-0efd-4c68-92d0-939623bc6d8b None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:34.025276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254c0e5-0efd-4c68-92d0-939623bc6d8b None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:34.029896 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08cfbb-760e-490d-a45b-5ae2530a19eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:34.030549 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08cfbb-760e-490d-a45b-5ae2530a19eb admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:34.030830 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08cfbb-760e-490d-a45b-5ae2530a19eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:34.031106 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad08cfbb-760e-490d-a45b-5ae2530a19eb admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:34.031968 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad08cfbb-760e-490d-a45b-5ae2530a19eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:38:34.032281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad08cfbb-760e-490d-a45b-5ae2530a19eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:34.033880 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad08cfbb-760e-490d-a45b-5ae2530a19eb admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:34.049992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1348/2691] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:38:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:38:34.054574 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f884e-af09-4738-a8e8-15d3a58baec3 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:34.063693 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681f884e-af09-4738-a8e8-15d3a58baec3 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:34.071255 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab30f1-795d-4214-8d1d-db64cfebda75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:34.071941 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab30f1-795d-4214-8d1d-db64cfebda75 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:34.072224 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab30f1-795d-4214-8d1d-db64cfebda75 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:34.072500 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfab30f1-795d-4214-8d1d-db64cfebda75 admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:34.073200 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab30f1-795d-4214-8d1d-db64cfebda75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:34.075115 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfab30f1-795d-4214-8d1d-db64cfebda75 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:34.103799 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1344/2692] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:38:34 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:38:34.104960 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08cfbb-760e-490d-a45b-5ae2530a19eb admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:34.114822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad08cfbb-760e-490d-a45b-5ae2530a19eb admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:34.170462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8782c1a-3ba7-401e-b49d-ea068c889116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:34.171127 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8782c1a-3ba7-401e-b49d-ea068c889116 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:34.171416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8782c1a-3ba7-401e-b49d-ea068c889116 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:34.171725 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8782c1a-3ba7-401e-b49d-ea068c889116 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:34.172434 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8782c1a-3ba7-401e-b49d-ea068c889116 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:34.174365 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8782c1a-3ba7-401e-b49d-ea068c889116 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:34.193839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1349/2693] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:38:34 2022] POST /identity/v3/users => generated 288 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:38:34.197866 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab30f1-795d-4214-8d1d-db64cfebda75 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:34.208727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfab30f1-795d-4214-8d1d-db64cfebda75 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:34.213399 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9ad11-e8a7-436e-9f6d-a8860cab2f4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:34.214072 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9ad11-e8a7-436e-9f6d-a8860cab2f4e admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:34.214344 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9ad11-e8a7-436e-9f6d-a8860cab2f4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:34.214662 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e9ad11-e8a7-436e-9f6d-a8860cab2f4e admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:34.215385 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9ad11-e8a7-436e-9f6d-a8860cab2f4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:34.217016 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e9ad11-e8a7-436e-9f6d-a8860cab2f4e admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:34.227287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1345/2694] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:38:34.230888 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8782c1a-3ba7-401e-b49d-ea068c889116 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:34.240722 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8782c1a-3ba7-401e-b49d-ea068c889116 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:34.245288 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccb971c-e5d3-490c-9341-0c3e4aa8c98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:34.245925 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb971c-e5d3-490c-9341-0c3e4aa8c98c admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:34.246215 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb971c-e5d3-490c-9341-0c3e4aa8c98c admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:34.246493 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccb971c-e5d3-490c-9341-0c3e4aa8c98c admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:34.247206 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb971c-e5d3-490c-9341-0c3e4aa8c98c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:34.248824 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccb971c-e5d3-490c-9341-0c3e4aa8c98c admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:34.259050 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1350/2695] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:38:34 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:38:34.263007 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9ad11-e8a7-436e-9f6d-a8860cab2f4e admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:34.273553 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e9ad11-e8a7-436e-9f6d-a8860cab2f4e admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:34.278207 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d99a0-297c-469d-8165-ff4902aee32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:34.279066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d99a0-297c-469d-8165-ff4902aee32a admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:34.279358 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d99a0-297c-469d-8165-ff4902aee32a admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:34.279692 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d99a0-297c-469d-8165-ff4902aee32a admin admin] PATH_INFO: `/v3/projects/e0d870e67f68470988dd26ac7aef3fec/users/c9f93af4621b4a9db098c299c9e32c20/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:34.294914 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d99a0-297c-469d-8165-ff4902aee32a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0d870e67f68470988dd26ac7aef3fec, user_id=c9f93af4621b4a9db098c299c9e32c20, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:34.297617 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d99a0-297c-469d-8165-ff4902aee32a admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:34.309848 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1346/2696] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:38:34 2022] PUT /identity/v3/projects/e0d870e67f68470988dd26ac7aef3fec/users/c9f93af4621b4a9db098c299c9e32c20/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:34.314735 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d9fe1-071e-4354-ab06-85f617f643d7 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:34.315026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d9fe1-071e-4354-ab06-85f617f643d7 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:34.315303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59d9fe1-071e-4354-ab06-85f617f643d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:34.333728 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-c59d9fe1-071e-4354-ab06-85f617f643d7 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:34.334914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-c59d9fe1-071e-4354-ab06-85f617f643d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:34.391741 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1351/2697] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:34.401641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d99a0-297c-469d-8165-ff4902aee32a admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:34.403330 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-607d99a0-297c-469d-8165-ff4902aee32a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:34.424651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:34.461651 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d99a0-297c-469d-8165-ff4902aee32a admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:34.465361 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478175c-a512-49ef-b738-df653de9d2a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:34.466003 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478175c-a512-49ef-b738-df653de9d2a0 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:34.466295 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478175c-a512-49ef-b738-df653de9d2a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:34.466579 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5478175c-a512-49ef-b738-df653de9d2a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:34.477138 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478175c-a512-49ef-b738-df653de9d2a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:34.478634 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5478175c-a512-49ef-b738-df653de9d2a0 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:34.488146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1347/2698] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:38:38.282852 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1a0cd-498f-4b4f-88dc-763012567d50 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:38.283356 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1a0cd-498f-4b4f-88dc-763012567d50 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:38.283356 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef1a0cd-498f-4b4f-88dc-763012567d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:38.347421 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-bef1a0cd-498f-4b4f-88dc-763012567d50 None None] MFA Rules not processed for user `c9f93af4621b4a9db098c299c9e32c20`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:38.349343 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-bef1a0cd-498f-4b4f-88dc-763012567d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:38.375271 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:38.428664 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1352/2699] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:38.432898 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478175c-a512-49ef-b738-df653de9d2a0 service neutron] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:38.443397 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5478175c-a512-49ef-b738-df653de9d2a0 service neutron] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:38.448156 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4991f9b-b86b-488c-b918-f20598a06988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:38.448814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4991f9b-b86b-488c-b918-f20598a06988 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:38.449102 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4991f9b-b86b-488c-b918-f20598a06988 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:38.449378 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4991f9b-b86b-488c-b918-f20598a06988 admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:38.450073 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4991f9b-b86b-488c-b918-f20598a06988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:38.451999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4991f9b-b86b-488c-b918-f20598a06988 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:38.479786 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1348/2700] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:38:38 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:38:38.483874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1a0cd-498f-4b4f-88dc-763012567d50 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:38.495473 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef1a0cd-498f-4b4f-88dc-763012567d50 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:38.555240 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77138e28-1272-4605-9922-c7510f4996de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:38.556191 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77138e28-1272-4605-9922-c7510f4996de admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:38.556641 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77138e28-1272-4605-9922-c7510f4996de admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:38.556923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77138e28-1272-4605-9922-c7510f4996de admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:38.557617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77138e28-1272-4605-9922-c7510f4996de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:38.559631 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77138e28-1272-4605-9922-c7510f4996de admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:38.580375 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1353/2701] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:38:38 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:38:38.584988 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4991f9b-b86b-488c-b918-f20598a06988 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:38.595661 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4991f9b-b86b-488c-b918-f20598a06988 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:38.600483 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd4887-5ed4-482f-893f-94622f649fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:38.601229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd4887-5ed4-482f-893f-94622f649fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:38.601522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd4887-5ed4-482f-893f-94622f649fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:38.601802 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfd4887-5ed4-482f-893f-94622f649fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:38.602536 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd4887-5ed4-482f-893f-94622f649fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:38.604175 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfd4887-5ed4-482f-893f-94622f649fe9 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:38.615829 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1349/2702] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:38:38.620038 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77138e28-1272-4605-9922-c7510f4996de admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:38.631181 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77138e28-1272-4605-9922-c7510f4996de admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:38.636024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899f829-1be8-4339-b203-cde64e7c7424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:38.636945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899f829-1be8-4339-b203-cde64e7c7424 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:38.637232 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899f829-1be8-4339-b203-cde64e7c7424 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:38.637546 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0899f829-1be8-4339-b203-cde64e7c7424 admin admin] PATH_INFO: `/v3/projects/4c2d99c1b5ea4df18e95adc54d0120be/users/a8337f188a2b4251a2f101fffeaa8ebf/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:38.654264 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899f829-1be8-4339-b203-cde64e7c7424 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c2d99c1b5ea4df18e95adc54d0120be, user_id=a8337f188a2b4251a2f101fffeaa8ebf, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:38.657047 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0899f829-1be8-4339-b203-cde64e7c7424 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:38.672640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1354/2703] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:38:38 2022] PUT /identity/v3/projects/4c2d99c1b5ea4df18e95adc54d0120be/users/a8337f188a2b4251a2f101fffeaa8ebf/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:38:38.680766 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd4887-5ed4-482f-893f-94622f649fe9 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:38.691922 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfd4887-5ed4-482f-893f-94622f649fe9 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:38.765102 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72ca841-9afa-43f0-b041-1d0eabe2cd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:38.766033 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ca841-9afa-43f0-b041-1d0eabe2cd4c admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:38.766316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ca841-9afa-43f0-b041-1d0eabe2cd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:38.766592 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72ca841-9afa-43f0-b041-1d0eabe2cd4c admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:38.767316 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ca841-9afa-43f0-b041-1d0eabe2cd4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:38.768946 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72ca841-9afa-43f0-b041-1d0eabe2cd4c admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:38.783111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1350/2704] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:38:38.784966 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899f829-1be8-4339-b203-cde64e7c7424 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:38.797483 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0899f829-1be8-4339-b203-cde64e7c7424 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:38.802644 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574a938-d6db-4843-a438-3c9597a2c489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:38.803648 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574a938-d6db-4843-a438-3c9597a2c489 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:38.804005 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574a938-d6db-4843-a438-3c9597a2c489 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:38.804352 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2574a938-d6db-4843-a438-3c9597a2c489 admin admin] PATH_INFO: `/v3/projects/4c2d99c1b5ea4df18e95adc54d0120be/users/a8337f188a2b4251a2f101fffeaa8ebf/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:38.806432 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574a938-d6db-4843-a438-3c9597a2c489 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c2d99c1b5ea4df18e95adc54d0120be, user_id=a8337f188a2b4251a2f101fffeaa8ebf, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:38.809216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2574a938-d6db-4843-a438-3c9597a2c489 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:38.821518 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1355/2705] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:38:38 2022] PUT /identity/v3/projects/4c2d99c1b5ea4df18e95adc54d0120be/users/a8337f188a2b4251a2f101fffeaa8ebf/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:42.884700 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ead52-d6e7-4168-a941-2ed9946715b9 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:42.885219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ead52-d6e7-4168-a941-2ed9946715b9 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:42.885346 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4ead52-d6e7-4168-a941-2ed9946715b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:42.914252 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-3e4ead52-d6e7-4168-a941-2ed9946715b9 None None] MFA Rules not processed for user `a8337f188a2b4251a2f101fffeaa8ebf`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:42.915507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-3e4ead52-d6e7-4168-a941-2ed9946715b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:42.985590 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1351/2706] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:42 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:43.002364 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574a938-d6db-4843-a438-3c9597a2c489 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:43.004303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-2574a938-d6db-4843-a438-3c9597a2c489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:43.080569 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2574a938-d6db-4843-a438-3c9597a2c489 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:43.086372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b901ee09-33bd-4c7f-b04f-e17fc82c60de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:43.087103 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901ee09-33bd-4c7f-b04f-e17fc82c60de service nova] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:43.087299 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901ee09-33bd-4c7f-b04f-e17fc82c60de service nova] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:43.087577 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b901ee09-33bd-4c7f-b04f-e17fc82c60de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:43.093569 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:43.148814 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901ee09-33bd-4c7f-b04f-e17fc82c60de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:43.150431 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b901ee09-33bd-4c7f-b04f-e17fc82c60de service nova] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:43.159593 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1356/2707] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:43 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:38:46.109072 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ead52-d6e7-4168-a941-2ed9946715b9 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:46.110560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-3e4ead52-d6e7-4168-a941-2ed9946715b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:46.124848 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:46.278015 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4ead52-d6e7-4168-a941-2ed9946715b9 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:46.283957 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d225e5-e6d6-48e4-8341-16b0ea315653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:46.285552 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d225e5-e6d6-48e4-8341-16b0ea315653 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:46.285985 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d225e5-e6d6-48e4-8341-16b0ea315653 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:46.286278 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d225e5-e6d6-48e4-8341-16b0ea315653 admin admin] PATH_INFO: `/v3/users/a5f5428cd91c4b21bf43e6fae79ef210` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:46.287847 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d225e5-e6d6-48e4-8341-16b0ea315653 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5f5428cd91c4b21bf43e6fae79ef210)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:46.292438 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d225e5-e6d6-48e4-8341-16b0ea315653 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:46.349110 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-72d225e5-e6d6-48e4-8341-16b0ea315653 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f5428cd91c4b21bf43e6fae79ef210'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:46.357330 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-72d225e5-e6d6-48e4-8341-16b0ea315653 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f5428cd91c4b21bf43e6fae79ef210'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:46.358099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-72d225e5-e6d6-48e4-8341-16b0ea315653 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f5428cd91c4b21bf43e6fae79ef210'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:46.361830 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-72d225e5-e6d6-48e4-8341-16b0ea315653 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f5428cd91c4b21bf43e6fae79ef210'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:46.377135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-72d225e5-e6d6-48e4-8341-16b0ea315653 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f5428cd91c4b21bf43e6fae79ef210'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:46.390727 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1352/2708] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:38:46 2022] DELETE /identity/v3/users/a5f5428cd91c4b21bf43e6fae79ef210 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:46.395865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5431e9-d61c-4a32-b1b7-6a82840ac66c None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:46.396357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5431e9-d61c-4a32-b1b7-6a82840ac66c None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:46.396491 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5431e9-d61c-4a32-b1b7-6a82840ac66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:46.427302 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-6d5431e9-d61c-4a32-b1b7-6a82840ac66c None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:46.428582 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-6d5431e9-d61c-4a32-b1b7-6a82840ac66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:46.491733 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1357/2709] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:46.501486 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d225e5-e6d6-48e4-8341-16b0ea315653 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:46.502921 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-72d225e5-e6d6-48e4-8341-16b0ea315653 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:46.553868 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:46.641996 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d225e5-e6d6-48e4-8341-16b0ea315653 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:46.646507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f803e3-c6ed-492a-8091-efb4da8c9b61 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:46.647346 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f803e3-c6ed-492a-8091-efb4da8c9b61 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:46.647730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f803e3-c6ed-492a-8091-efb4da8c9b61 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:46.651741 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f803e3-c6ed-492a-8091-efb4da8c9b61 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:46.666329 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f803e3-c6ed-492a-8091-efb4da8c9b61 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:46.667933 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f803e3-c6ed-492a-8091-efb4da8c9b61 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:46.680307 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1353/2710] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:38:47.030595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5431e9-d61c-4a32-b1b7-6a82840ac66c None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:47.035418 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-6d5431e9-d61c-4a32-b1b7-6a82840ac66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:47.056912 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5431e9-d61c-4a32-b1b7-6a82840ac66c None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:47.068762 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5277662-9e64-4b24-8c3b-763d5e81683c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:47.069970 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5277662-9e64-4b24-8c3b-763d5e81683c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:47.070637 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5277662-9e64-4b24-8c3b-763d5e81683c admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:47.071378 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5277662-9e64-4b24-8c3b-763d5e81683c admin admin] PATH_INFO: `/v3/projects/5b9ac26fe297412d901a726508e231d4` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:47.072693 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5277662-9e64-4b24-8c3b-763d5e81683c admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b9ac26fe297412d901a726508e231d4)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:47.074663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5277662-9e64-4b24-8c3b-763d5e81683c admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:47.146981 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-f5277662-9e64-4b24-8c3b-763d5e81683c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b9ac26fe297412d901a726508e231d4', 'request_id': 'req-f5277662-9e64-4b24-8c3b-763d5e81683c'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:47.155145 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-f5277662-9e64-4b24-8c3b-763d5e81683c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b9ac26fe297412d901a726508e231d4', 'request_id': 'req-f5277662-9e64-4b24-8c3b-763d5e81683c'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:47.162561 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-f5277662-9e64-4b24-8c3b-763d5e81683c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b9ac26fe297412d901a726508e231d4', 'request_id': 'req-f5277662-9e64-4b24-8c3b-763d5e81683c'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:47.179849 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-f5277662-9e64-4b24-8c3b-763d5e81683c admin admin] The token cache is being invalidate because project 5b9ac26fe297412d901a726508e231d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:38:47.180277 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-f5277662-9e64-4b24-8c3b-763d5e81683c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:47.181012 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-f5277662-9e64-4b24-8c3b-763d5e81683c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:38:47.183002 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1358/2711] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:38:47 2022] DELETE /identity/v3/projects/5b9ac26fe297412d901a726508e231d4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:47.188005 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41452d06-3d01-45fd-a963-b719b330c000 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:47.188946 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41452d06-3d01-45fd-a963-b719b330c000 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:47.189490 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41452d06-3d01-45fd-a963-b719b330c000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:47.233109 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-41452d06-3d01-45fd-a963-b719b330c000 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:47.234381 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-41452d06-3d01-45fd-a963-b719b330c000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:47.299063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1354/2712] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:38:47.307445 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14c85a-f861-443c-ac8c-e8f8aafeac79 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:47.307846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14c85a-f861-443c-ac8c-e8f8aafeac79 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:47.308198 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be14c85a-f861-443c-ac8c-e8f8aafeac79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:47.327191 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-be14c85a-f861-443c-ac8c-e8f8aafeac79 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:47.328573 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-be14c85a-f861-443c-ac8c-e8f8aafeac79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:47.337013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1359/2713] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:47.341356 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41452d06-3d01-45fd-a963-b719b330c000 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:47.352018 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41452d06-3d01-45fd-a963-b719b330c000 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:47.356867 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4ee6b-ca6e-43e2-8006-94a497a94766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:47.357544 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4ee6b-ca6e-43e2-8006-94a497a94766 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:47.357832 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4ee6b-ca6e-43e2-8006-94a497a94766 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:47.358112 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b4ee6b-ca6e-43e2-8006-94a497a94766 admin admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:47.358850 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4ee6b-ca6e-43e2-8006-94a497a94766 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:38:47.359160 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4ee6b-ca6e-43e2-8006-94a497a94766 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:47.360841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b4ee6b-ca6e-43e2-8006-94a497a94766 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:47.377600 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1355/2714] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:38:47.378728 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14c85a-f861-443c-ac8c-e8f8aafeac79 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:47.391211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be14c85a-f861-443c-ac8c-e8f8aafeac79 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:47.396331 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96d794-fb36-46aa-a44c-77d439e36150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:47.397108 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96d794-fb36-46aa-a44c-77d439e36150 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:47.397460 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96d794-fb36-46aa-a44c-77d439e36150 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:47.397865 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db96d794-fb36-46aa-a44c-77d439e36150 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:47.398641 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96d794-fb36-46aa-a44c-77d439e36150 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:47.400665 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db96d794-fb36-46aa-a44c-77d439e36150 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:47.416289 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:47.434580 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1360/2715] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:38:47 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:38:47.438662 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4ee6b-ca6e-43e2-8006-94a497a94766 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:47.449170 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b4ee6b-ca6e-43e2-8006-94a497a94766 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:47.512111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64619a56-828d-4ed0-93dd-d1762994acbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:47.512900 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64619a56-828d-4ed0-93dd-d1762994acbe admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:47.513273 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64619a56-828d-4ed0-93dd-d1762994acbe admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:47.513756 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64619a56-828d-4ed0-93dd-d1762994acbe admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:47.514610 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64619a56-828d-4ed0-93dd-d1762994acbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:47.517002 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64619a56-828d-4ed0-93dd-d1762994acbe admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:47.533359 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:47.543494 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1356/2716] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:38:47 2022] POST /identity/v3/users => generated 287 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:38:47.544599 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96d794-fb36-46aa-a44c-77d439e36150 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:47.555955 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db96d794-fb36-46aa-a44c-77d439e36150 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:47.566109 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c070522-b103-448f-a02f-421937a63a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:47.566801 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c070522-b103-448f-a02f-421937a63a62 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:47.567087 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c070522-b103-448f-a02f-421937a63a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:47.567364 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c070522-b103-448f-a02f-421937a63a62 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:47.568166 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c070522-b103-448f-a02f-421937a63a62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:47.569829 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c070522-b103-448f-a02f-421937a63a62 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:47.582217 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1361/2717] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:38:47.585191 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64619a56-828d-4ed0-93dd-d1762994acbe admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:47.595811 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64619a56-828d-4ed0-93dd-d1762994acbe admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:47.603659 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1644781-1332-4d69-9760-c1ba7760811b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:47.603659 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1644781-1332-4d69-9760-c1ba7760811b admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:47.603659 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1644781-1332-4d69-9760-c1ba7760811b admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:47.603659 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1644781-1332-4d69-9760-c1ba7760811b admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:47.604159 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1644781-1332-4d69-9760-c1ba7760811b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:47.605012 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1644781-1332-4d69-9760-c1ba7760811b admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:47.619084 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1357/2718] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:38:47.620522 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c070522-b103-448f-a02f-421937a63a62 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:47.631173 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c070522-b103-448f-a02f-421937a63a62 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:47.636016 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0896dbb-43fc-437d-87eb-f85fdb700250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:47.636913 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0896dbb-43fc-437d-87eb-f85fdb700250 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:47.637194 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0896dbb-43fc-437d-87eb-f85fdb700250 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:47.637469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0896dbb-43fc-437d-87eb-f85fdb700250 admin admin] PATH_INFO: `/v3/projects/8bf0fd6a893b43f3a62537f9abb82f34/users/59eccc7e263340c98313f65496e89fe3/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:47.655338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0896dbb-43fc-437d-87eb-f85fdb700250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bf0fd6a893b43f3a62537f9abb82f34, user_id=59eccc7e263340c98313f65496e89fe3, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:47.658108 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0896dbb-43fc-437d-87eb-f85fdb700250 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:47.671918 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1362/2719] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:38:47 2022] PUT /identity/v3/projects/8bf0fd6a893b43f3a62537f9abb82f34/users/59eccc7e263340c98313f65496e89fe3/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:38:47.683247 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7949c7-e329-4e9e-a61b-c217b98694b0 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:47.683550 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7949c7-e329-4e9e-a61b-c217b98694b0 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:47.683874 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7949c7-e329-4e9e-a61b-c217b98694b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:47.713844 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-6e7949c7-e329-4e9e-a61b-c217b98694b0 None None] MFA Rules not processed for user `59eccc7e263340c98313f65496e89fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:47.715068 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-6e7949c7-e329-4e9e-a61b-c217b98694b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:47.784144 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1358/2720] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:47 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:47.795367 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0896dbb-43fc-437d-87eb-f85fdb700250 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:47.797331 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e0896dbb-43fc-437d-87eb-f85fdb700250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:47.859043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0896dbb-43fc-437d-87eb-f85fdb700250 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:47.862767 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fbb5f-42bc-4b80-89c8-8fb505f860cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:47.863462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fbb5f-42bc-4b80-89c8-8fb505f860cc service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:47.863851 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fbb5f-42bc-4b80-89c8-8fb505f860cc service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:47.864156 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42fbb5f-42bc-4b80-89c8-8fb505f860cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:47.873822 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fbb5f-42bc-4b80-89c8-8fb505f860cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:47.875307 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42fbb5f-42bc-4b80-89c8-8fb505f860cc service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:47.884542 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1363/2721] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:47 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:38:49.299383 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ecf8c-8b2b-4530-8293-8b0289148f86 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:49.299954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ecf8c-8b2b-4530-8293-8b0289148f86 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:49.299954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ecf8c-8b2b-4530-8293-8b0289148f86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:49.317169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-b69ecf8c-8b2b-4530-8293-8b0289148f86 None None] MFA Rules not processed for user `59eccc7e263340c98313f65496e89fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:38:49.318365 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-b69ecf8c-8b2b-4530-8293-8b0289148f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:49.325145 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1359/2722] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:38:49 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:38:50.027013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fbb5f-42bc-4b80-89c8-8fb505f860cc service cinder] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:50.028434 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d42fbb5f-42bc-4b80-89c8-8fb505f860cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:50.101012 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42fbb5f-42bc-4b80-89c8-8fb505f860cc service cinder] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:50.106646 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90749629-acbc-49bc-a2e5-0925bee94583 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9164f14fe6894daba1a9f2d8f1f4929c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:50.107326 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90749629-acbc-49bc-a2e5-0925bee94583 service placement] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:50.107638 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90749629-acbc-49bc-a2e5-0925bee94583 service placement] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:50.107940 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90749629-acbc-49bc-a2e5-0925bee94583 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:50.109802 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-90749629-acbc-49bc-a2e5-0925bee94583 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:50.122526 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90749629-acbc-49bc-a2e5-0925bee94583 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:50.124160 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90749629-acbc-49bc-a2e5-0925bee94583 service placement] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:50.134730 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1364/2723] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:38:59.311975 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=41 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:38:59.373548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ecf8c-8b2b-4530-8293-8b0289148f86 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:38:59.375113 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-b69ecf8c-8b2b-4530-8293-8b0289148f86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:59.469024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ecf8c-8b2b-4530-8293-8b0289148f86 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:38:59.474373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389111f1-606e-4b18-aea2-b30983856534 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:38:59.475018 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389111f1-606e-4b18-aea2-b30983856534 service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:38:59.475298 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389111f1-606e-4b18-aea2-b30983856534 service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:38:59.475572 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389111f1-606e-4b18-aea2-b30983856534 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:38:59.477339 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-389111f1-606e-4b18-aea2-b30983856534 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:38:59.489009 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389111f1-606e-4b18-aea2-b30983856534 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:38:59.490610 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389111f1-606e-4b18-aea2-b30983856534 service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:38:59.501127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1360/2724] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:38:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:39:00.130411 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=75,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:06.629480 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b7081-f68b-4fca-935d-4b74da431597 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:06.630040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b7081-f68b-4fca-935d-4b74da431597 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:06.630040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b7081-f68b-4fca-935d-4b74da431597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:06.647436 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-371b7081-f68b-4fca-935d-4b74da431597 None None] MFA Rules not processed for user `39bbc5ff02d24f40b796bd2245a7431a`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:06.648659 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-371b7081-f68b-4fca-935d-4b74da431597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:06.706218 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1365/2725] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 00:39:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:06.753711 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389111f1-606e-4b18-aea2-b30983856534 service nova] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:06.755274 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-389111f1-606e-4b18-aea2-b30983856534 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:06.825621 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389111f1-606e-4b18-aea2-b30983856534 service nova] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:06.830659 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e58090-c284-4925-a21f-9a899173cd1d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918c4a8c6a64812b61fc235ab8e7bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:06.831352 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e58090-c284-4925-a21f-9a899173cd1d service swift] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:06.831669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e58090-c284-4925-a21f-9a899173cd1d service swift] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:06.831956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e58090-c284-4925-a21f-9a899173cd1d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:06.839882 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e58090-c284-4925-a21f-9a899173cd1d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:06.841467 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e58090-c284-4925-a21f-9a899173cd1d service swift] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:06.849884 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1361/2726] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 00:39:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 16 00:39:07.341313 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182fe72-79e8-4957-8365-f4db42ffaea3 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:07.341608 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182fe72-79e8-4957-8365-f4db42ffaea3 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:07.341893 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182fe72-79e8-4957-8365-f4db42ffaea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:07.359351 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-3182fe72-79e8-4957-8365-f4db42ffaea3 None None] MFA Rules not processed for user `39bbc5ff02d24f40b796bd2245a7431a`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:07.360594 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-3182fe72-79e8-4957-8365-f4db42ffaea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:07.368274 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1366/2727] 10.222.0.44 () {58 vars in 967 bytes} [Thu Jun 16 00:39:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:07.380726 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e58090-c284-4925-a21f-9a899173cd1d service swift] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:07.391356 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e58090-c284-4925-a21f-9a899173cd1d service swift] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:07.396377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1d9a2-eb8a-4625-931c-cdec6365cbb9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918c4a8c6a64812b61fc235ab8e7bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:07.397004 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1d9a2-eb8a-4625-931c-cdec6365cbb9 service swift] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:07.397289 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1d9a2-eb8a-4625-931c-cdec6365cbb9 service swift] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:07.397568 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c1d9a2-eb8a-4625-931c-cdec6365cbb9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:07.405445 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1d9a2-eb8a-4625-931c-cdec6365cbb9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:07.407051 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c1d9a2-eb8a-4625-931c-cdec6365cbb9 service swift] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:07.414963 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1362/2728] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 00:39:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:39:07.601198 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af141ee2-782e-4ab7-bd3a-c40b76fcb82e None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:07.601491 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af141ee2-782e-4ab7-bd3a-c40b76fcb82e None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:07.601798 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af141ee2-782e-4ab7-bd3a-c40b76fcb82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:07.618916 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-af141ee2-782e-4ab7-bd3a-c40b76fcb82e None None] MFA Rules not processed for user `39bbc5ff02d24f40b796bd2245a7431a`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:07.620165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-af141ee2-782e-4ab7-bd3a-c40b76fcb82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:07.627131 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1367/2729] 10.222.0.44 () {58 vars in 1009 bytes} [Thu Jun 16 00:39:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:07.639089 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1d9a2-eb8a-4625-931c-cdec6365cbb9 service swift] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:07.650283 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c1d9a2-eb8a-4625-931c-cdec6365cbb9 service swift] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:07.655197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fa65d-790d-41b2-948a-65bbbf7d538e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918c4a8c6a64812b61fc235ab8e7bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:07.655855 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fa65d-790d-41b2-948a-65bbbf7d538e service swift] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:07.656140 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fa65d-790d-41b2-948a-65bbbf7d538e service swift] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:07.656656 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fa65d-790d-41b2-948a-65bbbf7d538e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:07.666094 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fa65d-790d-41b2-948a-65bbbf7d538e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:07.667686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fa65d-790d-41b2-948a-65bbbf7d538e service swift] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:07.675550 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1363/2730] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 00:39:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:39:07.857013 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98e1cf-3320-4ce7-80d0-6ee61dc371cf None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:07.857496 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98e1cf-3320-4ce7-80d0-6ee61dc371cf None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:07.857599 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98e1cf-3320-4ce7-80d0-6ee61dc371cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:07.877682 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-6f98e1cf-3320-4ce7-80d0-6ee61dc371cf None None] MFA Rules not processed for user `c9f93af4621b4a9db098c299c9e32c20`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:07.879451 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-6f98e1cf-3320-4ce7-80d0-6ee61dc371cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:07.940600 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1368/2731] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:39:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:07.998555 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3824313-1373-44e0-aa31-5af8fcac9262 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:07.998975 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3824313-1373-44e0-aa31-5af8fcac9262 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:07.999124 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3824313-1373-44e0-aa31-5af8fcac9262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:08.017174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-b3824313-1373-44e0-aa31-5af8fcac9262 None None] MFA Rules not processed for user `39bbc5ff02d24f40b796bd2245a7431a`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:08.019186 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-b3824313-1373-44e0-aa31-5af8fcac9262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:08.026785 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1364/2732] 10.222.0.44 () {58 vars in 967 bytes} [Thu Jun 16 00:39:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:08.039873 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98e1cf-3320-4ce7-80d0-6ee61dc371cf None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:08.052429 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98e1cf-3320-4ce7-80d0-6ee61dc371cf None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:08.057609 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8782ae6-60d5-45ca-aa53-9dc27efc9972 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9918c4a8c6a64812b61fc235ab8e7bec', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:08.058261 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8782ae6-60d5-45ca-aa53-9dc27efc9972 service swift] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:08.058549 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8782ae6-60d5-45ca-aa53-9dc27efc9972 service swift] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:08.058828 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8782ae6-60d5-45ca-aa53-9dc27efc9972 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:08.068144 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8782ae6-60d5-45ca-aa53-9dc27efc9972 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:08.069747 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8782ae6-60d5-45ca-aa53-9dc27efc9972 service swift] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:08.078153 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1369/2733] 10.222.0.44 () {60 vars in 1384 bytes} [Thu Jun 16 00:39:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 16 00:39:08.270922 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3824313-1373-44e0-aa31-5af8fcac9262 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:08.272572 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-b3824313-1373-44e0-aa31-5af8fcac9262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:08.320670 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=100 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:08.333394 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3824313-1373-44e0-aa31-5af8fcac9262 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:08.337049 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44211402-5722-4296-a894-f0fb971b56c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:08.337708 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44211402-5722-4296-a894-f0fb971b56c5 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:08.337994 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44211402-5722-4296-a894-f0fb971b56c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:08.338280 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44211402-5722-4296-a894-f0fb971b56c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:08.340080 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-44211402-5722-4296-a894-f0fb971b56c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:08.350301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44211402-5722-4296-a894-f0fb971b56c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:08.352137 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44211402-5722-4296-a894-f0fb971b56c5 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:08.360673 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1365/2734] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:39:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:39:10.171524 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8782ae6-60d5-45ca-aa53-9dc27efc9972 service swift] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:10.234525 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8782ae6-60d5-45ca-aa53-9dc27efc9972 service swift] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:10.239217 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be84142-98d1-48b4-a405-70ed7e9c06f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:10.240128 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be84142-98d1-48b4-a405-70ed7e9c06f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:10.240412 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be84142-98d1-48b4-a405-70ed7e9c06f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:10.240691 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be84142-98d1-48b4-a405-70ed7e9c06f3 admin admin] PATH_INFO: `/v3/users/59eccc7e263340c98313f65496e89fe3` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:10.241966 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be84142-98d1-48b4-a405-70ed7e9c06f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59eccc7e263340c98313f65496e89fe3)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:10.243945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be84142-98d1-48b4-a405-70ed7e9c06f3 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:10.281161 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:10.303998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-9be84142-98d1-48b4-a405-70ed7e9c06f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59eccc7e263340c98313f65496e89fe3'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:39:10.312614 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-9be84142-98d1-48b4-a405-70ed7e9c06f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59eccc7e263340c98313f65496e89fe3'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:39:10.313338 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-9be84142-98d1-48b4-a405-70ed7e9c06f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59eccc7e263340c98313f65496e89fe3'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:39:10.327907 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-9be84142-98d1-48b4-a405-70ed7e9c06f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59eccc7e263340c98313f65496e89fe3'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:39:10.331060 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-9be84142-98d1-48b4-a405-70ed7e9c06f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59eccc7e263340c98313f65496e89fe3'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:39:10.345307 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1370/2735] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:39:10 2022] DELETE /identity/v3/users/59eccc7e263340c98313f65496e89fe3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:39:10.349928 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea082d-5bf2-4d5b-8f5d-3693a74a0f24 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:10.350432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea082d-5bf2-4d5b-8f5d-3693a74a0f24 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:10.350811 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea082d-5bf2-4d5b-8f5d-3693a74a0f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:10.370968 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-50ea082d-5bf2-4d5b-8f5d-3693a74a0f24 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:10.372485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-50ea082d-5bf2-4d5b-8f5d-3693a74a0f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:10.438526 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1366/2736] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:10.451515 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be84142-98d1-48b4-a405-70ed7e9c06f3 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:10.453673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-9be84142-98d1-48b4-a405-70ed7e9c06f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:10.526819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be84142-98d1-48b4-a405-70ed7e9c06f3 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:10.532025 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18138478-6141-4ae9-b2cc-cac1270d38b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:10.533181 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18138478-6141-4ae9-b2cc-cac1270d38b8 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:10.536242 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18138478-6141-4ae9-b2cc-cac1270d38b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:10.537345 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18138478-6141-4ae9-b2cc-cac1270d38b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:10.548945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18138478-6141-4ae9-b2cc-cac1270d38b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:10.551098 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18138478-6141-4ae9-b2cc-cac1270d38b8 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:10.562740 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1371/2737] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:39:10.766795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea082d-5bf2-4d5b-8f5d-3693a74a0f24 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:10.769235 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-50ea082d-5bf2-4d5b-8f5d-3693a74a0f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:10.781804 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea082d-5bf2-4d5b-8f5d-3693a74a0f24 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:10.787367 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92fcea-5e3b-4496-a511-4aa0ffa0b0c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:10.788374 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92fcea-5e3b-4496-a511-4aa0ffa0b0c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:10.788731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92fcea-5e3b-4496-a511-4aa0ffa0b0c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:10.789116 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d92fcea-5e3b-4496-a511-4aa0ffa0b0c3 admin admin] PATH_INFO: `/v3/projects/8bf0fd6a893b43f3a62537f9abb82f34` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:10.790434 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92fcea-5e3b-4496-a511-4aa0ffa0b0c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bf0fd6a893b43f3a62537f9abb82f34)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:10.792661 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d92fcea-5e3b-4496-a511-4aa0ffa0b0c3 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:10.845587 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4d92fcea-5e3b-4496-a511-4aa0ffa0b0c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bf0fd6a893b43f3a62537f9abb82f34', 'request_id': 'req-4d92fcea-5e3b-4496-a511-4aa0ffa0b0c3'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:39:10.852306 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4d92fcea-5e3b-4496-a511-4aa0ffa0b0c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bf0fd6a893b43f3a62537f9abb82f34', 'request_id': 'req-4d92fcea-5e3b-4496-a511-4aa0ffa0b0c3'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:39:10.857764 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4d92fcea-5e3b-4496-a511-4aa0ffa0b0c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bf0fd6a893b43f3a62537f9abb82f34', 'request_id': 'req-4d92fcea-5e3b-4496-a511-4aa0ffa0b0c3'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:39:10.872309 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4d92fcea-5e3b-4496-a511-4aa0ffa0b0c3 admin admin] The token cache is being invalidate because project 8bf0fd6a893b43f3a62537f9abb82f34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:39:10.872773 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4d92fcea-5e3b-4496-a511-4aa0ffa0b0c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:39:10.873442 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4d92fcea-5e3b-4496-a511-4aa0ffa0b0c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:39:10.875039 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1367/2738] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:39:10 2022] DELETE /identity/v3/projects/8bf0fd6a893b43f3a62537f9abb82f34 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:39:20.419230 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18138478-6141-4ae9-b2cc-cac1270d38b8 service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:20.420673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-18138478-6141-4ae9-b2cc-cac1270d38b8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:20.477175 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18138478-6141-4ae9-b2cc-cac1270d38b8 service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:20.524970 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbf1ef-32d0-4802-8f0a-fe106b4cf626 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:20.525646 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbf1ef-32d0-4802-8f0a-fe106b4cf626 service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:20.525931 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbf1ef-32d0-4802-8f0a-fe106b4cf626 service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:20.526210 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cbf1ef-32d0-4802-8f0a-fe106b4cf626 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:20.528066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a0cbf1ef-32d0-4802-8f0a-fe106b4cf626 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:20.542813 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:20.590016 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbf1ef-32d0-4802-8f0a-fe106b4cf626 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:20.591389 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cbf1ef-32d0-4802-8f0a-fe106b4cf626 service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:20.600879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1372/2739] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:39:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:39:20.868998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=61,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:23.466380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92fcea-5e3b-4496-a511-4aa0ffa0b0c3 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:23.467948 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-4d92fcea-5e3b-4496-a511-4aa0ffa0b0c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:23.546377 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d92fcea-5e3b-4496-a511-4aa0ffa0b0c3 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:23.554102 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4144a07d-6b77-4761-98c7-a22e34ac4009 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:23.555004 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144a07d-6b77-4761-98c7-a22e34ac4009 service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:23.555129 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144a07d-6b77-4761-98c7-a22e34ac4009 service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:23.555338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4144a07d-6b77-4761-98c7-a22e34ac4009 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:23.557472 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-4144a07d-6b77-4761-98c7-a22e34ac4009 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:23.572039 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144a07d-6b77-4761-98c7-a22e34ac4009 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:23.573627 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4144a07d-6b77-4761-98c7-a22e34ac4009 service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:23.586952 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1368/2740] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:39:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:39:24.513029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbf1ef-32d0-4802-8f0a-fe106b4cf626 service cinder] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:39:24.514809 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a0cbf1ef-32d0-4802-8f0a-fe106b4cf626 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:24.579900 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cbf1ef-32d0-4802-8f0a-fe106b4cf626 service cinder] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:39:24.584507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687d63f-2a9d-4a41-88fd-842a2f2a62ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:39:24.585369 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687d63f-2a9d-4a41-88fd-842a2f2a62ab service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:24.585835 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687d63f-2a9d-4a41-88fd-842a2f2a62ab service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:24.586276 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687d63f-2a9d-4a41-88fd-842a2f2a62ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:24.588144 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-2687d63f-2a9d-4a41-88fd-842a2f2a62ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:24.653773 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687d63f-2a9d-4a41-88fd-842a2f2a62ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:39:24.655222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2687d63f-2a9d-4a41-88fd-842a2f2a62ab service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:39:24.665906 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1373/2741] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:39:24 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:39:27.460710 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33d96c-3032-495e-bc94-c53984af8a41 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:39:27.461206 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33d96c-3032-495e-bc94-c53984af8a41 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:39:27.461317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33d96c-3032-495e-bc94-c53984af8a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:39:27.478307 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-9a33d96c-3032-495e-bc94-c53984af8a41 None None] MFA Rules not processed for user `9e3855abd7ea410fa64d546b3a85ff31`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:39:27.479516 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-9a33d96c-3032-495e-bc94-c53984af8a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:39:27.486318 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1369/2742] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:39:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:39:34.661240 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=70 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:39:37.473519 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=37 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:40:23.099157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687d63f-2a9d-4a41-88fd-842a2f2a62ab service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:40:23.101226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-2687d63f-2a9d-4a41-88fd-842a2f2a62ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:23.189729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687d63f-2a9d-4a41-88fd-842a2f2a62ab service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:40:23.194874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3a4d5-e892-46e1-b855-7ddecd469ec9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9164f14fe6894daba1a9f2d8f1f4929c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:40:23.195524 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3a4d5-e892-46e1-b855-7ddecd469ec9 service placement] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:40:23.195843 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3a4d5-e892-46e1-b855-7ddecd469ec9 service placement] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:40:23.196126 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3a4d5-e892-46e1-b855-7ddecd469ec9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:40:23.197911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-75c3a4d5-e892-46e1-b855-7ddecd469ec9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:40:23.209388 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3a4d5-e892-46e1-b855-7ddecd469ec9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:40:23.210972 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3a4d5-e892-46e1-b855-7ddecd469ec9 service placement] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:40:23.220879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1374/2743] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:40:23 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:40:33.216603 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=41 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:17.106120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33d96c-3032-495e-bc94-c53984af8a41 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:17.107503 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-9a33d96c-3032-495e-bc94-c53984af8a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:17.119254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33d96c-3032-495e-bc94-c53984af8a41 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:17.122827 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efaee9-df85-4cc9-8095-88770e455032 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:17.123460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efaee9-df85-4cc9-8095-88770e455032 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:17.123861 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efaee9-df85-4cc9-8095-88770e455032 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:17.124154 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41efaee9-df85-4cc9-8095-88770e455032 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:17.125863 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-41efaee9-df85-4cc9-8095-88770e455032 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:17.158626 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efaee9-df85-4cc9-8095-88770e455032 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:17.160096 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41efaee9-df85-4cc9-8095-88770e455032 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:17.179705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1370/2744] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:25.153527 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3a4d5-e892-46e1-b855-7ddecd469ec9 service placement] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:25.154934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-75c3a4d5-e892-46e1-b855-7ddecd469ec9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:25.166723 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3a4d5-e892-46e1-b855-7ddecd469ec9 service placement] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:25.171308 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03db704-541f-4d8f-a1fe-70ba9c4ea733 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:25.172341 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03db704-541f-4d8f-a1fe-70ba9c4ea733 service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:25.172341 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03db704-541f-4d8f-a1fe-70ba9c4ea733 service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:25.172688 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03db704-541f-4d8f-a1fe-70ba9c4ea733 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:25.174811 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-f03db704-541f-4d8f-a1fe-70ba9c4ea733 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:25.190018 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03db704-541f-4d8f-a1fe-70ba9c4ea733 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:25.191467 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03db704-541f-4d8f-a1fe-70ba9c4ea733 service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:25.202387 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1375/2745] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:25 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:27.177092 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=18 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:35.197499 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=6 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:37.955752 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efaee9-df85-4cc9-8095-88770e455032 service cinder] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:37.957269 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-41efaee9-df85-4cc9-8095-88770e455032 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:37.968605 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41efaee9-df85-4cc9-8095-88770e455032 service cinder] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:37.972130 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06372ac-3ae8-4d1a-a942-40e52d357fbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:37.972762 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06372ac-3ae8-4d1a-a942-40e52d357fbb service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:37.973046 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06372ac-3ae8-4d1a-a942-40e52d357fbb service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:37.973323 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06372ac-3ae8-4d1a-a942-40e52d357fbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:37.975002 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-c06372ac-3ae8-4d1a-a942-40e52d357fbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:38.037482 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06372ac-3ae8-4d1a-a942-40e52d357fbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:38.038941 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06372ac-3ae8-4d1a-a942-40e52d357fbb service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:38.049146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1371/2746] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:41.084288 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03db704-541f-4d8f-a1fe-70ba9c4ea733 service cinder] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:41.085872 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-f03db704-541f-4d8f-a1fe-70ba9c4ea733 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:41.100008 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03db704-541f-4d8f-a1fe-70ba9c4ea733 service cinder] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:41.105673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514595d8-2c8a-42b6-9ac8-46899059b3b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9164f14fe6894daba1a9f2d8f1f4929c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:41.106324 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514595d8-2c8a-42b6-9ac8-46899059b3b3 service placement] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:41.106613 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514595d8-2c8a-42b6-9ac8-46899059b3b3 service placement] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:41.106898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514595d8-2c8a-42b6-9ac8-46899059b3b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:41.108743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-514595d8-2c8a-42b6-9ac8-46899059b3b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:41.120737 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514595d8-2c8a-42b6-9ac8-46899059b3b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:41.122337 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514595d8-2c8a-42b6-9ac8-46899059b3b3 service placement] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:41.134573 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1376/2747] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:41 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:41.139758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06372ac-3ae8-4d1a-a942-40e52d357fbb service neutron] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:41.141263 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-c06372ac-3ae8-4d1a-a942-40e52d357fbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:41.154179 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06372ac-3ae8-4d1a-a942-40e52d357fbb service neutron] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:41.159197 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c876371d-16f9-4e24-a94f-2aded3f1904c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:41.160217 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876371d-16f9-4e24-a94f-2aded3f1904c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:41.160568 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876371d-16f9-4e24-a94f-2aded3f1904c admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:41.160915 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c876371d-16f9-4e24-a94f-2aded3f1904c admin admin] PATH_INFO: `/v3/users/9e3855abd7ea410fa64d546b3a85ff31` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:41.162178 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876371d-16f9-4e24-a94f-2aded3f1904c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e3855abd7ea410fa64d546b3a85ff31)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:41.164939 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c876371d-16f9-4e24-a94f-2aded3f1904c admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:41.215106 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c876371d-16f9-4e24-a94f-2aded3f1904c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e3855abd7ea410fa64d546b3a85ff31'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:41.222908 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c876371d-16f9-4e24-a94f-2aded3f1904c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e3855abd7ea410fa64d546b3a85ff31'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:41.223569 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c876371d-16f9-4e24-a94f-2aded3f1904c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e3855abd7ea410fa64d546b3a85ff31'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:41.224223 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c876371d-16f9-4e24-a94f-2aded3f1904c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e3855abd7ea410fa64d546b3a85ff31'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:41.238239 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-c876371d-16f9-4e24-a94f-2aded3f1904c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e3855abd7ea410fa64d546b3a85ff31'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:41.250640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1372/2748] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:41 2022] DELETE /identity/v3/users/9e3855abd7ea410fa64d546b3a85ff31 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:41.426592 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514595d8-2c8a-42b6-9ac8-46899059b3b3 service placement] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:41.438151 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514595d8-2c8a-42b6-9ac8-46899059b3b3 service placement] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:41.495061 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0187653-2557-4246-970a-7249af2c05eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:41.495979 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0187653-2557-4246-970a-7249af2c05eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:41.496292 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0187653-2557-4246-970a-7249af2c05eb admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:41.496564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0187653-2557-4246-970a-7249af2c05eb admin admin] PATH_INFO: `/v3/projects/985ab6e44f6d4425a2def9b3a52262d8` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:41.497817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0187653-2557-4246-970a-7249af2c05eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=985ab6e44f6d4425a2def9b3a52262d8)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:41.499835 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0187653-2557-4246-970a-7249af2c05eb admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:41.545211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-b0187653-2557-4246-970a-7249af2c05eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '985ab6e44f6d4425a2def9b3a52262d8', 'request_id': 'req-b0187653-2557-4246-970a-7249af2c05eb'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:41.550737 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-b0187653-2557-4246-970a-7249af2c05eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '985ab6e44f6d4425a2def9b3a52262d8', 'request_id': 'req-b0187653-2557-4246-970a-7249af2c05eb'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:41.556753 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-b0187653-2557-4246-970a-7249af2c05eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '985ab6e44f6d4425a2def9b3a52262d8', 'request_id': 'req-b0187653-2557-4246-970a-7249af2c05eb'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:41.568606 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-b0187653-2557-4246-970a-7249af2c05eb admin admin] The token cache is being invalidate because project 985ab6e44f6d4425a2def9b3a52262d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:41.568896 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-b0187653-2557-4246-970a-7249af2c05eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:41.569511 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-b0187653-2557-4246-970a-7249af2c05eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:41.571091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1377/2749] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:41 2022] DELETE /identity/v3/projects/985ab6e44f6d4425a2def9b3a52262d8 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:41.575997 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f439b4-5fd9-4d7b-a4d8-856db47a5d4e None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:41.576293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f439b4-5fd9-4d7b-a4d8-856db47a5d4e None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:41.576573 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f439b4-5fd9-4d7b-a4d8-856db47a5d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:41.605099 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-d0f439b4-5fd9-4d7b-a4d8-856db47a5d4e None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:41.606230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-d0f439b4-5fd9-4d7b-a4d8-856db47a5d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:41.656222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:41.667750 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1373/2750] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:41.675606 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f3540-4e16-4f38-9b6a-131732f32a2f None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:41.675913 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f3540-4e16-4f38-9b6a-131732f32a2f None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:41.676217 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f3540-4e16-4f38-9b6a-131732f32a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:41.694185 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-502f3540-4e16-4f38-9b6a-131732f32a2f None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:41.695938 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-502f3540-4e16-4f38-9b6a-131732f32a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:41.703811 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1378/2751] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:41:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:41.707913 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f439b4-5fd9-4d7b-a4d8-856db47a5d4e None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:41.718380 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f439b4-5fd9-4d7b-a4d8-856db47a5d4e None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:41.722978 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bcd4e-7a71-48de-8b8a-ff0fe0181c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:41.723656 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bcd4e-7a71-48de-8b8a-ff0fe0181c5b admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:41.723950 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bcd4e-7a71-48de-8b8a-ff0fe0181c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:41.724232 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533bcd4e-7a71-48de-8b8a-ff0fe0181c5b admin admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:41.724955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533bcd4e-7a71-48de-8b8a-ff0fe0181c5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:41:41.725268 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533bcd4e-7a71-48de-8b8a-ff0fe0181c5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:41.726857 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533bcd4e-7a71-48de-8b8a-ff0fe0181c5b admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:41.738465 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1374/2752] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:41:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:41:41.742752 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f3540-4e16-4f38-9b6a-131732f32a2f None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:41.752636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f3540-4e16-4f38-9b6a-131732f32a2f None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:41.757422 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fada9-8458-499c-9426-78b70bf25177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:41.758584 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fada9-8458-499c-9426-78b70bf25177 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:41.758902 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fada9-8458-499c-9426-78b70bf25177 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:41.759178 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fada9-8458-499c-9426-78b70bf25177 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:41.759898 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fada9-8458-499c-9426-78b70bf25177 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:41.762053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946fada9-8458-499c-9426-78b70bf25177 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:41.788003 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1379/2753] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:41 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:41.792161 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bcd4e-7a71-48de-8b8a-ff0fe0181c5b admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:41.803220 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533bcd4e-7a71-48de-8b8a-ff0fe0181c5b admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:41.860454 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b8200-ab7a-4e8e-b72d-8a2fa6b4743c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:41.861056 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b8200-ab7a-4e8e-b72d-8a2fa6b4743c admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:41.861342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b8200-ab7a-4e8e-b72d-8a2fa6b4743c admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:41.861621 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92b8200-ab7a-4e8e-b72d-8a2fa6b4743c admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:41.862302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b8200-ab7a-4e8e-b72d-8a2fa6b4743c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:41.864264 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92b8200-ab7a-4e8e-b72d-8a2fa6b4743c admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:41.882253 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1375/2754] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:41 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:41:41.887217 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fada9-8458-499c-9426-78b70bf25177 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:41.897625 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fada9-8458-499c-9426-78b70bf25177 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:41.902797 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331e77b-1caa-4f8f-a1f4-9b60e584feea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:41.903457 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331e77b-1caa-4f8f-a1f4-9b60e584feea admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:41.903768 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331e77b-1caa-4f8f-a1f4-9b60e584feea admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:41.904044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e331e77b-1caa-4f8f-a1f4-9b60e584feea admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:41.904762 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331e77b-1caa-4f8f-a1f4-9b60e584feea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:41.906379 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e331e77b-1caa-4f8f-a1f4-9b60e584feea admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:41.916554 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1380/2755] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:41.920484 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b8200-ab7a-4e8e-b72d-8a2fa6b4743c admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:41.930489 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92b8200-ab7a-4e8e-b72d-8a2fa6b4743c admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:41.935158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de991246-e015-4763-9d1e-03b058447f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:41.935840 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de991246-e015-4763-9d1e-03b058447f35 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:41.936128 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de991246-e015-4763-9d1e-03b058447f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:41.936406 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de991246-e015-4763-9d1e-03b058447f35 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:41.937131 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de991246-e015-4763-9d1e-03b058447f35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:41.938788 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de991246-e015-4763-9d1e-03b058447f35 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:41.949221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1376/2756] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:41.952958 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331e77b-1caa-4f8f-a1f4-9b60e584feea admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:41.964211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e331e77b-1caa-4f8f-a1f4-9b60e584feea admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:41.968742 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25503f71-b3f6-41b7-905c-86a8a1cc7ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:41.969707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25503f71-b3f6-41b7-905c-86a8a1cc7ed6 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:41.969989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25503f71-b3f6-41b7-905c-86a8a1cc7ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:41.970285 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25503f71-b3f6-41b7-905c-86a8a1cc7ed6 admin admin] PATH_INFO: `/v3/projects/1242c7490548422b8ac0a3bc8167b77c/users/9ddf6c35afdf4c8e9ae4de2ce7744119/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:41.985297 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25503f71-b3f6-41b7-905c-86a8a1cc7ed6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1242c7490548422b8ac0a3bc8167b77c, user_id=9ddf6c35afdf4c8e9ae4de2ce7744119, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:41.988012 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25503f71-b3f6-41b7-905c-86a8a1cc7ed6 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:42.001108 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1381/2757] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:41 2022] PUT /identity/v3/projects/1242c7490548422b8ac0a3bc8167b77c/users/9ddf6c35afdf4c8e9ae4de2ce7744119/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:42.012749 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380f8d0-776c-41d6-8473-f932bb55f5f8 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:42.013070 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380f8d0-776c-41d6-8473-f932bb55f5f8 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:42.013350 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380f8d0-776c-41d6-8473-f932bb55f5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:42.038973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-d380f8d0-776c-41d6-8473-f932bb55f5f8 None None] MFA Rules not processed for user `9ddf6c35afdf4c8e9ae4de2ce7744119`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:42.040237 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-d380f8d0-776c-41d6-8473-f932bb55f5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:42.107001 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1377/2758] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:41:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:41:42.111640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25503f71-b3f6-41b7-905c-86a8a1cc7ed6 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:42.126190 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:42.177402 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25503f71-b3f6-41b7-905c-86a8a1cc7ed6 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:42.182695 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11ab3c-d15e-42e1-8feb-83eb20e6203f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:42.183360 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11ab3c-d15e-42e1-8feb-83eb20e6203f admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:42.183672 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11ab3c-d15e-42e1-8feb-83eb20e6203f admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:42.183957 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11ab3c-d15e-42e1-8feb-83eb20e6203f admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:42.184646 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11ab3c-d15e-42e1-8feb-83eb20e6203f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:42.186562 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11ab3c-d15e-42e1-8feb-83eb20e6203f admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:42.213049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1382/2759] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:42 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:41:42.217094 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380f8d0-776c-41d6-8473-f932bb55f5f8 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:42.227694 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d380f8d0-776c-41d6-8473-f932bb55f5f8 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:42.274135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:42.284485 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b3446-27b5-41e0-a1ed-fa94ac3148d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:42.285156 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b3446-27b5-41e0-a1ed-fa94ac3148d1 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:42.285439 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b3446-27b5-41e0-a1ed-fa94ac3148d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:42.285715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429b3446-27b5-41e0-a1ed-fa94ac3148d1 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:42.286402 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b3446-27b5-41e0-a1ed-fa94ac3148d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:42.288388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429b3446-27b5-41e0-a1ed-fa94ac3148d1 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:42.308076 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1378/2760] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:42 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:41:42.311960 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11ab3c-d15e-42e1-8feb-83eb20e6203f admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:42.322617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11ab3c-d15e-42e1-8feb-83eb20e6203f admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:42.327150 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c24ceb-f396-4a7e-a063-7892b8e9c0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:42.327834 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c24ceb-f396-4a7e-a063-7892b8e9c0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:42.328117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c24ceb-f396-4a7e-a063-7892b8e9c0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:42.328392 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c24ceb-f396-4a7e-a063-7892b8e9c0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:42.329113 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c24ceb-f396-4a7e-a063-7892b8e9c0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:42.330702 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c24ceb-f396-4a7e-a063-7892b8e9c0d8 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:42.341054 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1383/2761] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:42.345065 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b3446-27b5-41e0-a1ed-fa94ac3148d1 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:42.356266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429b3446-27b5-41e0-a1ed-fa94ac3148d1 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:42.360955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94197c-5715-4885-a583-9604d2a06284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:42.361896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94197c-5715-4885-a583-9604d2a06284 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:42.362118 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94197c-5715-4885-a583-9604d2a06284 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:42.362406 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f94197c-5715-4885-a583-9604d2a06284 admin admin] PATH_INFO: `/v3/projects/c889e6de06574191b1c6479acea105e7/users/a1330172feb1472ba8a8f75bc885598e/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:42.377719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94197c-5715-4885-a583-9604d2a06284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c889e6de06574191b1c6479acea105e7, user_id=a1330172feb1472ba8a8f75bc885598e, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:42.380895 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f94197c-5715-4885-a583-9604d2a06284 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:42.394074 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1379/2762] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:42 2022] PUT /identity/v3/projects/c889e6de06574191b1c6479acea105e7/users/a1330172feb1472ba8a8f75bc885598e/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:42.397932 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c24ceb-f396-4a7e-a063-7892b8e9c0d8 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:42.407886 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c24ceb-f396-4a7e-a063-7892b8e9c0d8 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:42.462823 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cc0dc4-ef54-4191-84b1-9b6480a8f9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:42.463713 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc0dc4-ef54-4191-84b1-9b6480a8f9e8 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:42.464030 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc0dc4-ef54-4191-84b1-9b6480a8f9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:42.464315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cc0dc4-ef54-4191-84b1-9b6480a8f9e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:42.465048 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc0dc4-ef54-4191-84b1-9b6480a8f9e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:42.466718 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cc0dc4-ef54-4191-84b1-9b6480a8f9e8 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:42.477123 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1384/2763] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:42.481343 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94197c-5715-4885-a583-9604d2a06284 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:42.491462 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f94197c-5715-4885-a583-9604d2a06284 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:42.496624 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602af54b-37c9-466a-87c9-df1dadeb3088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:42.497637 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602af54b-37c9-466a-87c9-df1dadeb3088 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:42.497924 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602af54b-37c9-466a-87c9-df1dadeb3088 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:42.498208 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602af54b-37c9-466a-87c9-df1dadeb3088 admin admin] PATH_INFO: `/v3/projects/c889e6de06574191b1c6479acea105e7/users/a1330172feb1472ba8a8f75bc885598e/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:42.500261 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602af54b-37c9-466a-87c9-df1dadeb3088 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c889e6de06574191b1c6479acea105e7, user_id=a1330172feb1472ba8a8f75bc885598e, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:42.502883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602af54b-37c9-466a-87c9-df1dadeb3088 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:42.513192 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1380/2764] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:42 2022] PUT /identity/v3/projects/c889e6de06574191b1c6479acea105e7/users/a1330172feb1472ba8a8f75bc885598e/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:42.523000 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1daf4b-14b8-41d4-876a-78556eef83ed None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:42.523325 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1daf4b-14b8-41d4-876a-78556eef83ed None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:42.523606 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1daf4b-14b8-41d4-876a-78556eef83ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:42.550604 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-0a1daf4b-14b8-41d4-876a-78556eef83ed None None] MFA Rules not processed for user `a1330172feb1472ba8a8f75bc885598e`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:42.551819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-0a1daf4b-14b8-41d4-876a-78556eef83ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:42.618364 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1385/2765] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:41:42 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:42.629432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602af54b-37c9-466a-87c9-df1dadeb3088 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:42.631175 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-602af54b-37c9-466a-87c9-df1dadeb3088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:42.696401 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602af54b-37c9-466a-87c9-df1dadeb3088 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:42.700418 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5301d4-b934-4c6e-9135-7090a26ae0e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:42.701109 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5301d4-b934-4c6e-9135-7090a26ae0e3 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:42.701424 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5301d4-b934-4c6e-9135-7090a26ae0e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:42.701766 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5301d4-b934-4c6e-9135-7090a26ae0e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:42.711334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5301d4-b934-4c6e-9135-7090a26ae0e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:42.712797 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5301d4-b934-4c6e-9135-7090a26ae0e3 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:42.722215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1381/2766] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:42 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:43.097538 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1daf4b-14b8-41d4-876a-78556eef83ed None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:43.107536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:43.160293 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1daf4b-14b8-41d4-876a-78556eef83ed None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:43.164816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffb622-8ff2-4350-bf77-593bc45728e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:43.165676 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffb622-8ff2-4350-bf77-593bc45728e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:43.165964 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffb622-8ff2-4350-bf77-593bc45728e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:43.166243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ffb622-8ff2-4350-bf77-593bc45728e1 admin admin] PATH_INFO: `/v3/users/9ddf6c35afdf4c8e9ae4de2ce7744119` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:43.167434 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ffb622-8ff2-4350-bf77-593bc45728e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ddf6c35afdf4c8e9ae4de2ce7744119)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:43.169406 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ffb622-8ff2-4350-bf77-593bc45728e1 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:43.215232 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-e7ffb622-8ff2-4350-bf77-593bc45728e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ddf6c35afdf4c8e9ae4de2ce7744119'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:43.222735 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-e7ffb622-8ff2-4350-bf77-593bc45728e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ddf6c35afdf4c8e9ae4de2ce7744119'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:43.223372 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-e7ffb622-8ff2-4350-bf77-593bc45728e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ddf6c35afdf4c8e9ae4de2ce7744119'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:43.235641 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-e7ffb622-8ff2-4350-bf77-593bc45728e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ddf6c35afdf4c8e9ae4de2ce7744119'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:43.236274 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-e7ffb622-8ff2-4350-bf77-593bc45728e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ddf6c35afdf4c8e9ae4de2ce7744119'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:43.248846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1386/2767] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:43 2022] DELETE /identity/v3/users/9ddf6c35afdf4c8e9ae4de2ce7744119 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:43.253301 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a3c7c-1076-404f-b00d-0a1ae00b5977 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:43.253759 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a3c7c-1076-404f-b00d-0a1ae00b5977 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:43.253883 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51a3c7c-1076-404f-b00d-0a1ae00b5977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:43.271843 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-e51a3c7c-1076-404f-b00d-0a1ae00b5977 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:43.273047 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-e51a3c7c-1076-404f-b00d-0a1ae00b5977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:43.331799 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1382/2768] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:41:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:43.342058 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffb622-8ff2-4350-bf77-593bc45728e1 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:43.343513 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-e7ffb622-8ff2-4350-bf77-593bc45728e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:43.400646 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ffb622-8ff2-4350-bf77-593bc45728e1 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:43.405003 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77856dca-b5c3-466f-9a17-25810fe1f1fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:43.405653 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77856dca-b5c3-466f-9a17-25810fe1f1fa service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:43.405938 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77856dca-b5c3-466f-9a17-25810fe1f1fa service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:43.406216 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77856dca-b5c3-466f-9a17-25810fe1f1fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:43.416045 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77856dca-b5c3-466f-9a17-25810fe1f1fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:43.417421 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77856dca-b5c3-466f-9a17-25810fe1f1fa service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:43.426894 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1387/2769] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:43.691533 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a3c7c-1076-404f-b00d-0a1ae00b5977 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:43.693452 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-e51a3c7c-1076-404f-b00d-0a1ae00b5977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:43.709584 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51a3c7c-1076-404f-b00d-0a1ae00b5977 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:43.715698 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197debb6-ec33-4366-8c3c-0687622ccc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:43.716777 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197debb6-ec33-4366-8c3c-0687622ccc63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:43.717153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197debb6-ec33-4366-8c3c-0687622ccc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:43.717653 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197debb6-ec33-4366-8c3c-0687622ccc63 admin admin] PATH_INFO: `/v3/projects/1242c7490548422b8ac0a3bc8167b77c` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:43.719068 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197debb6-ec33-4366-8c3c-0687622ccc63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1242c7490548422b8ac0a3bc8167b77c)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:43.721079 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197debb6-ec33-4366-8c3c-0687622ccc63 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:43.764094 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:43.767719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-197debb6-ec33-4366-8c3c-0687622ccc63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1242c7490548422b8ac0a3bc8167b77c', 'request_id': 'req-197debb6-ec33-4366-8c3c-0687622ccc63'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:43.774830 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-197debb6-ec33-4366-8c3c-0687622ccc63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1242c7490548422b8ac0a3bc8167b77c', 'request_id': 'req-197debb6-ec33-4366-8c3c-0687622ccc63'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:43.780922 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-197debb6-ec33-4366-8c3c-0687622ccc63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1242c7490548422b8ac0a3bc8167b77c', 'request_id': 'req-197debb6-ec33-4366-8c3c-0687622ccc63'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:43.794358 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-197debb6-ec33-4366-8c3c-0687622ccc63 admin admin] The token cache is being invalidate because project 1242c7490548422b8ac0a3bc8167b77c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:43.794658 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-197debb6-ec33-4366-8c3c-0687622ccc63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:43.795289 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-197debb6-ec33-4366-8c3c-0687622ccc63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:43.796864 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1383/2770] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:43 2022] DELETE /identity/v3/projects/1242c7490548422b8ac0a3bc8167b77c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:43.800945 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77856dca-b5c3-466f-9a17-25810fe1f1fa service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:43.810607 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77856dca-b5c3-466f-9a17-25810fe1f1fa service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:43.838765 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:43.868247 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdda3c9-1eab-4de4-8f56-0c5dc5ec3d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:43.869118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdda3c9-1eab-4de4-8f56-0c5dc5ec3d15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:43.869404 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdda3c9-1eab-4de4-8f56-0c5dc5ec3d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:43.869685 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdda3c9-1eab-4de4-8f56-0c5dc5ec3d15 admin admin] PATH_INFO: `/v3/users/a1330172feb1472ba8a8f75bc885598e` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:43.870861 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdda3c9-1eab-4de4-8f56-0c5dc5ec3d15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1330172feb1472ba8a8f75bc885598e)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:43.873194 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdda3c9-1eab-4de4-8f56-0c5dc5ec3d15 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:43.918665 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-6cdda3c9-1eab-4de4-8f56-0c5dc5ec3d15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1330172feb1472ba8a8f75bc885598e'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:43.927058 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-6cdda3c9-1eab-4de4-8f56-0c5dc5ec3d15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1330172feb1472ba8a8f75bc885598e'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:43.927855 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-6cdda3c9-1eab-4de4-8f56-0c5dc5ec3d15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1330172feb1472ba8a8f75bc885598e'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:43.939998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-6cdda3c9-1eab-4de4-8f56-0c5dc5ec3d15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1330172feb1472ba8a8f75bc885598e'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:43.940573 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-6cdda3c9-1eab-4de4-8f56-0c5dc5ec3d15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1330172feb1472ba8a8f75bc885598e'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:43.953428 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1388/2771] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:43 2022] DELETE /identity/v3/users/a1330172feb1472ba8a8f75bc885598e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:44.215390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197debb6-ec33-4366-8c3c-0687622ccc63 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:44.216881 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-197debb6-ec33-4366-8c3c-0687622ccc63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:44.230361 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197debb6-ec33-4366-8c3c-0687622ccc63 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:44.285677 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7e3e30-611a-42a9-bd3b-bca96fbbb8f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:44.286538 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e3e30-611a-42a9-bd3b-bca96fbbb8f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:44.286821 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e3e30-611a-42a9-bd3b-bca96fbbb8f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:44.287096 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7e3e30-611a-42a9-bd3b-bca96fbbb8f0 admin admin] PATH_INFO: `/v3/projects/c889e6de06574191b1c6479acea105e7` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:44.288284 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e3e30-611a-42a9-bd3b-bca96fbbb8f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c889e6de06574191b1c6479acea105e7)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:44.290775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7e3e30-611a-42a9-bd3b-bca96fbbb8f0 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:44.336278 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-5d7e3e30-611a-42a9-bd3b-bca96fbbb8f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c889e6de06574191b1c6479acea105e7', 'request_id': 'req-5d7e3e30-611a-42a9-bd3b-bca96fbbb8f0'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:44.341880 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-5d7e3e30-611a-42a9-bd3b-bca96fbbb8f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c889e6de06574191b1c6479acea105e7', 'request_id': 'req-5d7e3e30-611a-42a9-bd3b-bca96fbbb8f0'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:44.347836 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-5d7e3e30-611a-42a9-bd3b-bca96fbbb8f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c889e6de06574191b1c6479acea105e7', 'request_id': 'req-5d7e3e30-611a-42a9-bd3b-bca96fbbb8f0'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:44.361233 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-5d7e3e30-611a-42a9-bd3b-bca96fbbb8f0 admin admin] The token cache is being invalidate because project c889e6de06574191b1c6479acea105e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:44.361525 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-5d7e3e30-611a-42a9-bd3b-bca96fbbb8f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:44.362156 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-5d7e3e30-611a-42a9-bd3b-bca96fbbb8f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:44.363730 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1384/2772] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:44 2022] DELETE /identity/v3/projects/c889e6de06574191b1c6479acea105e7 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:41:44.368663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26d783-3066-4bab-badc-465a7998da30 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:44.369140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26d783-3066-4bab-badc-465a7998da30 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:44.369255 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26d783-3066-4bab-badc-465a7998da30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:44.387378 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-9e26d783-3066-4bab-badc-465a7998da30 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:44.388712 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-9e26d783-3066-4bab-badc-465a7998da30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:44.447139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1389/2773] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:44.454885 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aac43a-aecb-4375-8bac-00ba13b28d01 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:44.455180 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aac43a-aecb-4375-8bac-00ba13b28d01 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:44.455463 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aac43a-aecb-4375-8bac-00ba13b28d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:44.474073 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-45aac43a-aecb-4375-8bac-00ba13b28d01 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:44.475218 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-45aac43a-aecb-4375-8bac-00ba13b28d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:44.483785 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1385/2774] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:41:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:44.487801 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26d783-3066-4bab-badc-465a7998da30 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:44.497358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26d783-3066-4bab-badc-465a7998da30 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:44.501963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41e9ec-e3d7-479c-8a6f-c453d871ed84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:44.502608 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41e9ec-e3d7-479c-8a6f-c453d871ed84 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:44.502889 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41e9ec-e3d7-479c-8a6f-c453d871ed84 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:44.503163 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c41e9ec-e3d7-479c-8a6f-c453d871ed84 admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:44.503914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41e9ec-e3d7-479c-8a6f-c453d871ed84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:41:44.504237 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41e9ec-e3d7-479c-8a6f-c453d871ed84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:44.505820 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c41e9ec-e3d7-479c-8a6f-c453d871ed84 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:44.517302 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1390/2775] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:41:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:41:44.525500 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aac43a-aecb-4375-8bac-00ba13b28d01 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:44.530990 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aac43a-aecb-4375-8bac-00ba13b28d01 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:44.535877 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a9cb8-a4ac-4d74-ac87-6c1dca236ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:44.536528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a9cb8-a4ac-4d74-ac87-6c1dca236ea0 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:44.536814 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a9cb8-a4ac-4d74-ac87-6c1dca236ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:44.537093 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9a9cb8-a4ac-4d74-ac87-6c1dca236ea0 admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:44.537794 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a9cb8-a4ac-4d74-ac87-6c1dca236ea0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:44.540371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9a9cb8-a4ac-4d74-ac87-6c1dca236ea0 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:44.565122 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1386/2776] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:44 2022] POST /identity/v3/projects => generated 379 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:41:44.569158 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41e9ec-e3d7-479c-8a6f-c453d871ed84 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:44.578914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c41e9ec-e3d7-479c-8a6f-c453d871ed84 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:44.611933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:44.637006 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3e7cb-73ce-4b14-9575-591f7e4063ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:44.637677 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3e7cb-73ce-4b14-9575-591f7e4063ac admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:44.637960 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3e7cb-73ce-4b14-9575-591f7e4063ac admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:44.638236 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac3e7cb-73ce-4b14-9575-591f7e4063ac admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:44.638933 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3e7cb-73ce-4b14-9575-591f7e4063ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:44.640891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac3e7cb-73ce-4b14-9575-591f7e4063ac admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:44.661095 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1391/2777] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:44 2022] POST /identity/v3/users => generated 290 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:44.664453 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a9cb8-a4ac-4d74-ac87-6c1dca236ea0 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:44.674774 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9a9cb8-a4ac-4d74-ac87-6c1dca236ea0 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:44.679465 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd2114-c8a3-44c5-a02d-6f49f60fd672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:44.680142 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd2114-c8a3-44c5-a02d-6f49f60fd672 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:44.680426 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd2114-c8a3-44c5-a02d-6f49f60fd672 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:44.680701 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd2114-c8a3-44c5-a02d-6f49f60fd672 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:44.681423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd2114-c8a3-44c5-a02d-6f49f60fd672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:44.683019 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd2114-c8a3-44c5-a02d-6f49f60fd672 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:44.700174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1387/2778] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:44.704273 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3e7cb-73ce-4b14-9575-591f7e4063ac admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:44.714939 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac3e7cb-73ce-4b14-9575-591f7e4063ac admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:44.719883 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4b7696-113c-4439-9aa8-bc4f206243bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:44.720536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b7696-113c-4439-9aa8-bc4f206243bc admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:44.720818 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b7696-113c-4439-9aa8-bc4f206243bc admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:44.721095 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4b7696-113c-4439-9aa8-bc4f206243bc admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:44.721814 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b7696-113c-4439-9aa8-bc4f206243bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:44.723410 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4b7696-113c-4439-9aa8-bc4f206243bc admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:44.733396 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1392/2779] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:44.737293 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd2114-c8a3-44c5-a02d-6f49f60fd672 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:44.747369 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd2114-c8a3-44c5-a02d-6f49f60fd672 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:44.752330 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3c62e-f857-4136-b150-f0f591adbd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:44.753212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3c62e-f857-4136-b150-f0f591adbd2a admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:44.753501 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3c62e-f857-4136-b150-f0f591adbd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:44.753782 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3c62e-f857-4136-b150-f0f591adbd2a admin admin] PATH_INFO: `/v3/projects/99bcd28737a44cc7aa41fa03ff00cc7e/users/18820eec48294fe58a6f618e3b775302/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:44.769323 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3c62e-f857-4136-b150-f0f591adbd2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=99bcd28737a44cc7aa41fa03ff00cc7e, user_id=18820eec48294fe58a6f618e3b775302, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:44.772036 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f3c62e-f857-4136-b150-f0f591adbd2a admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:44.780595 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:44.789306 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1388/2780] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:44 2022] PUT /identity/v3/projects/99bcd28737a44cc7aa41fa03ff00cc7e/users/18820eec48294fe58a6f618e3b775302/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:44.800595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaaafc-f547-4506-afcb-93d293003437 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:44.800995 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaaafc-f547-4506-afcb-93d293003437 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:44.801163 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefaaafc-f547-4506-afcb-93d293003437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:44.827757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-cefaaafc-f547-4506-afcb-93d293003437 None None] MFA Rules not processed for user `18820eec48294fe58a6f618e3b775302`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:44.828970 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-cefaaafc-f547-4506-afcb-93d293003437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:44.893051 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1393/2781] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:41:44 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:44.897423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3c62e-f857-4136-b150-f0f591adbd2a admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:44.959289 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3c62e-f857-4136-b150-f0f591adbd2a admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:44.964701 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d40ad-b0ed-49eb-bdd6-c4015d1c39ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:44.965364 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d40ad-b0ed-49eb-bdd6-c4015d1c39ca admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:44.965661 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d40ad-b0ed-49eb-bdd6-c4015d1c39ca admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:44.965946 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6d40ad-b0ed-49eb-bdd6-c4015d1c39ca admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:44.966639 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d40ad-b0ed-49eb-bdd6-c4015d1c39ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:44.968583 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6d40ad-b0ed-49eb-bdd6-c4015d1c39ca admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:44.994198 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1389/2782] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:44 2022] POST /identity/v3/projects => generated 379 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:44.998178 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefaaafc-f547-4506-afcb-93d293003437 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:45.009443 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefaaafc-f547-4506-afcb-93d293003437 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:45.066529 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706aabd-ed53-464e-9f14-e75bebf91c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:45.067211 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706aabd-ed53-464e-9f14-e75bebf91c42 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:45.067501 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706aabd-ed53-464e-9f14-e75bebf91c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:45.067816 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7706aabd-ed53-464e-9f14-e75bebf91c42 admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:45.068500 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706aabd-ed53-464e-9f14-e75bebf91c42 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:45.071091 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7706aabd-ed53-464e-9f14-e75bebf91c42 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:45.092765 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1394/2783] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:44 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:45.097115 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d40ad-b0ed-49eb-bdd6-c4015d1c39ca admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:45.108279 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6d40ad-b0ed-49eb-bdd6-c4015d1c39ca admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:45.113417 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b8b98-aedd-4ddc-b966-63976a69ff15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:45.114176 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b8b98-aedd-4ddc-b966-63976a69ff15 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:45.114466 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b8b98-aedd-4ddc-b966-63976a69ff15 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:45.114751 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b8b98-aedd-4ddc-b966-63976a69ff15 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:45.115557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b8b98-aedd-4ddc-b966-63976a69ff15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:45.117759 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b8b98-aedd-4ddc-b966-63976a69ff15 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:45.130638 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1390/2784] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:45.134851 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706aabd-ed53-464e-9f14-e75bebf91c42 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:45.146807 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7706aabd-ed53-464e-9f14-e75bebf91c42 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:45.151787 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9ef6c-bb01-4ed6-95f2-b4a6cb545b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:45.152689 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9ef6c-bb01-4ed6-95f2-b4a6cb545b4e admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:45.152974 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9ef6c-bb01-4ed6-95f2-b4a6cb545b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:45.153291 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9ef6c-bb01-4ed6-95f2-b4a6cb545b4e admin admin] PATH_INFO: `/v3/projects/9738fded539345a488ee4884f6f7437c/users/989a33fcb6c544faa3e571667f277002/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:45.170007 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9ef6c-bb01-4ed6-95f2-b4a6cb545b4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9738fded539345a488ee4884f6f7437c, user_id=989a33fcb6c544faa3e571667f277002, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:45.173317 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be9ef6c-bb01-4ed6-95f2-b4a6cb545b4e admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:45.189371 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1395/2785] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:45 2022] PUT /identity/v3/projects/9738fded539345a488ee4884f6f7437c/users/989a33fcb6c544faa3e571667f277002/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:45.193027 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b8b98-aedd-4ddc-b966-63976a69ff15 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:45.203706 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b8b98-aedd-4ddc-b966-63976a69ff15 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:45.262297 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a4bd6f-bf3c-4341-a007-e9dcc034b290 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:45.262898 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4bd6f-bf3c-4341-a007-e9dcc034b290 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:45.263195 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4bd6f-bf3c-4341-a007-e9dcc034b290 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:45.263479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a4bd6f-bf3c-4341-a007-e9dcc034b290 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:45.264271 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4bd6f-bf3c-4341-a007-e9dcc034b290 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:45.265955 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a4bd6f-bf3c-4341-a007-e9dcc034b290 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:45.276421 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1391/2786] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:45 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:45.280382 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9ef6c-bb01-4ed6-95f2-b4a6cb545b4e admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:45.291256 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9ef6c-bb01-4ed6-95f2-b4a6cb545b4e admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:45.296474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4a52c-585a-4aab-9dbd-e627047c80a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:45.297360 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4a52c-585a-4aab-9dbd-e627047c80a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:45.297648 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4a52c-585a-4aab-9dbd-e627047c80a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:45.297998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b4a52c-585a-4aab-9dbd-e627047c80a7 admin admin] PATH_INFO: `/v3/projects/9738fded539345a488ee4884f6f7437c/users/989a33fcb6c544faa3e571667f277002/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:45.300157 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4a52c-585a-4aab-9dbd-e627047c80a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9738fded539345a488ee4884f6f7437c, user_id=989a33fcb6c544faa3e571667f277002, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:45.302836 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b4a52c-585a-4aab-9dbd-e627047c80a7 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:45.308963 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:45.314553 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1396/2787] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:45 2022] PUT /identity/v3/projects/9738fded539345a488ee4884f6f7437c/users/989a33fcb6c544faa3e571667f277002/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:45.325433 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a1fe5-fb4c-4c44-a4ae-ebf7af5e3103 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:45.325926 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a1fe5-fb4c-4c44-a4ae-ebf7af5e3103 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:45.326036 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a1fe5-fb4c-4c44-a4ae-ebf7af5e3103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:45.353557 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-3f4a1fe5-fb4c-4c44-a4ae-ebf7af5e3103 None None] MFA Rules not processed for user `989a33fcb6c544faa3e571667f277002`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:45.354763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-3f4a1fe5-fb4c-4c44-a4ae-ebf7af5e3103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:45.411376 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:45.423430 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1392/2788] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:41:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:45.436002 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4a52c-585a-4aab-9dbd-e627047c80a7 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:45.437736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-97b4a52c-585a-4aab-9dbd-e627047c80a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:45.493056 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b4a52c-585a-4aab-9dbd-e627047c80a7 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:45.496718 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946bd62-3318-49aa-8bc6-5a5894dcf500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:45.497352 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946bd62-3318-49aa-8bc6-5a5894dcf500 service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:45.497639 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946bd62-3318-49aa-8bc6-5a5894dcf500 service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:45.497917 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946bd62-3318-49aa-8bc6-5a5894dcf500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:45.506753 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946bd62-3318-49aa-8bc6-5a5894dcf500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:45.508315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946bd62-3318-49aa-8bc6-5a5894dcf500 service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:45.517934 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1397/2789] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:45 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:45.814747 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a1fe5-fb4c-4c44-a4ae-ebf7af5e3103 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:45.824071 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a1fe5-fb4c-4c44-a4ae-ebf7af5e3103 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:45.828623 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8d566-b71e-4ba8-9405-3b56c6a5a4cd tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989a33fcb6c544faa3e571667f277002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9738fded539345a488ee4884f6f7437c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:45.829284 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8d566-b71e-4ba8-9405-3b56c6a5a4cd tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:45.829574 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8d566-b71e-4ba8-9405-3b56c6a5a4cd tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:45.829858 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac8d566-b71e-4ba8-9405-3b56c6a5a4cd tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:45.830596 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8d566-b71e-4ba8-9405-3b56c6a5a4cd tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:41:45.830916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8d566-b71e-4ba8-9405-3b56c6a5a4cd tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:45.832548 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac8d566-b71e-4ba8-9405-3b56c6a5a4cd tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:45.844322 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1393/2790] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:41:45.848364 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946bd62-3318-49aa-8bc6-5a5894dcf500 service cinder] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:45.858200 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946bd62-3318-49aa-8bc6-5a5894dcf500 service cinder] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:45.862789 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7672e-fd80-402a-b5b3-dcaeb10b4f6f tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989a33fcb6c544faa3e571667f277002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9738fded539345a488ee4884f6f7437c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:45.863438 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7672e-fd80-402a-b5b3-dcaeb10b4f6f tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:45.863769 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7672e-fd80-402a-b5b3-dcaeb10b4f6f tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:45.864054 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae7672e-fd80-402a-b5b3-dcaeb10b4f6f tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:45.864751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7672e-fd80-402a-b5b3-dcaeb10b4f6f tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:45.866681 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae7672e-fd80-402a-b5b3-dcaeb10b4f6f tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:45.893305 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1398/2791] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:45 2022] POST /identity/v3/projects => generated 354 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:45.897470 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8d566-b71e-4ba8-9405-3b56c6a5a4cd tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:45.907867 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac8d566-b71e-4ba8-9405-3b56c6a5a4cd tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:45.962529 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb8da2-d3e2-4351-8910-cca2d81980e3 tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989a33fcb6c544faa3e571667f277002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9738fded539345a488ee4884f6f7437c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:45.963207 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb8da2-d3e2-4351-8910-cca2d81980e3 tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:45.963493 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb8da2-d3e2-4351-8910-cca2d81980e3 tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:45.963805 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb8da2-d3e2-4351-8910-cca2d81980e3 tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:45.964528 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb8da2-d3e2-4351-8910-cca2d81980e3 tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:41:45.964838 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb8da2-d3e2-4351-8910-cca2d81980e3 tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:45.966417 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb8da2-d3e2-4351-8910-cca2d81980e3 tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:45.977982 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1394/2792] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:41:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:41:46.012589 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7672e-fd80-402a-b5b3-dcaeb10b4f6f tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:46.022943 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae7672e-fd80-402a-b5b3-dcaeb10b4f6f tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:46.028222 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f7e0e-12dc-4d3a-9575-529a5230e4e3 tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '989a33fcb6c544faa3e571667f277002', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9738fded539345a488ee4884f6f7437c', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:46.029029 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f7e0e-12dc-4d3a-9575-529a5230e4e3 tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:46.029319 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f7e0e-12dc-4d3a-9575-529a5230e4e3 tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:46.029597 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f7e0e-12dc-4d3a-9575-529a5230e4e3 tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] PATH_INFO: `/v3/projects/6d3f2b4495394d23a4b8117439377e61` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:46.030793 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f7e0e-12dc-4d3a-9575-529a5230e4e3 tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6d3f2b4495394d23a4b8117439377e61)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:46.032740 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f7e0e-12dc-4d3a-9575-529a5230e4e3 tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:46.078959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-234f7e0e-12dc-4d3a-9575-529a5230e4e3 tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d3f2b4495394d23a4b8117439377e61', 'request_id': 'req-234f7e0e-12dc-4d3a-9575-529a5230e4e3'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:46.084590 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-234f7e0e-12dc-4d3a-9575-529a5230e4e3 tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d3f2b4495394d23a4b8117439377e61', 'request_id': 'req-234f7e0e-12dc-4d3a-9575-529a5230e4e3'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:46.090919 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-234f7e0e-12dc-4d3a-9575-529a5230e4e3 tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d3f2b4495394d23a4b8117439377e61', 'request_id': 'req-234f7e0e-12dc-4d3a-9575-529a5230e4e3'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:46.103283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-234f7e0e-12dc-4d3a-9575-529a5230e4e3 tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] The token cache is being invalidate because project 6d3f2b4495394d23a4b8117439377e61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:46.103572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-234f7e0e-12dc-4d3a-9575-529a5230e4e3 tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:46.104225 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-234f7e0e-12dc-4d3a-9575-529a5230e4e3 tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:46.105760 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1399/2793] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:46 2022] DELETE /identity/v3/projects/6d3f2b4495394d23a4b8117439377e61 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:46.288115 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb8da2-d3e2-4351-8910-cca2d81980e3 tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:46.290723 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-67bb8da2-d3e2-4351-8910-cca2d81980e3 tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:46.357265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb8da2-d3e2-4351-8910-cca2d81980e3 tempest-VolumeQuotaClassesTest-195888661 tempest-VolumeQuotaClassesTest-195888661-project-admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:46.415251 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0ec65-8611-49e3-8a88-38816bf4add2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:46.416266 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0ec65-8611-49e3-8a88-38816bf4add2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:46.416556 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0ec65-8611-49e3-8a88-38816bf4add2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:46.416827 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0ec65-8611-49e3-8a88-38816bf4add2 admin admin] PATH_INFO: `/v3/users/18820eec48294fe58a6f618e3b775302` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:46.418023 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0ec65-8611-49e3-8a88-38816bf4add2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18820eec48294fe58a6f618e3b775302)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:46.420012 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0ec65-8611-49e3-8a88-38816bf4add2 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:46.443958 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:46.476451 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-27a0ec65-8611-49e3-8a88-38816bf4add2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18820eec48294fe58a6f618e3b775302'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:46.483429 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-27a0ec65-8611-49e3-8a88-38816bf4add2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18820eec48294fe58a6f618e3b775302'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:46.484061 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-27a0ec65-8611-49e3-8a88-38816bf4add2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18820eec48294fe58a6f618e3b775302'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:46.484650 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-27a0ec65-8611-49e3-8a88-38816bf4add2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18820eec48294fe58a6f618e3b775302'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:46.496834 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-27a0ec65-8611-49e3-8a88-38816bf4add2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18820eec48294fe58a6f618e3b775302'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:46.509282 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1395/2794] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:46 2022] DELETE /identity/v3/users/18820eec48294fe58a6f618e3b775302 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:46.513947 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b81ce5-b33b-40d4-ab16-8cf5266a0d05 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:46.514429 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b81ce5-b33b-40d4-ab16-8cf5266a0d05 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:46.514543 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b81ce5-b33b-40d4-ab16-8cf5266a0d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:46.531583 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-79b81ce5-b33b-40d4-ab16-8cf5266a0d05 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:46.532812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-79b81ce5-b33b-40d4-ab16-8cf5266a0d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:46.590751 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1400/2795] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:41:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:46.600547 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0ec65-8611-49e3-8a88-38816bf4add2 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:46.602278 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-27a0ec65-8611-49e3-8a88-38816bf4add2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:46.658692 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0ec65-8611-49e3-8a88-38816bf4add2 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:46.662901 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86dd003-e093-4412-a773-b417762f83ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:46.663591 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dd003-e093-4412-a773-b417762f83ba service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:46.663876 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dd003-e093-4412-a773-b417762f83ba service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:46.664232 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86dd003-e093-4412-a773-b417762f83ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:46.675245 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86dd003-e093-4412-a773-b417762f83ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:46.676726 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86dd003-e093-4412-a773-b417762f83ba service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:46.686588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1396/2796] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:46.967183 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b81ce5-b33b-40d4-ab16-8cf5266a0d05 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:46.968737 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-79b81ce5-b33b-40d4-ab16-8cf5266a0d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:46.977593 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:46.994148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b81ce5-b33b-40d4-ab16-8cf5266a0d05 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:46.999539 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7c840-545d-4d1f-a0c1-632596e9535e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:47.000575 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7c840-545d-4d1f-a0c1-632596e9535e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:47.000925 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7c840-545d-4d1f-a0c1-632596e9535e admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:47.001274 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab7c840-545d-4d1f-a0c1-632596e9535e admin admin] PATH_INFO: `/v3/projects/99bcd28737a44cc7aa41fa03ff00cc7e` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:47.002537 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7c840-545d-4d1f-a0c1-632596e9535e admin admin] RBAC: Authorizing `identity:delete_project(project_id=99bcd28737a44cc7aa41fa03ff00cc7e)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:47.004595 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab7c840-545d-4d1f-a0c1-632596e9535e admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:47.053594 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2ab7c840-545d-4d1f-a0c1-632596e9535e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99bcd28737a44cc7aa41fa03ff00cc7e', 'request_id': 'req-2ab7c840-545d-4d1f-a0c1-632596e9535e'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:47.060323 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2ab7c840-545d-4d1f-a0c1-632596e9535e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99bcd28737a44cc7aa41fa03ff00cc7e', 'request_id': 'req-2ab7c840-545d-4d1f-a0c1-632596e9535e'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:47.066459 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2ab7c840-545d-4d1f-a0c1-632596e9535e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99bcd28737a44cc7aa41fa03ff00cc7e', 'request_id': 'req-2ab7c840-545d-4d1f-a0c1-632596e9535e'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:47.079045 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2ab7c840-545d-4d1f-a0c1-632596e9535e admin admin] The token cache is being invalidate because project 99bcd28737a44cc7aa41fa03ff00cc7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:47.079331 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2ab7c840-545d-4d1f-a0c1-632596e9535e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:47.079975 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2ab7c840-545d-4d1f-a0c1-632596e9535e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:47.081521 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1401/2797] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:46 2022] DELETE /identity/v3/projects/99bcd28737a44cc7aa41fa03ff00cc7e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:47.085507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86dd003-e093-4412-a773-b417762f83ba service neutron] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:47.095153 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86dd003-e093-4412-a773-b417762f83ba service neutron] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:47.152140 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdfbff-1579-4064-b3fb-f5a21f833a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:47.153024 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdfbff-1579-4064-b3fb-f5a21f833a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:47.153310 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdfbff-1579-4064-b3fb-f5a21f833a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:47.153588 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdfbff-1579-4064-b3fb-f5a21f833a73 admin admin] PATH_INFO: `/v3/users/989a33fcb6c544faa3e571667f277002` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:47.154896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdfbff-1579-4064-b3fb-f5a21f833a73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=989a33fcb6c544faa3e571667f277002)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:47.156876 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdfbff-1579-4064-b3fb-f5a21f833a73 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:47.205073 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:47.207148 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-94fdfbff-1579-4064-b3fb-f5a21f833a73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '989a33fcb6c544faa3e571667f277002'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:47.216716 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-94fdfbff-1579-4064-b3fb-f5a21f833a73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '989a33fcb6c544faa3e571667f277002'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:47.217725 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-94fdfbff-1579-4064-b3fb-f5a21f833a73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '989a33fcb6c544faa3e571667f277002'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:47.218697 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-94fdfbff-1579-4064-b3fb-f5a21f833a73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '989a33fcb6c544faa3e571667f277002'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:47.231433 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-94fdfbff-1579-4064-b3fb-f5a21f833a73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '989a33fcb6c544faa3e571667f277002'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:47.244697 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1397/2798] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:47 2022] DELETE /identity/v3/users/989a33fcb6c544faa3e571667f277002 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:47.537252 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7c840-545d-4d1f-a0c1-632596e9535e admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:47.539456 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-2ab7c840-545d-4d1f-a0c1-632596e9535e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:47.556175 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab7c840-545d-4d1f-a0c1-632596e9535e admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:47.630180 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eca0990-c218-4687-89f5-6b010f496d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:47.631166 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca0990-c218-4687-89f5-6b010f496d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:47.631522 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca0990-c218-4687-89f5-6b010f496d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:47.631838 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eca0990-c218-4687-89f5-6b010f496d98 admin admin] PATH_INFO: `/v3/projects/9738fded539345a488ee4884f6f7437c` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:47.633558 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca0990-c218-4687-89f5-6b010f496d98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9738fded539345a488ee4884f6f7437c)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:47.635857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eca0990-c218-4687-89f5-6b010f496d98 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:47.683993 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2eca0990-c218-4687-89f5-6b010f496d98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9738fded539345a488ee4884f6f7437c', 'request_id': 'req-2eca0990-c218-4687-89f5-6b010f496d98'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:47.690523 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2eca0990-c218-4687-89f5-6b010f496d98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9738fded539345a488ee4884f6f7437c', 'request_id': 'req-2eca0990-c218-4687-89f5-6b010f496d98'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:47.697998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2eca0990-c218-4687-89f5-6b010f496d98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9738fded539345a488ee4884f6f7437c', 'request_id': 'req-2eca0990-c218-4687-89f5-6b010f496d98'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:47.711759 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2eca0990-c218-4687-89f5-6b010f496d98 admin admin] The token cache is being invalidate because project 9738fded539345a488ee4884f6f7437c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:47.712062 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2eca0990-c218-4687-89f5-6b010f496d98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:47.712834 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-2eca0990-c218-4687-89f5-6b010f496d98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:47.714904 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1402/2799] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:47 2022] DELETE /identity/v3/projects/9738fded539345a488ee4884f6f7437c => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:47.719720 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9548b41-fcad-4e68-9c7a-29bc7d0e3521 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:47.720216 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9548b41-fcad-4e68-9c7a-29bc7d0e3521 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:47.720216 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9548b41-fcad-4e68-9c7a-29bc7d0e3521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:47.740335 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-c9548b41-fcad-4e68-9c7a-29bc7d0e3521 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:47.741561 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-c9548b41-fcad-4e68-9c7a-29bc7d0e3521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:47.817959 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1398/2800] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:47.826401 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf614d42-893b-46ea-aecc-c066ea65f69d None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:47.826899 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf614d42-893b-46ea-aecc-c066ea65f69d None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:47.827022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf614d42-893b-46ea-aecc-c066ea65f69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:47.854118 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-cf614d42-893b-46ea-aecc-c066ea65f69d None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:47.855358 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-cf614d42-893b-46ea-aecc-c066ea65f69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:47.864360 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1403/2801] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:41:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:47.868832 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9548b41-fcad-4e68-9c7a-29bc7d0e3521 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:47.879865 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9548b41-fcad-4e68-9c7a-29bc7d0e3521 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:47.887169 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b16df3-b569-40bb-baef-838864e64041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:47.888364 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b16df3-b569-40bb-baef-838864e64041 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:47.888868 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b16df3-b569-40bb-baef-838864e64041 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:47.889366 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b16df3-b569-40bb-baef-838864e64041 admin admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:47.890391 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b16df3-b569-40bb-baef-838864e64041 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:41:47.890912 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b16df3-b569-40bb-baef-838864e64041 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:47.892868 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b16df3-b569-40bb-baef-838864e64041 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:47.909709 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1399/2802] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:41:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:41:47.916028 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf614d42-893b-46ea-aecc-c066ea65f69d None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:47.923813 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf614d42-893b-46ea-aecc-c066ea65f69d None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:47.928728 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8e128-c58e-490e-99b0-de70a1ae69f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:47.929444 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8e128-c58e-490e-99b0-de70a1ae69f3 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:47.929735 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8e128-c58e-490e-99b0-de70a1ae69f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:47.930017 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a8e128-c58e-490e-99b0-de70a1ae69f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:47.930894 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8e128-c58e-490e-99b0-de70a1ae69f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:47.932887 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a8e128-c58e-490e-99b0-de70a1ae69f3 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:47.938049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:47.974748 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1404/2803] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:47 2022] POST /identity/v3/projects => generated 407 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:47.978971 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b16df3-b569-40bb-baef-838864e64041 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:47.989802 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b16df3-b569-40bb-baef-838864e64041 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:48.056187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af9c02-a2ca-4fd7-b386-821e0824d8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:48.056870 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af9c02-a2ca-4fd7-b386-821e0824d8e5 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:48.057201 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af9c02-a2ca-4fd7-b386-821e0824d8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:48.057454 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1af9c02-a2ca-4fd7-b386-821e0824d8e5 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:48.058112 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af9c02-a2ca-4fd7-b386-821e0824d8e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:48.060435 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1af9c02-a2ca-4fd7-b386-821e0824d8e5 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:48.083109 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1400/2804] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:47 2022] POST /identity/v3/users => generated 304 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:48.087294 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8e128-c58e-490e-99b0-de70a1ae69f3 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:48.098979 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a8e128-c58e-490e-99b0-de70a1ae69f3 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:48.105415 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7826a-15e2-4c2e-8227-ad73ea99e1a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:48.106184 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7826a-15e2-4c2e-8227-ad73ea99e1a8 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:48.106692 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7826a-15e2-4c2e-8227-ad73ea99e1a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:48.106879 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c7826a-15e2-4c2e-8227-ad73ea99e1a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:48.107959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7826a-15e2-4c2e-8227-ad73ea99e1a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:48.109797 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c7826a-15e2-4c2e-8227-ad73ea99e1a8 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:48.121968 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1405/2805] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:48.125774 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af9c02-a2ca-4fd7-b386-821e0824d8e5 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:48.137614 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1af9c02-a2ca-4fd7-b386-821e0824d8e5 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:48.142464 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf71173-3e53-44a8-95f5-fb9848c60494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:48.143148 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf71173-3e53-44a8-95f5-fb9848c60494 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:48.143606 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf71173-3e53-44a8-95f5-fb9848c60494 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:48.143930 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf71173-3e53-44a8-95f5-fb9848c60494 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:48.144680 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf71173-3e53-44a8-95f5-fb9848c60494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:48.146296 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf71173-3e53-44a8-95f5-fb9848c60494 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:48.160466 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1401/2806] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:48.165322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7826a-15e2-4c2e-8227-ad73ea99e1a8 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:48.176078 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c7826a-15e2-4c2e-8227-ad73ea99e1a8 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:48.181341 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88738cca-7702-4926-a867-5ac726c12dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:48.182269 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88738cca-7702-4926-a867-5ac726c12dc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:48.182559 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88738cca-7702-4926-a867-5ac726c12dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:48.182839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88738cca-7702-4926-a867-5ac726c12dc2 admin admin] PATH_INFO: `/v3/projects/c545ddd0eb4f417aac1f20e00b1f2e61/users/161160ecb73e4c94963be42eb842a3bc/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:48.200187 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88738cca-7702-4926-a867-5ac726c12dc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c545ddd0eb4f417aac1f20e00b1f2e61, user_id=161160ecb73e4c94963be42eb842a3bc, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:48.202982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88738cca-7702-4926-a867-5ac726c12dc2 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:48.218462 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1406/2807] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:48 2022] PUT /identity/v3/projects/c545ddd0eb4f417aac1f20e00b1f2e61/users/161160ecb73e4c94963be42eb842a3bc/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:48.229853 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba91283-8059-4dc3-9696-a93a2470bc6f None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:48.230147 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba91283-8059-4dc3-9696-a93a2470bc6f None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:48.230427 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba91283-8059-4dc3-9696-a93a2470bc6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:48.258695 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-fba91283-8059-4dc3-9696-a93a2470bc6f None None] MFA Rules not processed for user `161160ecb73e4c94963be42eb842a3bc`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:48.259959 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-fba91283-8059-4dc3-9696-a93a2470bc6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:48.276713 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:48.327981 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1402/2808] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:41:48 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:41:48.332475 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88738cca-7702-4926-a867-5ac726c12dc2 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:48.394993 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88738cca-7702-4926-a867-5ac726c12dc2 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:48.399931 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de537e-04fe-4afc-ab27-0ad6528bd6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:48.400625 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de537e-04fe-4afc-ab27-0ad6528bd6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:48.400914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de537e-04fe-4afc-ab27-0ad6528bd6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:48.401334 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14de537e-04fe-4afc-ab27-0ad6528bd6b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:48.401946 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de537e-04fe-4afc-ab27-0ad6528bd6b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:48.403913 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14de537e-04fe-4afc-ab27-0ad6528bd6b8 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:48.435320 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1407/2809] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:41:48 2022] POST /identity/v3/projects => generated 409 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:48.435723 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba91283-8059-4dc3-9696-a93a2470bc6f None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:48.447693 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba91283-8059-4dc3-9696-a93a2470bc6f None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:48.511332 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305a62e-d41e-4fda-bb21-99d96d9cb0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:48.512066 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305a62e-d41e-4fda-bb21-99d96d9cb0d9 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:48.512370 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305a62e-d41e-4fda-bb21-99d96d9cb0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:48.512647 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a305a62e-d41e-4fda-bb21-99d96d9cb0d9 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:48.513355 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305a62e-d41e-4fda-bb21-99d96d9cb0d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:48.515317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a305a62e-d41e-4fda-bb21-99d96d9cb0d9 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:48.537913 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1403/2810] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:41:48 2022] POST /identity/v3/users => generated 311 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:41:48.542267 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de537e-04fe-4afc-ab27-0ad6528bd6b8 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:48.554003 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14de537e-04fe-4afc-ab27-0ad6528bd6b8 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:48.561178 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064bf41-c25f-4575-86df-d359d0e9158a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:48.561890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064bf41-c25f-4575-86df-d359d0e9158a admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:48.562159 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064bf41-c25f-4575-86df-d359d0e9158a admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:48.562440 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d064bf41-c25f-4575-86df-d359d0e9158a admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:48.563176 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064bf41-c25f-4575-86df-d359d0e9158a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:48.564870 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d064bf41-c25f-4575-86df-d359d0e9158a admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:48.577185 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1408/2811] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:41:48.581131 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305a62e-d41e-4fda-bb21-99d96d9cb0d9 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:48.594646 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a305a62e-d41e-4fda-bb21-99d96d9cb0d9 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:48.599798 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1047d14-3a30-4f91-b990-162741afd871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:48.600798 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1047d14-3a30-4f91-b990-162741afd871 admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:48.601771 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1047d14-3a30-4f91-b990-162741afd871 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:48.602062 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1047d14-3a30-4f91-b990-162741afd871 admin admin] PATH_INFO: `/v3/projects/01693272cb1341e8b6fd7bfef76c4c53/users/745295c49c0d490cb6d8c1a94b263d58/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:48.636476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1047d14-3a30-4f91-b990-162741afd871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01693272cb1341e8b6fd7bfef76c4c53, user_id=745295c49c0d490cb6d8c1a94b263d58, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:48.639187 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1047d14-3a30-4f91-b990-162741afd871 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:48.654522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1404/2812] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:48 2022] PUT /identity/v3/projects/01693272cb1341e8b6fd7bfef76c4c53/users/745295c49c0d490cb6d8c1a94b263d58/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:48.660032 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064bf41-c25f-4575-86df-d359d0e9158a admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:48.664929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610d738-f596-483d-bdc1-253580942e32 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:48.665391 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610d738-f596-483d-bdc1-253580942e32 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:48.665719 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1610d738-f596-483d-bdc1-253580942e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:48.672321 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d064bf41-c25f-4575-86df-d359d0e9158a admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:48.685215 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-1610d738-f596-483d-bdc1-253580942e32 None None] MFA Rules not processed for user `c9f93af4621b4a9db098c299c9e32c20`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:48.686436 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-1610d738-f596-483d-bdc1-253580942e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:48.737107 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa53d81b-eb88-4cde-ab18-afbee6044a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:48.737726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53d81b-eb88-4cde-ab18-afbee6044a95 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:48.738018 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53d81b-eb88-4cde-ab18-afbee6044a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:48.738296 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa53d81b-eb88-4cde-ab18-afbee6044a95 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:48.739031 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53d81b-eb88-4cde-ab18-afbee6044a95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:48.740880 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa53d81b-eb88-4cde-ab18-afbee6044a95 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:48.747124 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1405/2813] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:41:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:41:48.756370 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1409/2814] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:41:48 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:41:48.757641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610d738-f596-483d-bdc1-253580942e32 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:48.771638 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1610d738-f596-483d-bdc1-253580942e32 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:48.777989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f942c-1d2f-4c09-ae00-91d4a460905d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:48.778754 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f942c-1d2f-4c09-ae00-91d4a460905d admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:48.779117 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f942c-1d2f-4c09-ae00-91d4a460905d admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:48.779480 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59f942c-1d2f-4c09-ae00-91d4a460905d admin admin] PATH_INFO: `/v3/projects/01693272cb1341e8b6fd7bfef76c4c53/users/745295c49c0d490cb6d8c1a94b263d58/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:48.781639 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f942c-1d2f-4c09-ae00-91d4a460905d admin admin] RBAC: Authorizing `identity:create_grant(project_id=01693272cb1341e8b6fd7bfef76c4c53, user_id=745295c49c0d490cb6d8c1a94b263d58, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:48.784906 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59f942c-1d2f-4c09-ae00-91d4a460905d admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:48.797773 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1406/2815] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:41:48 2022] PUT /identity/v3/projects/01693272cb1341e8b6fd7bfef76c4c53/users/745295c49c0d490cb6d8c1a94b263d58/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:48.808968 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265e534-8118-4b3d-a24d-316338aa428e None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:48.809354 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265e534-8118-4b3d-a24d-316338aa428e None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:48.809662 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265e534-8118-4b3d-a24d-316338aa428e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:48.843574 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-5265e534-8118-4b3d-a24d-316338aa428e None None] MFA Rules not processed for user `745295c49c0d490cb6d8c1a94b263d58`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:48.844599 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-5265e534-8118-4b3d-a24d-316338aa428e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:48.856987 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:48.922946 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1410/2816] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:41:48 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:41:48.933562 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f942c-1d2f-4c09-ae00-91d4a460905d admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:48.935286 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-f59f942c-1d2f-4c09-ae00-91d4a460905d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:48.954721 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:48.994976 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59f942c-1d2f-4c09-ae00-91d4a460905d admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:48.998827 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89168b-1903-4c07-b9fe-e0bc9364ebc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:48.999587 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89168b-1903-4c07-b9fe-e0bc9364ebc9 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:48.999973 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89168b-1903-4c07-b9fe-e0bc9364ebc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:49.000254 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d89168b-1903-4c07-b9fe-e0bc9364ebc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:49.010490 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89168b-1903-4c07-b9fe-e0bc9364ebc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:49.011967 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d89168b-1903-4c07-b9fe-e0bc9364ebc9 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:49.021670 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1407/2817] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:48 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:49.077098 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265e534-8118-4b3d-a24d-316338aa428e None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:49.078593 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-5265e534-8118-4b3d-a24d-316338aa428e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:49.138891 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265e534-8118-4b3d-a24d-316338aa428e None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:49.142597 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea81d2-a3bd-493f-a31c-04f947462345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:49.143244 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea81d2-a3bd-493f-a31c-04f947462345 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:49.143534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea81d2-a3bd-493f-a31c-04f947462345 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:49.143851 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea81d2-a3bd-493f-a31c-04f947462345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:49.145649 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-fbea81d2-a3bd-493f-a31c-04f947462345 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:49.155988 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea81d2-a3bd-493f-a31c-04f947462345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:49.157423 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea81d2-a3bd-493f-a31c-04f947462345 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:49.166079 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1411/2818] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:49.173302 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89168b-1903-4c07-b9fe-e0bc9364ebc9 service cinder] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:49.182233 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d89168b-1903-4c07-b9fe-e0bc9364ebc9 service cinder] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:49.185942 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fea3b99-01e5-461b-b005-e34f0e9348b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:49.186586 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea3b99-01e5-461b-b005-e34f0e9348b2 service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:49.186875 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea3b99-01e5-461b-b005-e34f0e9348b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:49.187158 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fea3b99-01e5-461b-b005-e34f0e9348b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:49.245522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea3b99-01e5-461b-b005-e34f0e9348b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:49.246885 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fea3b99-01e5-461b-b005-e34f0e9348b2 service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:49.256013 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1408/2819] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:49 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:58.631998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea81d2-a3bd-493f-a31c-04f947462345 service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:58.693347 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea81d2-a3bd-493f-a31c-04f947462345 service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:58.698498 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445c57b-9cba-4a1d-86af-d8b03b555e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:58.699364 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445c57b-9cba-4a1d-86af-d8b03b555e5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:58.699685 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445c57b-9cba-4a1d-86af-d8b03b555e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:58.699992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445c57b-9cba-4a1d-86af-d8b03b555e5b admin admin] PATH_INFO: `/v3/users/161160ecb73e4c94963be42eb842a3bc` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:58.701176 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445c57b-9cba-4a1d-86af-d8b03b555e5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=161160ecb73e4c94963be42eb842a3bc)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:58.703093 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b445c57b-9cba-4a1d-86af-d8b03b555e5b admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:58.747159 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-b445c57b-9cba-4a1d-86af-d8b03b555e5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '161160ecb73e4c94963be42eb842a3bc'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:58.750737 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:58.760064 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-b445c57b-9cba-4a1d-86af-d8b03b555e5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '161160ecb73e4c94963be42eb842a3bc'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:58.760799 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-b445c57b-9cba-4a1d-86af-d8b03b555e5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '161160ecb73e4c94963be42eb842a3bc'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:58.774071 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-b445c57b-9cba-4a1d-86af-d8b03b555e5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '161160ecb73e4c94963be42eb842a3bc'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:58.774731 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-b445c57b-9cba-4a1d-86af-d8b03b555e5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '161160ecb73e4c94963be42eb842a3bc'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:58.786736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1412/2820] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:58 2022] DELETE /identity/v3/users/161160ecb73e4c94963be42eb842a3bc => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:58.791354 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e859bf-2e6d-47f7-8133-a2da401605aa None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:58.791862 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e859bf-2e6d-47f7-8133-a2da401605aa None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:58.791966 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e859bf-2e6d-47f7-8133-a2da401605aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:58.809425 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-37e859bf-2e6d-47f7-8133-a2da401605aa None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:58.816823 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-37e859bf-2e6d-47f7-8133-a2da401605aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:58.875271 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1409/2821] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:41:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:41:58.885288 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445c57b-9cba-4a1d-86af-d8b03b555e5b admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:58.886724 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-b445c57b-9cba-4a1d-86af-d8b03b555e5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:58.944475 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445c57b-9cba-4a1d-86af-d8b03b555e5b admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:58.948592 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395dbc7-d854-4d5d-8532-dbf7676c0364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:58.949243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395dbc7-d854-4d5d-8532-dbf7676c0364 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:58.949526 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395dbc7-d854-4d5d-8532-dbf7676c0364 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:58.949800 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395dbc7-d854-4d5d-8532-dbf7676c0364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:58.959074 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395dbc7-d854-4d5d-8532-dbf7676c0364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:58.960617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3395dbc7-d854-4d5d-8532-dbf7676c0364 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:58.970739 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1413/2822] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:41:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:41:59.238147 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e859bf-2e6d-47f7-8133-a2da401605aa None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:59.239562 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-37e859bf-2e6d-47f7-8133-a2da401605aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:59.253207 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e859bf-2e6d-47f7-8133-a2da401605aa None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:59.258371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6ebbb-8886-4567-8d95-65e264ebedd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:59.259334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6ebbb-8886-4567-8d95-65e264ebedd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:59.259629 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6ebbb-8886-4567-8d95-65e264ebedd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:59.260185 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa6ebbb-8886-4567-8d95-65e264ebedd4 admin admin] PATH_INFO: `/v3/projects/c545ddd0eb4f417aac1f20e00b1f2e61` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:59.261373 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6ebbb-8886-4567-8d95-65e264ebedd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c545ddd0eb4f417aac1f20e00b1f2e61)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:59.270092 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa6ebbb-8886-4567-8d95-65e264ebedd4 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:59.316876 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-1aa6ebbb-8886-4567-8d95-65e264ebedd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c545ddd0eb4f417aac1f20e00b1f2e61', 'request_id': 'req-1aa6ebbb-8886-4567-8d95-65e264ebedd4'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:59.318792 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:59.323495 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-1aa6ebbb-8886-4567-8d95-65e264ebedd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c545ddd0eb4f417aac1f20e00b1f2e61', 'request_id': 'req-1aa6ebbb-8886-4567-8d95-65e264ebedd4'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:59.330139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-1aa6ebbb-8886-4567-8d95-65e264ebedd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c545ddd0eb4f417aac1f20e00b1f2e61', 'request_id': 'req-1aa6ebbb-8886-4567-8d95-65e264ebedd4'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:59.342508 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-1aa6ebbb-8886-4567-8d95-65e264ebedd4 admin admin] The token cache is being invalidate because project c545ddd0eb4f417aac1f20e00b1f2e61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:59.342782 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-1aa6ebbb-8886-4567-8d95-65e264ebedd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:59.343407 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-1aa6ebbb-8886-4567-8d95-65e264ebedd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:59.344996 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1410/2823] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:59 2022] DELETE /identity/v3/projects/c545ddd0eb4f417aac1f20e00b1f2e61 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:59.348902 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395dbc7-d854-4d5d-8532-dbf7676c0364 service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:59.359197 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395dbc7-d854-4d5d-8532-dbf7676c0364 service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:59.414668 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6db5f-e4ae-4385-88d7-32e5bd014996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:59.415544 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6db5f-e4ae-4385-88d7-32e5bd014996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:59.415859 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6db5f-e4ae-4385-88d7-32e5bd014996 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:59.416140 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6db5f-e4ae-4385-88d7-32e5bd014996 admin admin] PATH_INFO: `/v3/users/745295c49c0d490cb6d8c1a94b263d58` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:59.417326 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6db5f-e4ae-4385-88d7-32e5bd014996 admin admin] RBAC: Authorizing `identity:delete_user(user_id=745295c49c0d490cb6d8c1a94b263d58)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:59.419271 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6db5f-e4ae-4385-88d7-32e5bd014996 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:59.464343 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-cfe6db5f-e4ae-4385-88d7-32e5bd014996 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '745295c49c0d490cb6d8c1a94b263d58'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:59.471458 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-cfe6db5f-e4ae-4385-88d7-32e5bd014996 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '745295c49c0d490cb6d8c1a94b263d58'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:59.472132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-cfe6db5f-e4ae-4385-88d7-32e5bd014996 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '745295c49c0d490cb6d8c1a94b263d58'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:59.484424 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-cfe6db5f-e4ae-4385-88d7-32e5bd014996 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '745295c49c0d490cb6d8c1a94b263d58'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:59.485050 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-cfe6db5f-e4ae-4385-88d7-32e5bd014996 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '745295c49c0d490cb6d8c1a94b263d58'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:59.487007 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:41:59.499814 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1414/2824] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:41:59 2022] DELETE /identity/v3/users/745295c49c0d490cb6d8c1a94b263d58 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:59.781148 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6ebbb-8886-4567-8d95-65e264ebedd4 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:41:59.782750 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-1aa6ebbb-8886-4567-8d95-65e264ebedd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:41:59.798166 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa6ebbb-8886-4567-8d95-65e264ebedd4 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:41:59.857675 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4542ac19-1112-4c08-924e-ca658c750cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:41:59.858545 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542ac19-1112-4c08-924e-ca658c750cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:59.858833 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542ac19-1112-4c08-924e-ca658c750cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:59.859112 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4542ac19-1112-4c08-924e-ca658c750cf4 admin admin] PATH_INFO: `/v3/projects/01693272cb1341e8b6fd7bfef76c4c53` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:59.860338 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542ac19-1112-4c08-924e-ca658c750cf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01693272cb1341e8b6fd7bfef76c4c53)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:41:59.862241 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4542ac19-1112-4c08-924e-ca658c750cf4 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:41:59.908531 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4542ac19-1112-4c08-924e-ca658c750cf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01693272cb1341e8b6fd7bfef76c4c53', 'request_id': 'req-4542ac19-1112-4c08-924e-ca658c750cf4'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:59.915309 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4542ac19-1112-4c08-924e-ca658c750cf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01693272cb1341e8b6fd7bfef76c4c53', 'request_id': 'req-4542ac19-1112-4c08-924e-ca658c750cf4'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:59.921390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4542ac19-1112-4c08-924e-ca658c750cf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01693272cb1341e8b6fd7bfef76c4c53', 'request_id': 'req-4542ac19-1112-4c08-924e-ca658c750cf4'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:59.933348 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4542ac19-1112-4c08-924e-ca658c750cf4 admin admin] The token cache is being invalidate because project 01693272cb1341e8b6fd7bfef76c4c53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:41:59.933636 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4542ac19-1112-4c08-924e-ca658c750cf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:59.934342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-4542ac19-1112-4c08-924e-ca658c750cf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:41:59.935922 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1411/2825] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:41:59 2022] DELETE /identity/v3/projects/01693272cb1341e8b6fd7bfef76c4c53 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:41:59.940716 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5f24c-ed70-4db6-8b70-501b58730b5d None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:41:59.941168 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5f24c-ed70-4db6-8b70-501b58730b5d None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:41:59.941281 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5f24c-ed70-4db6-8b70-501b58730b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:41:59.958860 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-c8e5f24c-ed70-4db6-8b70-501b58730b5d None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:41:59.960665 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-c8e5f24c-ed70-4db6-8b70-501b58730b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:00.019312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1415/2826] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:41:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:00.028207 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76559c5-78bc-4ad9-ba77-5180812c1421 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:00.028639 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76559c5-78bc-4ad9-ba77-5180812c1421 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:00.028837 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76559c5-78bc-4ad9-ba77-5180812c1421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:00.047722 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-f76559c5-78bc-4ad9-ba77-5180812c1421 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:00.048942 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-f76559c5-78bc-4ad9-ba77-5180812c1421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:00.057560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1412/2827] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:42:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:00.061817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5f24c-ed70-4db6-8b70-501b58730b5d None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:00.073869 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5f24c-ed70-4db6-8b70-501b58730b5d None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:00.078626 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0574ca-bcc5-41c4-96c3-4dd80ec26556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:00.079416 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0574ca-bcc5-41c4-96c3-4dd80ec26556 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:00.079793 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0574ca-bcc5-41c4-96c3-4dd80ec26556 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:00.080137 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0574ca-bcc5-41c4-96c3-4dd80ec26556 admin admin] PATH_INFO: `/v3/domains` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:00.080974 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0574ca-bcc5-41c4-96c3-4dd80ec26556 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86525) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:42:00.081283 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0574ca-bcc5-41c4-96c3-4dd80ec26556 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:00.082908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0574ca-bcc5-41c4-96c3-4dd80ec26556 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:00.095370 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1416/2828] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:42:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:42:00.099487 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76559c5-78bc-4ad9-ba77-5180812c1421 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:00.108870 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76559c5-78bc-4ad9-ba77-5180812c1421 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:00.113573 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6eb017-f28a-4363-83bd-22c40473b85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:00.114233 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eb017-f28a-4363-83bd-22c40473b85e admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:00.114522 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eb017-f28a-4363-83bd-22c40473b85e admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:00.114804 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6eb017-f28a-4363-83bd-22c40473b85e admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:00.115540 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6eb017-f28a-4363-83bd-22c40473b85e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:00.117975 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6eb017-f28a-4363-83bd-22c40473b85e admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:00.148563 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1413/2829] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:42:00 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:42:00.149800 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0574ca-bcc5-41c4-96c3-4dd80ec26556 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:00.159998 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0574ca-bcc5-41c4-96c3-4dd80ec26556 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:00.216347 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb25af-4cb2-4b9c-9842-3d9c03a9bbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:00.217039 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb25af-4cb2-4b9c-9842-3d9c03a9bbbf admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:00.217325 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb25af-4cb2-4b9c-9842-3d9c03a9bbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:00.217605 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdb25af-4cb2-4b9c-9842-3d9c03a9bbbf admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:00.218293 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb25af-4cb2-4b9c-9842-3d9c03a9bbbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:00.220265 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdb25af-4cb2-4b9c-9842-3d9c03a9bbbf admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:00.239908 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1417/2830] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:42:00 2022] POST /identity/v3/users => generated 294 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:42:00.243904 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6eb017-f28a-4363-83bd-22c40473b85e admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:00.254120 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6eb017-f28a-4363-83bd-22c40473b85e admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:00.259419 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11b8a2-1332-4414-b07a-136341ab33f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:00.260371 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11b8a2-1332-4414-b07a-136341ab33f4 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:00.260659 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11b8a2-1332-4414-b07a-136341ab33f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:00.260943 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11b8a2-1332-4414-b07a-136341ab33f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:00.261670 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11b8a2-1332-4414-b07a-136341ab33f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:00.263272 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e11b8a2-1332-4414-b07a-136341ab33f4 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:00.273842 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1414/2831] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:00.277734 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb25af-4cb2-4b9c-9842-3d9c03a9bbbf admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:00.287603 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdb25af-4cb2-4b9c-9842-3d9c03a9bbbf admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:00.292487 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c0e9b-8e81-4a9c-91e9-59955dda351b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:00.293165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c0e9b-8e81-4a9c-91e9-59955dda351b admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:00.293448 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c0e9b-8e81-4a9c-91e9-59955dda351b admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:00.293721 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c0e9b-8e81-4a9c-91e9-59955dda351b admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:00.294482 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c0e9b-8e81-4a9c-91e9-59955dda351b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:00.296096 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c0e9b-8e81-4a9c-91e9-59955dda351b admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:00.306539 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1418/2832] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:00.310443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11b8a2-1332-4414-b07a-136341ab33f4 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:00.321001 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11b8a2-1332-4414-b07a-136341ab33f4 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:00.325668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a1e64-d4ef-41ee-ba2b-58506989a50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:00.326536 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a1e64-d4ef-41ee-ba2b-58506989a50a admin admin] REQUEST_METHOD: `PUT` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:00.326825 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a1e64-d4ef-41ee-ba2b-58506989a50a admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:00.327105 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493a1e64-d4ef-41ee-ba2b-58506989a50a admin admin] PATH_INFO: `/v3/projects/c6f7b63864a14185be20c976f1a7dc4f/users/37a3317a1f014a65bdafbba674887dab/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:00.341574 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a1e64-d4ef-41ee-ba2b-58506989a50a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f7b63864a14185be20c976f1a7dc4f, user_id=37a3317a1f014a65bdafbba674887dab, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:00.344295 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493a1e64-d4ef-41ee-ba2b-58506989a50a admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:00.357668 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1415/2833] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:42:00 2022] PUT /identity/v3/projects/c6f7b63864a14185be20c976f1a7dc4f/users/37a3317a1f014a65bdafbba674887dab/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:42:00.368240 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8169d12-e540-48da-8f33-724bd12b2086 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:00.368534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8169d12-e540-48da-8f33-724bd12b2086 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:00.368812 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8169d12-e540-48da-8f33-724bd12b2086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:00.394657 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-d8169d12-e540-48da-8f33-724bd12b2086 None None] MFA Rules not processed for user `37a3317a1f014a65bdafbba674887dab`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:00.395890 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d8169d12-e540-48da-8f33-724bd12b2086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:00.439393 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:00.459317 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1419/2834] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:42:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:00.463770 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a1e64-d4ef-41ee-ba2b-58506989a50a admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:00.472597 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:00.525526 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493a1e64-d4ef-41ee-ba2b-58506989a50a admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:00.530184 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fbca0-053b-4760-8a5c-37b3f11c86bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:00.530774 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fbca0-053b-4760-8a5c-37b3f11c86bd admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:00.531057 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fbca0-053b-4760-8a5c-37b3f11c86bd admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:00.531334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37fbca0-053b-4760-8a5c-37b3f11c86bd admin admin] PATH_INFO: `/v3/projects` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:00.532075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fbca0-053b-4760-8a5c-37b3f11c86bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:00.533962 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37fbca0-053b-4760-8a5c-37b3f11c86bd admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:00.558560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1416/2835] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:42:00 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:42:00.562536 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8169d12-e540-48da-8f33-724bd12b2086 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:00.573096 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8169d12-e540-48da-8f33-724bd12b2086 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:00.628561 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63beb5c-3ecf-4d56-b93d-eb6dc2e9874c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:00.629228 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63beb5c-3ecf-4d56-b93d-eb6dc2e9874c admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:00.629512 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63beb5c-3ecf-4d56-b93d-eb6dc2e9874c admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:00.629790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63beb5c-3ecf-4d56-b93d-eb6dc2e9874c admin admin] PATH_INFO: `/v3/users` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:00.630476 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63beb5c-3ecf-4d56-b93d-eb6dc2e9874c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:00.632468 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63beb5c-3ecf-4d56-b93d-eb6dc2e9874c admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:00.651634 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1420/2836] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:42:00 2022] POST /identity/v3/users => generated 300 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:42:00.655563 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fbca0-053b-4760-8a5c-37b3f11c86bd admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:00.666219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37fbca0-053b-4760-8a5c-37b3f11c86bd admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:00.670787 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d740201-077a-4095-880e-f612c5c9254e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:00.671435 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d740201-077a-4095-880e-f612c5c9254e admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:00.671763 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d740201-077a-4095-880e-f612c5c9254e admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:00.672044 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d740201-077a-4095-880e-f612c5c9254e admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:00.672790 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d740201-077a-4095-880e-f612c5c9254e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:00.674379 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d740201-077a-4095-880e-f612c5c9254e admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:00.685382 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1417/2837] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:00.689261 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63beb5c-3ecf-4d56-b93d-eb6dc2e9874c admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:00.699217 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63beb5c-3ecf-4d56-b93d-eb6dc2e9874c admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:00.703836 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0cda6-6da2-4db9-abea-32e567ed2fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:00.704701 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0cda6-6da2-4db9-abea-32e567ed2fff admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:00.704982 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0cda6-6da2-4db9-abea-32e567ed2fff admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:00.705257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b0cda6-6da2-4db9-abea-32e567ed2fff admin admin] PATH_INFO: `/v3/projects/81bf023f196944bb863aebc283f41f7f/users/8ff1b968e3d04ae79419a59e3d941b06/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:00.720397 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0cda6-6da2-4db9-abea-32e567ed2fff admin admin] RBAC: Authorizing `identity:create_grant(project_id=81bf023f196944bb863aebc283f41f7f, user_id=8ff1b968e3d04ae79419a59e3d941b06, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:00.723048 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b0cda6-6da2-4db9-abea-32e567ed2fff admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:00.735363 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1421/2838] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:42:00 2022] PUT /identity/v3/projects/81bf023f196944bb863aebc283f41f7f/users/8ff1b968e3d04ae79419a59e3d941b06/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:42:00.739155 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d740201-077a-4095-880e-f612c5c9254e admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:00.755011 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d740201-077a-4095-880e-f612c5c9254e admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:00.811986 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1677554b-7ec6-422a-90fc-ef995984fa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:00.812659 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677554b-7ec6-422a-90fc-ef995984fa6c admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:00.812942 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677554b-7ec6-422a-90fc-ef995984fa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:00.813219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1677554b-7ec6-422a-90fc-ef995984fa6c admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:00.813941 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677554b-7ec6-422a-90fc-ef995984fa6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:00.815526 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1677554b-7ec6-422a-90fc-ef995984fa6c admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:00.825409 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1418/2839] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:00.829535 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0cda6-6da2-4db9-abea-32e567ed2fff admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:00.840445 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b0cda6-6da2-4db9-abea-32e567ed2fff admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:00.844989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb17da-8cc4-4bc5-90f5-b8ddeb4a648e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:00.845866 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb17da-8cc4-4bc5-90f5-b8ddeb4a648e admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:00.846145 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb17da-8cc4-4bc5-90f5-b8ddeb4a648e admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:00.846419 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb17da-8cc4-4bc5-90f5-b8ddeb4a648e admin admin] PATH_INFO: `/v3/projects/81bf023f196944bb863aebc283f41f7f/users/8ff1b968e3d04ae79419a59e3d941b06/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:00.848340 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb17da-8cc4-4bc5-90f5-b8ddeb4a648e admin admin] RBAC: Authorizing `identity:create_grant(project_id=81bf023f196944bb863aebc283f41f7f, user_id=8ff1b968e3d04ae79419a59e3d941b06, role_id=6d591a75a0ba4f5ea1ebf9d92b1625ab)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:00.851524 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb17da-8cc4-4bc5-90f5-b8ddeb4a648e admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:00.861529 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1422/2840] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:42:00 2022] PUT /identity/v3/projects/81bf023f196944bb863aebc283f41f7f/users/8ff1b968e3d04ae79419a59e3d941b06/roles/6d591a75a0ba4f5ea1ebf9d92b1625ab => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:00.871540 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304b965-159e-4983-bd75-e8fbde7a2847 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:00.871862 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304b965-159e-4983-bd75-e8fbde7a2847 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:00.872142 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304b965-159e-4983-bd75-e8fbde7a2847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:00.898233 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-e304b965-159e-4983-bd75-e8fbde7a2847 None None] MFA Rules not processed for user `8ff1b968e3d04ae79419a59e3d941b06`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:00.899424 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-e304b965-159e-4983-bd75-e8fbde7a2847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:00.966114 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1419/2841] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:42:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:00.977418 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb17da-8cc4-4bc5-90f5-b8ddeb4a648e admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:00.979228 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-93eb17da-8cc4-4bc5-90f5-b8ddeb4a648e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:01.035056 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb17da-8cc4-4bc5-90f5-b8ddeb4a648e admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:01.039241 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af604c0-3979-4b00-bd67-6a1c797542a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:01.039902 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af604c0-3979-4b00-bd67-6a1c797542a7 service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:01.040188 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af604c0-3979-4b00-bd67-6a1c797542a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:01.040469 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af604c0-3979-4b00-bd67-6a1c797542a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:01.049346 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af604c0-3979-4b00-bd67-6a1c797542a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:01.050776 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af604c0-3979-4b00-bd67-6a1c797542a7 service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:01.061119 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1423/2842] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:00 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:42:01.618562 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304b965-159e-4983-bd75-e8fbde7a2847 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:01.622736 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:01.680902 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304b965-159e-4983-bd75-e8fbde7a2847 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:01.685647 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab145c-c0fe-45c5-944e-d8aaf02d87ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:01.686520 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab145c-c0fe-45c5-944e-d8aaf02d87ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:01.686810 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab145c-c0fe-45c5-944e-d8aaf02d87ad admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:01.687091 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab145c-c0fe-45c5-944e-d8aaf02d87ad admin admin] PATH_INFO: `/v3/users/37a3317a1f014a65bdafbba674887dab` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:01.688315 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab145c-c0fe-45c5-944e-d8aaf02d87ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=37a3317a1f014a65bdafbba674887dab)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:01.690337 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab145c-c0fe-45c5-944e-d8aaf02d87ad admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:01.736098 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-95ab145c-c0fe-45c5-944e-d8aaf02d87ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37a3317a1f014a65bdafbba674887dab'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:01.753494 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-95ab145c-c0fe-45c5-944e-d8aaf02d87ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37a3317a1f014a65bdafbba674887dab'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:01.754423 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-95ab145c-c0fe-45c5-944e-d8aaf02d87ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37a3317a1f014a65bdafbba674887dab'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:01.755132 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-95ab145c-c0fe-45c5-944e-d8aaf02d87ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37a3317a1f014a65bdafbba674887dab'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:01.767549 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-95ab145c-c0fe-45c5-944e-d8aaf02d87ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37a3317a1f014a65bdafbba674887dab'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:01.780383 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1420/2843] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:42:01 2022] DELETE /identity/v3/users/37a3317a1f014a65bdafbba674887dab => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:01.785020 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ab465-c323-4d97-a00b-89242f384d7a None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:01.785314 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ab465-c323-4d97-a00b-89242f384d7a None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:01.785597 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8ab465-c323-4d97-a00b-89242f384d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:01.803735 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-cd8ab465-c323-4d97-a00b-89242f384d7a None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:01.804917 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-cd8ab465-c323-4d97-a00b-89242f384d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:01.842839 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:01.866396 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1424/2844] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:42:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 16 00:42:01.875917 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab145c-c0fe-45c5-944e-d8aaf02d87ad admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:01.877327 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-95ab145c-c0fe-45c5-944e-d8aaf02d87ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:01.934787 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab145c-c0fe-45c5-944e-d8aaf02d87ad admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:01.938503 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a62aa-6685-4545-9dda-c2d0efe51d90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:01.939146 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a62aa-6685-4545-9dda-c2d0efe51d90 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:01.939439 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a62aa-6685-4545-9dda-c2d0efe51d90 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:01.939758 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631a62aa-6685-4545-9dda-c2d0efe51d90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:01.949219 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a62aa-6685-4545-9dda-c2d0efe51d90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:01.950663 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631a62aa-6685-4545-9dda-c2d0efe51d90 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:01.960802 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1421/2845] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:42:02.220195 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ab465-c323-4d97-a00b-89242f384d7a None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:02.221661 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-cd8ab465-c323-4d97-a00b-89242f384d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:02.233695 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8ab465-c323-4d97-a00b-89242f384d7a None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:02.238479 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ba45b-159f-4ed7-a16a-ee3f33f8fd8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:02.239349 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ba45b-159f-4ed7-a16a-ee3f33f8fd8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:02.239669 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ba45b-159f-4ed7-a16a-ee3f33f8fd8a admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:02.239961 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117ba45b-159f-4ed7-a16a-ee3f33f8fd8a admin admin] PATH_INFO: `/v3/projects/c6f7b63864a14185be20c976f1a7dc4f` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:02.241669 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ba45b-159f-4ed7-a16a-ee3f33f8fd8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6f7b63864a14185be20c976f1a7dc4f)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:02.243582 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117ba45b-159f-4ed7-a16a-ee3f33f8fd8a admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:02.289805 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-117ba45b-159f-4ed7-a16a-ee3f33f8fd8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6f7b63864a14185be20c976f1a7dc4f', 'request_id': 'req-117ba45b-159f-4ed7-a16a-ee3f33f8fd8a'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:02.295315 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-117ba45b-159f-4ed7-a16a-ee3f33f8fd8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6f7b63864a14185be20c976f1a7dc4f', 'request_id': 'req-117ba45b-159f-4ed7-a16a-ee3f33f8fd8a'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:02.301412 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-117ba45b-159f-4ed7-a16a-ee3f33f8fd8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6f7b63864a14185be20c976f1a7dc4f', 'request_id': 'req-117ba45b-159f-4ed7-a16a-ee3f33f8fd8a'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:02.314412 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-117ba45b-159f-4ed7-a16a-ee3f33f8fd8a admin admin] The token cache is being invalidate because project c6f7b63864a14185be20c976f1a7dc4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:42:02.314709 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-117ba45b-159f-4ed7-a16a-ee3f33f8fd8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:02.315344 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-117ba45b-159f-4ed7-a16a-ee3f33f8fd8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:02.316987 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1425/2846] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:42:02 2022] DELETE /identity/v3/projects/c6f7b63864a14185be20c976f1a7dc4f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:02.321552 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a62aa-6685-4545-9dda-c2d0efe51d90 service neutron] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:02.331147 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631a62aa-6685-4545-9dda-c2d0efe51d90 service neutron] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:02.350318 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:02.392888 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdbd619-a352-4c9a-b23c-08962982226f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:02.393761 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbd619-a352-4c9a-b23c-08962982226f admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:02.394080 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbd619-a352-4c9a-b23c-08962982226f admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:02.394365 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdbd619-a352-4c9a-b23c-08962982226f admin admin] PATH_INFO: `/v3/users/8ff1b968e3d04ae79419a59e3d941b06` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:02.395650 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdbd619-a352-4c9a-b23c-08962982226f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ff1b968e3d04ae79419a59e3d941b06)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:02.397580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdbd619-a352-4c9a-b23c-08962982226f admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:02.445342 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7bdbd619-a352-4c9a-b23c-08962982226f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ff1b968e3d04ae79419a59e3d941b06'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:02.452950 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7bdbd619-a352-4c9a-b23c-08962982226f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ff1b968e3d04ae79419a59e3d941b06'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:02.453881 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7bdbd619-a352-4c9a-b23c-08962982226f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ff1b968e3d04ae79419a59e3d941b06'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:02.454736 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7bdbd619-a352-4c9a-b23c-08962982226f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ff1b968e3d04ae79419a59e3d941b06'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:02.467514 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-7bdbd619-a352-4c9a-b23c-08962982226f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ff1b968e3d04ae79419a59e3d941b06'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:02.479986 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1422/2847] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:42:02 2022] DELETE /identity/v3/users/8ff1b968e3d04ae79419a59e3d941b06 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:02.754989 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ba45b-159f-4ed7-a16a-ee3f33f8fd8a admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:02.756594 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-117ba45b-159f-4ed7-a16a-ee3f33f8fd8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:02.770321 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117ba45b-159f-4ed7-a16a-ee3f33f8fd8a admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:02.833773 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf9c86-efb3-4eed-875f-19edd8d36eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:02.834644 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf9c86-efb3-4eed-875f-19edd8d36eb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:02.835590 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf9c86-efb3-4eed-875f-19edd8d36eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:02.835911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf9c86-efb3-4eed-875f-19edd8d36eb9 admin admin] PATH_INFO: `/v3/projects/81bf023f196944bb863aebc283f41f7f` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:02.837112 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf9c86-efb3-4eed-875f-19edd8d36eb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81bf023f196944bb863aebc283f41f7f)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:02.839049 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf9c86-efb3-4eed-875f-19edd8d36eb9 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:02.885629 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d8cf9c86-efb3-4eed-875f-19edd8d36eb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81bf023f196944bb863aebc283f41f7f', 'request_id': 'req-d8cf9c86-efb3-4eed-875f-19edd8d36eb9'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:02.891066 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d8cf9c86-efb3-4eed-875f-19edd8d36eb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81bf023f196944bb863aebc283f41f7f', 'request_id': 'req-d8cf9c86-efb3-4eed-875f-19edd8d36eb9'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:02.897083 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d8cf9c86-efb3-4eed-875f-19edd8d36eb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81bf023f196944bb863aebc283f41f7f', 'request_id': 'req-d8cf9c86-efb3-4eed-875f-19edd8d36eb9'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:02.901446 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:02.911726 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d8cf9c86-efb3-4eed-875f-19edd8d36eb9 admin admin] The token cache is being invalidate because project 81bf023f196944bb863aebc283f41f7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:42:02.912022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d8cf9c86-efb3-4eed-875f-19edd8d36eb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:02.912673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d8cf9c86-efb3-4eed-875f-19edd8d36eb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:02.914228 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1426/2848] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:42:02 2022] DELETE /identity/v3/projects/81bf023f196944bb863aebc283f41f7f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:02.919139 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e7607-b0d5-441b-977e-999a743a47ad None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:02.919598 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e7607-b0d5-441b-977e-999a743a47ad None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:02.919755 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064e7607-b0d5-441b-977e-999a743a47ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:02.937143 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-064e7607-b0d5-441b-977e-999a743a47ad None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:02.938285 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-064e7607-b0d5-441b-977e-999a743a47ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:03.000299 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1423/2849] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:42:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:03.059323 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fda719-d94e-44d0-bef9-33e1ea543eb9 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:03.059597 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fda719-d94e-44d0-bef9-33e1ea543eb9 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:03.059915 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fda719-d94e-44d0-bef9-33e1ea543eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:03.078541 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-31fda719-d94e-44d0-bef9-33e1ea543eb9 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:03.079799 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-31fda719-d94e-44d0-bef9-33e1ea543eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:03.087756 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1427/2850] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:03.091861 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e7607-b0d5-441b-977e-999a743a47ad None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:03.101642 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064e7607-b0d5-441b-977e-999a743a47ad None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:03.106276 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c2fc0-63bb-4905-a64d-64f71eb7bc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:03.106933 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c2fc0-63bb-4905-a64d-64f71eb7bc83 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:03.107222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c2fc0-63bb-4905-a64d-64f71eb7bc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:03.107507 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161c2fc0-63bb-4905-a64d-64f71eb7bc83 admin admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:03.108267 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c2fc0-63bb-4905-a64d-64f71eb7bc83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:42:03.108583 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c2fc0-63bb-4905-a64d-64f71eb7bc83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:03.110178 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161c2fc0-63bb-4905-a64d-64f71eb7bc83 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:03.122039 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1424/2851] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:42:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 16 00:42:03.126020 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fda719-d94e-44d0-bef9-33e1ea543eb9 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:03.136154 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fda719-d94e-44d0-bef9-33e1ea543eb9 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:03.140819 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc59193-e76d-4d30-8cfc-b4d5e04334d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:03.141459 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc59193-e76d-4d30-8cfc-b4d5e04334d4 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:03.141742 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc59193-e76d-4d30-8cfc-b4d5e04334d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:03.142018 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc59193-e76d-4d30-8cfc-b4d5e04334d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:03.142705 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc59193-e76d-4d30-8cfc-b4d5e04334d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:03.144643 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc59193-e76d-4d30-8cfc-b4d5e04334d4 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:03.169301 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1428/2852] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:42:03 2022] POST /identity/v3/projects => generated 381 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:42:03.173431 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c2fc0-63bb-4905-a64d-64f71eb7bc83 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:03.183872 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161c2fc0-63bb-4905-a64d-64f71eb7bc83 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:03.212818 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:03.242102 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d048a-6d84-4030-a8dd-35c949f24f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:03.242801 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d048a-6d84-4030-a8dd-35c949f24f7a admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:03.243092 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d048a-6d84-4030-a8dd-35c949f24f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:03.243375 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17d048a-6d84-4030-a8dd-35c949f24f7a admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:03.244127 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d048a-6d84-4030-a8dd-35c949f24f7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:03.246081 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17d048a-6d84-4030-a8dd-35c949f24f7a admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:03.266078 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1425/2853] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:42:03 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 16 00:42:03.270176 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc59193-e76d-4d30-8cfc-b4d5e04334d4 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:03.280499 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc59193-e76d-4d30-8cfc-b4d5e04334d4 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:03.285139 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be84ca-6be5-4e67-b4a9-038ade92fcde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:03.285799 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be84ca-6be5-4e67-b4a9-038ade92fcde admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:03.286090 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be84ca-6be5-4e67-b4a9-038ade92fcde admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:03.286374 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27be84ca-6be5-4e67-b4a9-038ade92fcde admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:03.287110 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be84ca-6be5-4e67-b4a9-038ade92fcde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:03.288763 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27be84ca-6be5-4e67-b4a9-038ade92fcde admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:03.299035 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1429/2854] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:03.303022 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d048a-6d84-4030-a8dd-35c949f24f7a admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:03.313449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17d048a-6d84-4030-a8dd-35c949f24f7a admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:03.318311 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c249181-8152-485d-8b42-479c293f960f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:03.318975 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c249181-8152-485d-8b42-479c293f960f admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:03.319949 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c249181-8152-485d-8b42-479c293f960f admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:03.320235 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c249181-8152-485d-8b42-479c293f960f admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:03.320995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c249181-8152-485d-8b42-479c293f960f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:03.322728 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c249181-8152-485d-8b42-479c293f960f admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:03.332975 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1426/2855] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:03.336777 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be84ca-6be5-4e67-b4a9-038ade92fcde admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:03.346553 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27be84ca-6be5-4e67-b4a9-038ade92fcde admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:03.351753 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14cc2a-c698-4c88-80e7-28b24aaa966d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:03.352618 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14cc2a-c698-4c88-80e7-28b24aaa966d admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:03.352902 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14cc2a-c698-4c88-80e7-28b24aaa966d admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:03.353180 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14cc2a-c698-4c88-80e7-28b24aaa966d admin admin] PATH_INFO: `/v3/projects/52b637097b2b41f89da242c9c160ce56/users/00ea7e25c60948949e0add223cb6cda4/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:03.368002 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14cc2a-c698-4c88-80e7-28b24aaa966d admin admin] RBAC: Authorizing `identity:create_grant(project_id=52b637097b2b41f89da242c9c160ce56, user_id=00ea7e25c60948949e0add223cb6cda4, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:03.371043 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14cc2a-c698-4c88-80e7-28b24aaa966d admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:03.383958 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1430/2856] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:42:03 2022] PUT /identity/v3/projects/52b637097b2b41f89da242c9c160ce56/users/00ea7e25c60948949e0add223cb6cda4/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:03.394074 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcae81d-54b5-4e22-948c-0b7dee32c824 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:03.394477 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcae81d-54b5-4e22-948c-0b7dee32c824 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:03.394795 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcae81d-54b5-4e22-948c-0b7dee32c824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:03.421152 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-1bcae81d-54b5-4e22-948c-0b7dee32c824 None None] MFA Rules not processed for user `00ea7e25c60948949e0add223cb6cda4`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:03.422357 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-1bcae81d-54b5-4e22-948c-0b7dee32c824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:03.485045 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1427/2857] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:42:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:03.496691 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14cc2a-c698-4c88-80e7-28b24aaa966d admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:03.498473 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-3a14cc2a-c698-4c88-80e7-28b24aaa966d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:03.555855 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14cc2a-c698-4c88-80e7-28b24aaa966d admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:03.559582 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fbea888-223e-4f3c-aa04-e05e6ce663ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:03.560253 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbea888-223e-4f3c-aa04-e05e6ce663ae service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:03.560540 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbea888-223e-4f3c-aa04-e05e6ce663ae service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:03.560845 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbea888-223e-4f3c-aa04-e05e6ce663ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:03.569403 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbea888-223e-4f3c-aa04-e05e6ce663ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:03.570837 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fbea888-223e-4f3c-aa04-e05e6ce663ae service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:03.579663 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1431/2858] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:42:03.598922 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcae81d-54b5-4e22-948c-0b7dee32c824 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:03.663660 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcae81d-54b5-4e22-948c-0b7dee32c824 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:03.668474 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1d679-ca4b-4287-bc65-b18189dcb5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:03.669385 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1d679-ca4b-4287-bc65-b18189dcb5f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:03.669674 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1d679-ca4b-4287-bc65-b18189dcb5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:03.669956 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1d679-ca4b-4287-bc65-b18189dcb5f5 admin admin] PATH_INFO: `/v3/users/00ea7e25c60948949e0add223cb6cda4` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:03.671186 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1d679-ca4b-4287-bc65-b18189dcb5f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00ea7e25c60948949e0add223cb6cda4)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:03.673152 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1d679-ca4b-4287-bc65-b18189dcb5f5 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:03.717287 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:03.724060 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-eef1d679-ca4b-4287-bc65-b18189dcb5f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00ea7e25c60948949e0add223cb6cda4'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:03.731686 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-eef1d679-ca4b-4287-bc65-b18189dcb5f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00ea7e25c60948949e0add223cb6cda4'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:03.732331 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-eef1d679-ca4b-4287-bc65-b18189dcb5f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00ea7e25c60948949e0add223cb6cda4'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:03.732989 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-eef1d679-ca4b-4287-bc65-b18189dcb5f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00ea7e25c60948949e0add223cb6cda4'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:03.745261 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-eef1d679-ca4b-4287-bc65-b18189dcb5f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00ea7e25c60948949e0add223cb6cda4'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:03.757729 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1428/2859] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:42:03 2022] DELETE /identity/v3/users/00ea7e25c60948949e0add223cb6cda4 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:03.762447 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b537535-e1b7-49de-96ff-1f7592df5762 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:03.762740 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b537535-e1b7-49de-96ff-1f7592df5762 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:03.763022 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b537535-e1b7-49de-96ff-1f7592df5762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:03.781325 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-5b537535-e1b7-49de-96ff-1f7592df5762 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:03.782546 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-5b537535-e1b7-49de-96ff-1f7592df5762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:03.840976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1432/2860] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:42:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:03.850595 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1d679-ca4b-4287-bc65-b18189dcb5f5 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:03.852016 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-eef1d679-ca4b-4287-bc65-b18189dcb5f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:03.908560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1d679-ca4b-4287-bc65-b18189dcb5f5 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:03.912174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39f711b-0fe1-41bb-b464-d73c449d6278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:03.912836 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f711b-0fe1-41bb-b464-d73c449d6278 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:03.913135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f711b-0fe1-41bb-b464-d73c449d6278 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:03.913417 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39f711b-0fe1-41bb-b464-d73c449d6278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:03.922237 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f711b-0fe1-41bb-b464-d73c449d6278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:03.923743 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39f711b-0fe1-41bb-b464-d73c449d6278 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:03.933473 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1429/2861] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:42:04.195366 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b537535-e1b7-49de-96ff-1f7592df5762 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:04.196960 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-5b537535-e1b7-49de-96ff-1f7592df5762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:04.209268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b537535-e1b7-49de-96ff-1f7592df5762 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:04.213856 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f54cc62-2aa5-44ab-acb0-4d82892a746e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:04.214719 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54cc62-2aa5-44ab-acb0-4d82892a746e admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:04.215006 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54cc62-2aa5-44ab-acb0-4d82892a746e admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:04.215268 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f54cc62-2aa5-44ab-acb0-4d82892a746e admin admin] PATH_INFO: `/v3/projects/52b637097b2b41f89da242c9c160ce56` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:04.216515 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54cc62-2aa5-44ab-acb0-4d82892a746e admin admin] RBAC: Authorizing `identity:delete_project(project_id=52b637097b2b41f89da242c9c160ce56)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:04.218470 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f54cc62-2aa5-44ab-acb0-4d82892a746e admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:04.252236 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:04.266644 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-7f54cc62-2aa5-44ab-acb0-4d82892a746e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52b637097b2b41f89da242c9c160ce56', 'request_id': 'req-7f54cc62-2aa5-44ab-acb0-4d82892a746e'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:04.272055 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-7f54cc62-2aa5-44ab-acb0-4d82892a746e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52b637097b2b41f89da242c9c160ce56', 'request_id': 'req-7f54cc62-2aa5-44ab-acb0-4d82892a746e'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:04.278044 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-7f54cc62-2aa5-44ab-acb0-4d82892a746e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52b637097b2b41f89da242c9c160ce56', 'request_id': 'req-7f54cc62-2aa5-44ab-acb0-4d82892a746e'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:04.290332 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-7f54cc62-2aa5-44ab-acb0-4d82892a746e admin admin] The token cache is being invalidate because project 52b637097b2b41f89da242c9c160ce56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:42:04.290616 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-7f54cc62-2aa5-44ab-acb0-4d82892a746e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:04.291243 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-7f54cc62-2aa5-44ab-acb0-4d82892a746e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:04.292792 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1433/2862] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:42:04 2022] DELETE /identity/v3/projects/52b637097b2b41f89da242c9c160ce56 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:04.297809 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e921b-d8b9-4e70-8197-217c1bf34980 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:04.298104 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e921b-d8b9-4e70-8197-217c1bf34980 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:04.298388 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e921b-d8b9-4e70-8197-217c1bf34980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:04.315932 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-755e921b-d8b9-4e70-8197-217c1bf34980 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:04.317115 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-755e921b-d8b9-4e70-8197-217c1bf34980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:04.375896 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1430/2863] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:04.383468 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fd6ca-15c4-4b18-af54-f8d8ef91fb42 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:04.383792 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fd6ca-15c4-4b18-af54-f8d8ef91fb42 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:04.384081 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87fd6ca-15c4-4b18-af54-f8d8ef91fb42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:04.402403 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-c87fd6ca-15c4-4b18-af54-f8d8ef91fb42 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:04.403627 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-c87fd6ca-15c4-4b18-af54-f8d8ef91fb42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:04.411706 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1434/2864] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:42:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:04.416143 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e921b-d8b9-4e70-8197-217c1bf34980 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:04.425776 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e921b-d8b9-4e70-8197-217c1bf34980 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:04.430460 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10ef81-0959-4b18-b349-3a7a4416a031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:04.431118 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10ef81-0959-4b18-b349-3a7a4416a031 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:04.431406 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10ef81-0959-4b18-b349-3a7a4416a031 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:04.431723 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10ef81-0959-4b18-b349-3a7a4416a031 admin admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:04.432449 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10ef81-0959-4b18-b349-3a7a4416a031 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:42:04.432762 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10ef81-0959-4b18-b349-3a7a4416a031 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:04.434480 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10ef81-0959-4b18-b349-3a7a4416a031 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:04.446447 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1431/2865] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:42:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:42:04.450468 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fd6ca-15c4-4b18-af54-f8d8ef91fb42 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:04.459645 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87fd6ca-15c4-4b18-af54-f8d8ef91fb42 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:04.464912 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfaa817-f932-4714-adf6-5cdb5162a663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:04.465556 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfaa817-f932-4714-adf6-5cdb5162a663 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:04.465871 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfaa817-f932-4714-adf6-5cdb5162a663 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:04.466148 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfaa817-f932-4714-adf6-5cdb5162a663 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:04.466830 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfaa817-f932-4714-adf6-5cdb5162a663 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:04.468758 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfaa817-f932-4714-adf6-5cdb5162a663 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:04.493911 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1435/2866] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:42:04 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:42:04.497979 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10ef81-0959-4b18-b349-3a7a4416a031 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:04.508612 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10ef81-0959-4b18-b349-3a7a4416a031 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:04.554766 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:04.568406 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06702ac9-f2e9-4109-bd1e-03ff4d670164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:04.569122 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06702ac9-f2e9-4109-bd1e-03ff4d670164 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:04.569931 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06702ac9-f2e9-4109-bd1e-03ff4d670164 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:04.570212 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06702ac9-f2e9-4109-bd1e-03ff4d670164 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:04.570922 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06702ac9-f2e9-4109-bd1e-03ff4d670164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:04.572954 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06702ac9-f2e9-4109-bd1e-03ff4d670164 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:04.592813 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1432/2867] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:42:04 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:42:04.596942 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfaa817-f932-4714-adf6-5cdb5162a663 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:04.607563 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfaa817-f932-4714-adf6-5cdb5162a663 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:04.612637 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0259d18-eb5c-418e-b5cf-9e8bb2cdac9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:04.613303 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0259d18-eb5c-418e-b5cf-9e8bb2cdac9e admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:04.613584 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0259d18-eb5c-418e-b5cf-9e8bb2cdac9e admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:04.613878 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0259d18-eb5c-418e-b5cf-9e8bb2cdac9e admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:04.614673 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0259d18-eb5c-418e-b5cf-9e8bb2cdac9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:04.616784 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0259d18-eb5c-418e-b5cf-9e8bb2cdac9e admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:04.627331 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1436/2868] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:04.631317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06702ac9-f2e9-4109-bd1e-03ff4d670164 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:04.642176 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06702ac9-f2e9-4109-bd1e-03ff4d670164 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:04.647144 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e89d7eb-a4b3-4172-8ba0-ac753ed42416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:04.647916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89d7eb-a4b3-4172-8ba0-ac753ed42416 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:04.648202 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89d7eb-a4b3-4172-8ba0-ac753ed42416 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:04.648476 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e89d7eb-a4b3-4172-8ba0-ac753ed42416 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:04.649223 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89d7eb-a4b3-4172-8ba0-ac753ed42416 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:04.650842 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e89d7eb-a4b3-4172-8ba0-ac753ed42416 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:04.662190 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1433/2869] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:04.666102 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0259d18-eb5c-418e-b5cf-9e8bb2cdac9e admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:04.675954 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0259d18-eb5c-418e-b5cf-9e8bb2cdac9e admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:04.681230 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584e0b6-57e2-452f-b78e-9671f6a18f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:04.682105 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584e0b6-57e2-452f-b78e-9671f6a18f2d admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:04.682387 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584e0b6-57e2-452f-b78e-9671f6a18f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:04.682777 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d584e0b6-57e2-452f-b78e-9671f6a18f2d admin admin] PATH_INFO: `/v3/projects/c1d97c1238d44a84bbba342ba44e7e0e/users/a6ff5f5a43234233b5b335650878a3c7/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:04.698355 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584e0b6-57e2-452f-b78e-9671f6a18f2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1d97c1238d44a84bbba342ba44e7e0e, user_id=a6ff5f5a43234233b5b335650878a3c7, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:04.701149 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d584e0b6-57e2-452f-b78e-9671f6a18f2d admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:04.720047 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1437/2870] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:42:04 2022] PUT /identity/v3/projects/c1d97c1238d44a84bbba342ba44e7e0e/users/a6ff5f5a43234233b5b335650878a3c7/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:04.732257 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290dba1f-0ef6-41f5-bec2-8c8fc221f582 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:04.732552 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290dba1f-0ef6-41f5-bec2-8c8fc221f582 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:04.732861 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290dba1f-0ef6-41f5-bec2-8c8fc221f582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:04.766303 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-290dba1f-0ef6-41f5-bec2-8c8fc221f582 None None] MFA Rules not processed for user `a6ff5f5a43234233b5b335650878a3c7`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:04.768448 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-290dba1f-0ef6-41f5-bec2-8c8fc221f582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:04.845060 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1434/2871] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:42:04 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:04.856696 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584e0b6-57e2-452f-b78e-9671f6a18f2d admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:04.858407 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d584e0b6-57e2-452f-b78e-9671f6a18f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:04.917976 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d584e0b6-57e2-452f-b78e-9671f6a18f2d admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:04.921641 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b3f97-e60a-472c-9d92-99cf0fcfd95f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:04.922285 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b3f97-e60a-472c-9d92-99cf0fcfd95f service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:04.922571 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b3f97-e60a-472c-9d92-99cf0fcfd95f service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:04.922846 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b3f97-e60a-472c-9d92-99cf0fcfd95f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:04.931640 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b3f97-e60a-472c-9d92-99cf0fcfd95f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:04.933078 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39b3f97-e60a-472c-9d92-99cf0fcfd95f service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:04.941974 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1438/2872] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:42:04.961362 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290dba1f-0ef6-41f5-bec2-8c8fc221f582 None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:05.023131 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290dba1f-0ef6-41f5-bec2-8c8fc221f582 None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:05.027695 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59a607-88ac-4e7e-82a8-213c0288459a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:05.028560 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59a607-88ac-4e7e-82a8-213c0288459a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:05.028849 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59a607-88ac-4e7e-82a8-213c0288459a admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:05.029135 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd59a607-88ac-4e7e-82a8-213c0288459a admin admin] PATH_INFO: `/v3/users/a6ff5f5a43234233b5b335650878a3c7` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:05.030343 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59a607-88ac-4e7e-82a8-213c0288459a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6ff5f5a43234233b5b335650878a3c7)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:05.032326 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd59a607-88ac-4e7e-82a8-213c0288459a admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:05.077875 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-bd59a607-88ac-4e7e-82a8-213c0288459a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6ff5f5a43234233b5b335650878a3c7'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:05.085047 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-bd59a607-88ac-4e7e-82a8-213c0288459a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6ff5f5a43234233b5b335650878a3c7'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:05.085702 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-bd59a607-88ac-4e7e-82a8-213c0288459a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6ff5f5a43234233b5b335650878a3c7'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:05.086317 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-bd59a607-88ac-4e7e-82a8-213c0288459a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6ff5f5a43234233b5b335650878a3c7'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:05.090751 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:05.100771 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-bd59a607-88ac-4e7e-82a8-213c0288459a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6ff5f5a43234233b5b335650878a3c7'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:05.112744 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1435/2873] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:42:04 2022] DELETE /identity/v3/users/a6ff5f5a43234233b5b335650878a3c7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:05.117957 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9364c6-86a0-44f2-8143-ae3ecb26641a None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:05.118254 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9364c6-86a0-44f2-8143-ae3ecb26641a None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:05.118540 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9364c6-86a0-44f2-8143-ae3ecb26641a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:05.135468 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-5f9364c6-86a0-44f2-8143-ae3ecb26641a None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:05.136729 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-5f9364c6-86a0-44f2-8143-ae3ecb26641a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:05.189992 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:05.201910 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1439/2874] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:05.212438 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59a607-88ac-4e7e-82a8-213c0288459a admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:05.213921 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-bd59a607-88ac-4e7e-82a8-213c0288459a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:05.271565 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd59a607-88ac-4e7e-82a8-213c0288459a admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:05.275791 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3699add-c016-4915-bfea-db20f2ee18d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:05.276443 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3699add-c016-4915-bfea-db20f2ee18d4 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:05.276731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3699add-c016-4915-bfea-db20f2ee18d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:05.277010 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3699add-c016-4915-bfea-db20f2ee18d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:05.286227 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3699add-c016-4915-bfea-db20f2ee18d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:05.287705 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3699add-c016-4915-bfea-db20f2ee18d4 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:05.298020 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1436/2875] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 16 00:42:05.559582 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9364c6-86a0-44f2-8143-ae3ecb26641a None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:05.561154 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-5f9364c6-86a0-44f2-8143-ae3ecb26641a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:05.575736 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9364c6-86a0-44f2-8143-ae3ecb26641a None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:05.580569 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cd9c5a-3706-440a-aa66-3cdcda3f057c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:05.581582 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd9c5a-3706-440a-aa66-3cdcda3f057c admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:05.581877 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd9c5a-3706-440a-aa66-3cdcda3f057c admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:05.582197 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cd9c5a-3706-440a-aa66-3cdcda3f057c admin admin] PATH_INFO: `/v3/projects/c1d97c1238d44a84bbba342ba44e7e0e` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:05.583368 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd9c5a-3706-440a-aa66-3cdcda3f057c admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1d97c1238d44a84bbba342ba44e7e0e)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:05.586121 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cd9c5a-3706-440a-aa66-3cdcda3f057c admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:05.633321 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d6cd9c5a-3706-440a-aa66-3cdcda3f057c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1d97c1238d44a84bbba342ba44e7e0e', 'request_id': 'req-d6cd9c5a-3706-440a-aa66-3cdcda3f057c'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:05.639176 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d6cd9c5a-3706-440a-aa66-3cdcda3f057c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1d97c1238d44a84bbba342ba44e7e0e', 'request_id': 'req-d6cd9c5a-3706-440a-aa66-3cdcda3f057c'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:05.645320 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d6cd9c5a-3706-440a-aa66-3cdcda3f057c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1d97c1238d44a84bbba342ba44e7e0e', 'request_id': 'req-d6cd9c5a-3706-440a-aa66-3cdcda3f057c'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:05.658105 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d6cd9c5a-3706-440a-aa66-3cdcda3f057c admin admin] The token cache is being invalidate because project c1d97c1238d44a84bbba342ba44e7e0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:42:05.658398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d6cd9c5a-3706-440a-aa66-3cdcda3f057c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:05.659026 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-d6cd9c5a-3706-440a-aa66-3cdcda3f057c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:42:05.660622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1440/2876] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:42:05 2022] DELETE /identity/v3/projects/c1d97c1238d44a84bbba342ba44e7e0e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:05.665567 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426427c0-ccc6-448d-b979-8f29757dab3a None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:05.665861 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426427c0-ccc6-448d-b979-8f29757dab3a None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:05.666150 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426427c0-ccc6-448d-b979-8f29757dab3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:05.683358 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-426427c0-ccc6-448d-b979-8f29757dab3a None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:05.684606 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-426427c0-ccc6-448d-b979-8f29757dab3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:05.742716 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1437/2877] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:05.750479 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e620b-d4b1-4d12-ad4b-bdd5798cf9aa None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:05.750772 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e620b-d4b1-4d12-ad4b-bdd5798cf9aa None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:05.751053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64e620b-d4b1-4d12-ad4b-bdd5798cf9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:05.769771 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-f64e620b-d4b1-4d12-ad4b-bdd5798cf9aa None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:05.770959 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-f64e620b-d4b1-4d12-ad4b-bdd5798cf9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:05.779343 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1441/2878] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:42:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:05.783492 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426427c0-ccc6-448d-b979-8f29757dab3a None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:05.793103 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426427c0-ccc6-448d-b979-8f29757dab3a None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:05.797711 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f77266-3fed-434e-9200-776924ae7366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:05.798363 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f77266-3fed-434e-9200-776924ae7366 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:05.798646 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f77266-3fed-434e-9200-776924ae7366 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:05.798920 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f77266-3fed-434e-9200-776924ae7366 admin admin] PATH_INFO: `/v3/domains` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:05.799662 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f77266-3fed-434e-9200-776924ae7366 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=86524) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 16 00:42:05.799972 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f77266-3fed-434e-9200-776924ae7366 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:05.801568 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f77266-3fed-434e-9200-776924ae7366 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:05.813137 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1438/2879] 10.222.0.44 () {58 vars in 1152 bytes} [Thu Jun 16 00:42:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 16 00:42:05.817398 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e620b-d4b1-4d12-ad4b-bdd5798cf9aa None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:05.827339 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64e620b-d4b1-4d12-ad4b-bdd5798cf9aa None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:05.832123 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761e7f3-9e79-45a0-847a-46d25ded3ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:05.832774 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761e7f3-9e79-45a0-847a-46d25ded3ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:05.833064 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761e7f3-9e79-45a0-847a-46d25ded3ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:05.833344 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761e7f3-9e79-45a0-847a-46d25ded3ef9 admin admin] PATH_INFO: `/v3/projects` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:05.834040 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761e7f3-9e79-45a0-847a-46d25ded3ef9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:05.836567 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761e7f3-9e79-45a0-847a-46d25ded3ef9 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:05.861024 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1442/2880] 10.222.0.44 () {60 vars in 1152 bytes} [Thu Jun 16 00:42:05 2022] POST /identity/v3/projects => generated 383 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:42:05.865023 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f77266-3fed-434e-9200-776924ae7366 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:05.874984 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f77266-3fed-434e-9200-776924ae7366 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:05.933396 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16c38d-03a5-4e7b-bd2d-a466627369f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:05.934074 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16c38d-03a5-4e7b-bd2d-a466627369f2 admin admin] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:05.934363 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16c38d-03a5-4e7b-bd2d-a466627369f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:05.934642 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be16c38d-03a5-4e7b-bd2d-a466627369f2 admin admin] PATH_INFO: `/v3/users` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:05.935337 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16c38d-03a5-4e7b-bd2d-a466627369f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:05.937306 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be16c38d-03a5-4e7b-bd2d-a466627369f2 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:05.947960 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:05.964659 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1439/2881] 10.222.0.44 () {60 vars in 1143 bytes} [Thu Jun 16 00:42:05 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 16 00:42:05.965988 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761e7f3-9e79-45a0-847a-46d25ded3ef9 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:05.976510 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761e7f3-9e79-45a0-847a-46d25ded3ef9 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:05.981312 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cd830-b513-43f2-8f08-3d54ccbc1c18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:05.982083 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cd830-b513-43f2-8f08-3d54ccbc1c18 admin admin] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:05.982379 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cd830-b513-43f2-8f08-3d54ccbc1c18 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:05.982652 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35cd830-b513-43f2-8f08-3d54ccbc1c18 admin admin] PATH_INFO: `/v3/roles` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:05.983374 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35cd830-b513-43f2-8f08-3d54ccbc1c18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:05.985025 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35cd830-b513-43f2-8f08-3d54ccbc1c18 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:05.996483 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1443/2882] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 16 00:42:06.000716 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16c38d-03a5-4e7b-bd2d-a466627369f2 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:06.011974 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be16c38d-03a5-4e7b-bd2d-a466627369f2 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:06.017759 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afdc38-ea48-4420-90e5-c0b3d4404027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:06.018566 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afdc38-ea48-4420-90e5-c0b3d4404027 admin admin] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:06.018855 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afdc38-ea48-4420-90e5-c0b3d4404027 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:06.019136 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afdc38-ea48-4420-90e5-c0b3d4404027 admin admin] PATH_INFO: `/v3/roles` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:06.019930 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afdc38-ea48-4420-90e5-c0b3d4404027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:06.021576 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afdc38-ea48-4420-90e5-c0b3d4404027 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:06.031831 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1440/2883] 10.222.0.44 () {58 vars in 1121 bytes} [Thu Jun 16 00:42:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 16 00:42:06.035958 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cd830-b513-43f2-8f08-3d54ccbc1c18 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:06.046144 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35cd830-b513-43f2-8f08-3d54ccbc1c18 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:06.050923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0f354-eec1-46b0-97a1-0ca8adcc80dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:06.051847 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0f354-eec1-46b0-97a1-0ca8adcc80dc admin admin] REQUEST_METHOD: `PUT` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:06.052131 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0f354-eec1-46b0-97a1-0ca8adcc80dc admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:06.052418 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c0f354-eec1-46b0-97a1-0ca8adcc80dc admin admin] PATH_INFO: `/v3/projects/ff8a376cc31445ee913739e0d2e8eec2/users/19a40d49410041928eb9ac2e14206c02/roles/d6fedf23abb64cd494e8b49acefff423` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:06.067465 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0f354-eec1-46b0-97a1-0ca8adcc80dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff8a376cc31445ee913739e0d2e8eec2, user_id=19a40d49410041928eb9ac2e14206c02, role_id=d6fedf23abb64cd494e8b49acefff423)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:06.070762 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c0f354-eec1-46b0-97a1-0ca8adcc80dc admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:06.083075 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1444/2884] 10.222.0.44 () {60 vars in 1482 bytes} [Thu Jun 16 00:42:06 2022] PUT /identity/v3/projects/ff8a376cc31445ee913739e0d2e8eec2/users/19a40d49410041928eb9ac2e14206c02/roles/d6fedf23abb64cd494e8b49acefff423 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:42:06.088131 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3c09c-11a9-49b6-8dc2-7cd6a8aee502 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:06.088431 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3c09c-11a9-49b6-8dc2-7cd6a8aee502 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:06.088704 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3c09c-11a9-49b6-8dc2-7cd6a8aee502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:06.106115 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-34f3c09c-11a9-49b6-8dc2-7cd6a8aee502 None None] MFA Rules not processed for user `5827dca4e6e6440096187e88acac47af`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:06.107315 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-34f3c09c-11a9-49b6-8dc2-7cd6a8aee502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:06.166409 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1441/2885] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:42:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:06.175632 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0f354-eec1-46b0-97a1-0ca8adcc80dc admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:06.177341 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d7c0f354-eec1-46b0-97a1-0ca8adcc80dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:06.233645 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c0f354-eec1-46b0-97a1-0ca8adcc80dc admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:06.237296 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30134a08-afa4-4190-ab63-86457d4b22c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:06.237941 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30134a08-afa4-4190-ab63-86457d4b22c1 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:06.238229 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30134a08-afa4-4190-ab63-86457d4b22c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:06.238511 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30134a08-afa4-4190-ab63-86457d4b22c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:06.248057 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30134a08-afa4-4190-ab63-86457d4b22c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:06.249506 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30134a08-afa4-4190-ab63-86457d4b22c1 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:06.259559 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1445/2886] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:42:06.869759 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9f0ca-f04e-47a4-a0c2-a380161e5da0 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:06.870052 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9f0ca-f04e-47a4-a0c2-a380161e5da0 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:06.870334 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd9f0ca-f04e-47a4-a0c2-a380161e5da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:06.898406 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-9bd9f0ca-f04e-47a4-a0c2-a380161e5da0 None None] MFA Rules not processed for user `19a40d49410041928eb9ac2e14206c02`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:06.899660 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-9bd9f0ca-f04e-47a4-a0c2-a380161e5da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:06.969305 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1442/2887] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:42:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:06.982025 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30134a08-afa4-4190-ab63-86457d4b22c1 service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:06.983502 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-30134a08-afa4-4190-ab63-86457d4b22c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:07.008132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:07.047707 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30134a08-afa4-4190-ab63-86457d4b22c1 service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:07.053513 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d900c3-fd68-4cbe-b304-273a0e5174cd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:07.054178 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d900c3-fd68-4cbe-b304-273a0e5174cd service cinder] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:07.054465 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d900c3-fd68-4cbe-b304-273a0e5174cd service cinder] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:07.054746 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d900c3-fd68-4cbe-b304-273a0e5174cd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:07.070185 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d900c3-fd68-4cbe-b304-273a0e5174cd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:07.071730 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d900c3-fd68-4cbe-b304-273a0e5174cd service cinder] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:07.082053 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1446/2888] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:42:08.453716 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4451072-fb47-40e9-b0a7-e142c41068b2 None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:08.454204 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4451072-fb47-40e9-b0a7-e142c41068b2 None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:08.454335 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4451072-fb47-40e9-b0a7-e142c41068b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:08.471912 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-b4451072-fb47-40e9-b0a7-e142c41068b2 None None] MFA Rules not processed for user `19a40d49410041928eb9ac2e14206c02`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:42:08.473111 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-b4451072-fb47-40e9-b0a7-e142c41068b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:08.480526 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1443/2889] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:42:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:42:17.077861 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=17 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:18.466676 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=69 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:42:25.107253 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d900c3-fd68-4cbe-b304-273a0e5174cd service cinder] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:42:25.116854 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d900c3-fd68-4cbe-b304-273a0e5174cd service cinder] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:42:25.120817 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2140ba9-7482-4fd1-acc6-10d160af5964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:42:25.121558 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2140ba9-7482-4fd1-acc6-10d160af5964 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:42:25.121842 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2140ba9-7482-4fd1-acc6-10d160af5964 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:42:25.122117 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2140ba9-7482-4fd1-acc6-10d160af5964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:42:25.123953 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-b2140ba9-7482-4fd1-acc6-10d160af5964 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:42:25.134509 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2140ba9-7482-4fd1-acc6-10d160af5964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:42:25.135994 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2140ba9-7482-4fd1-acc6-10d160af5964 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:42:25.144850 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1447/2890] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:42:25 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:42:35.140807 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=6 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:43:25.851725 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac905d-b16a-4db8-9296-242ea7afaebc None None] REQUEST_METHOD: `POST` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:43:25.852244 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac905d-b16a-4db8-9296-242ea7afaebc None None] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:43:25.852390 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ac905d-b16a-4db8-9296-242ea7afaebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:43:25.870480 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.auth.core [None req-70ac905d-b16a-4db8-9296-242ea7afaebc None None] MFA Rules not processed for user `19a40d49410041928eb9ac2e14206c02`. Rule list: `[]` (Enabled: `True`). {{(pid=86524) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:43:25.871696 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-70ac905d-b16a-4db8-9296-242ea7afaebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:43:25.878995 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1444/2891] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:43:25 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:43:35.864355 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=3 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:44:28.063834 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2140ba9-7482-4fd1-acc6-10d160af5964 service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:44:28.065238 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-b2140ba9-7482-4fd1-acc6-10d160af5964 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:28.125858 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac905d-b16a-4db8-9296-242ea7afaebc None None] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:44:28.143075 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2140ba9-7482-4fd1-acc6-10d160af5964 service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:44:28.147999 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ac905d-b16a-4db8-9296-242ea7afaebc None None] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:44:28.152489 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae940b-99db-4ca2-8730-d7c1256c6ba2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9164f14fe6894daba1a9f2d8f1f4929c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:44:28.152805 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea902e2-8bef-4487-8e95-83808544d602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:44:28.153136 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae940b-99db-4ca2-8730-d7c1256c6ba2 service placement] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:28.153421 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae940b-99db-4ca2-8730-d7c1256c6ba2 service placement] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:28.153667 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea902e2-8bef-4487-8e95-83808544d602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:28.153796 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ae940b-99db-4ca2-8730-d7c1256c6ba2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:28.153950 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea902e2-8bef-4487-8e95-83808544d602 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:28.154229 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea902e2-8bef-4487-8e95-83808544d602 admin admin] PATH_INFO: `/v3/users/19a40d49410041928eb9ac2e14206c02` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:28.155432 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea902e2-8bef-4487-8e95-83808544d602 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19a40d49410041928eb9ac2e14206c02)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:44:28.155564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-d7ae940b-99db-4ca2-8730-d7c1256c6ba2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:28.157398 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea902e2-8bef-4487-8e95-83808544d602 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:44:28.167507 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae940b-99db-4ca2-8730-d7c1256c6ba2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:44:28.169240 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ae940b-99db-4ca2-8730-d7c1256c6ba2 service placement] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:44:28.182837 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1448/2892] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:44:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:44:28.206580 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0ea902e2-8bef-4487-8e95-83808544d602 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19a40d49410041928eb9ac2e14206c02'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:44:28.214238 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0ea902e2-8bef-4487-8e95-83808544d602 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19a40d49410041928eb9ac2e14206c02'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:44:28.214874 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0ea902e2-8bef-4487-8e95-83808544d602 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19a40d49410041928eb9ac2e14206c02'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:44:28.215482 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0ea902e2-8bef-4487-8e95-83808544d602 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19a40d49410041928eb9ac2e14206c02'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:44:28.227279 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-0ea902e2-8bef-4487-8e95-83808544d602 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19a40d49410041928eb9ac2e14206c02'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:44:28.239244 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1445/2893] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:44:28 2022] DELETE /identity/v3/users/19a40d49410041928eb9ac2e14206c02 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:44:28.413706 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae940b-99db-4ca2-8730-d7c1256c6ba2 service placement] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:44:28.424731 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ae940b-99db-4ca2-8730-d7c1256c6ba2 service placement] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:44:28.484858 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb927ae-7691-4793-9fe3-33eaccb076c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:44:28.485730 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb927ae-7691-4793-9fe3-33eaccb076c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:28.486023 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb927ae-7691-4793-9fe3-33eaccb076c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:28.486302 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb927ae-7691-4793-9fe3-33eaccb076c5 admin admin] PATH_INFO: `/v3/projects/ff8a376cc31445ee913739e0d2e8eec2` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:28.487516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb927ae-7691-4793-9fe3-33eaccb076c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff8a376cc31445ee913739e0d2e8eec2)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:44:28.489993 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb927ae-7691-4793-9fe3-33eaccb076c5 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:44:28.536111 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-dfb927ae-7691-4793-9fe3-33eaccb076c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff8a376cc31445ee913739e0d2e8eec2', 'request_id': 'req-dfb927ae-7691-4793-9fe3-33eaccb076c5'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:44:28.542694 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-dfb927ae-7691-4793-9fe3-33eaccb076c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff8a376cc31445ee913739e0d2e8eec2', 'request_id': 'req-dfb927ae-7691-4793-9fe3-33eaccb076c5'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:44:28.549627 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-dfb927ae-7691-4793-9fe3-33eaccb076c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff8a376cc31445ee913739e0d2e8eec2', 'request_id': 'req-dfb927ae-7691-4793-9fe3-33eaccb076c5'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:44:28.562069 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-dfb927ae-7691-4793-9fe3-33eaccb076c5 admin admin] The token cache is being invalidate because project ff8a376cc31445ee913739e0d2e8eec2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86525) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:44:28.562359 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-dfb927ae-7691-4793-9fe3-33eaccb076c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:44:28.562991 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-dfb927ae-7691-4793-9fe3-33eaccb076c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:44:28.564564 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1449/2894] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:44:28 2022] DELETE /identity/v3/projects/ff8a376cc31445ee913739e0d2e8eec2 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:44:30.242594 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea902e2-8bef-4487-8e95-83808544d602 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:44:30.244041 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-0ea902e2-8bef-4487-8e95-83808544d602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:30.299214 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea902e2-8bef-4487-8e95-83808544d602 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:44:30.345533 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e9712-a350-496b-b866-be87de47323f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33ba9644ca064e95b43650424baef79f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:44:30.346192 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e9712-a350-496b-b866-be87de47323f service cinder] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:30.346479 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e9712-a350-496b-b866-be87de47323f service cinder] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:30.346754 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e9712-a350-496b-b866-be87de47323f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:30.349104 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-c94e9712-a350-496b-b866-be87de47323f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:30.390031 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:44:30.407518 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e9712-a350-496b-b866-be87de47323f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:44:30.408979 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e9712-a350-496b-b866-be87de47323f service cinder] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:44:30.418321 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1446/2895] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:44:30 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:44:38.559038 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:44:40.414269 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=8 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:44:41.391997 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32262b89-6b3d-4a84-9326-a0c77eeba298 None None] REQUEST_METHOD: `POST` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:41.392500 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32262b89-6b3d-4a84-9326-a0c77eeba298 None None] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:41.392624 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32262b89-6b3d-4a84-9326-a0c77eeba298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:41.410441 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.auth.core [None req-32262b89-6b3d-4a84-9326-a0c77eeba298 None None] MFA Rules not processed for user `c9f93af4621b4a9db098c299c9e32c20`. Rule list: `[]` (Enabled: `True`). {{(pid=86525) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 16 00:44:41.411674 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-32262b89-6b3d-4a84-9326-a0c77eeba298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:41.418624 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1450/2896] 10.222.0.44 () {58 vars in 957 bytes} [Thu Jun 16 00:44:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 16 00:44:42.151722 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e9712-a350-496b-b866-be87de47323f service cinder] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:44:42.153198 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-c94e9712-a350-496b-b866-be87de47323f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:42.225603 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e9712-a350-496b-b866-be87de47323f service cinder] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:44:42.231172 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a154caa-3332-41b0-b52c-9482b8bcc541 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9164f14fe6894daba1a9f2d8f1f4929c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:44:42.231862 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a154caa-3332-41b0-b52c-9482b8bcc541 service placement] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:42.232154 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a154caa-3332-41b0-b52c-9482b8bcc541 service placement] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:42.232439 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a154caa-3332-41b0-b52c-9482b8bcc541 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:42.234204 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-4a154caa-3332-41b0-b52c-9482b8bcc541 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:42.246173 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a154caa-3332-41b0-b52c-9482b8bcc541 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:44:42.247793 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a154caa-3332-41b0-b52c-9482b8bcc541 service placement] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:44:42.257916 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1447/2897] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:44:42 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:44:44.569265 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32262b89-6b3d-4a84-9326-a0c77eeba298 None None] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:44:44.572546 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-32262b89-6b3d-4a84-9326-a0c77eeba298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:44.668508 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32262b89-6b3d-4a84-9326-a0c77eeba298 None None] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:44:44.675603 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd2d4d-7f95-48fe-b1ce-2a398c4cdef2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:44:44.675603 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd2d4d-7f95-48fe-b1ce-2a398c4cdef2 service nova] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:44.675603 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd2d4d-7f95-48fe-b1ce-2a398c4cdef2 service nova] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:44.676046 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afd2d4d-7f95-48fe-b1ce-2a398c4cdef2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:44.677636 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-4afd2d4d-7f95-48fe-b1ce-2a398c4cdef2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:44.691099 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd2d4d-7f95-48fe-b1ce-2a398c4cdef2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:44:44.692738 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afd2d4d-7f95-48fe-b1ce-2a398c4cdef2 service nova] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:44:44.706153 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1451/2898] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:44:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:44:52.253383 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=32 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:44:54.699935 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=37 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:44:56.494724 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a154caa-3332-41b0-b52c-9482b8bcc541 service placement] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:44:56.496221 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-4a154caa-3332-41b0-b52c-9482b8bcc541 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:56.512296 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a154caa-3332-41b0-b52c-9482b8bcc541 service placement] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:44:56.517846 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff9c59-a3c3-4d0d-b385-285a621bd2c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40432493f16b4df681daf5a1af87832a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['reader', 'ResellerAdmin', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:44:56.518492 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff9c59-a3c3-4d0d-b385-285a621bd2c5 service nova] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:44:56.518778 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff9c59-a3c3-4d0d-b385-285a621bd2c5 service nova] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:44:56.519063 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff9c59-a3c3-4d0d-b385-285a621bd2c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:44:56.520884 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-23ff9c59-a3c3-4d0d-b385-285a621bd2c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:44:56.533841 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff9c59-a3c3-4d0d-b385-285a621bd2c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:44:56.535425 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff9c59-a3c3-4d0d-b385-285a621bd2c5 service nova] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:44:56.546027 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1448/2899] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:44:56 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:45:00.031830 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd2d4d-7f95-48fe-b1ce-2a398c4cdef2 service nova] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:00.033236 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-4afd2d4d-7f95-48fe-b1ce-2a398c4cdef2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:00.088357 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afd2d4d-7f95-48fe-b1ce-2a398c4cdef2 service nova] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:00.091923 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c6f3e-0856-4492-aa5c-5382d5dcb930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:00.092565 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c6f3e-0856-4492-aa5c-5382d5dcb930 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:00.092852 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c6f3e-0856-4492-aa5c-5382d5dcb930 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:00.093133 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3c6f3e-0856-4492-aa5c-5382d5dcb930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:00.094848 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-af3c6f3e-0856-4492-aa5c-5382d5dcb930 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:00.156535 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c6f3e-0856-4492-aa5c-5382d5dcb930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:00.157977 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af3c6f3e-0856-4492-aa5c-5382d5dcb930 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:00.167914 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1452/2900] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:45:00 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:45:06.542167 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=6 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:45:10.163186 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=50 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:45:27.382261 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff9c59-a3c3-4d0d-b385-285a621bd2c5 service nova] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:45:27.393929 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff9c59-a3c3-4d0d-b385-285a621bd2c5 service nova] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:45:27.399177 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cd48a-466d-4f1d-a2e6-b3163deaa69b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9164f14fe6894daba1a9f2d8f1f4929c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:45:27.399855 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cd48a-466d-4f1d-a2e6-b3163deaa69b service placement] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:45:27.400140 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cd48a-466d-4f1d-a2e6-b3163deaa69b service placement] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:45:27.400416 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964cd48a-466d-4f1d-a2e6-b3163deaa69b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:45:27.402174 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-964cd48a-466d-4f1d-a2e6-b3163deaa69b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:45:27.413862 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964cd48a-466d-4f1d-a2e6-b3163deaa69b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:45:27.415500 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964cd48a-466d-4f1d-a2e6-b3163deaa69b service placement] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:45:27.425261 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1449/2901] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:45:27 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:45:37.420998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=6 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:46:51.665967 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c6f3e-0856-4492-aa5c-5382d5dcb930 service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:51.669174 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-af3c6f3e-0856-4492-aa5c-5382d5dcb930 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:51.681322 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3c6f3e-0856-4492-aa5c-5382d5dcb930 service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:51.685132 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634102e-53d2-417a-b156-cd24eb0df609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:51.685790 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634102e-53d2-417a-b156-cd24eb0df609 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:51.686078 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634102e-53d2-417a-b156-cd24eb0df609 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:51.686368 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c634102e-53d2-417a-b156-cd24eb0df609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:51.688295 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-c634102e-53d2-417a-b156-cd24eb0df609 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:51.703111 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634102e-53d2-417a-b156-cd24eb0df609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:51.704697 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c634102e-53d2-417a-b156-cd24eb0df609 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:51.716084 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1453/2902] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:46:52.890089 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cd48a-466d-4f1d-a2e6-b3163deaa69b service placement] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:46:52.899465 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964cd48a-466d-4f1d-a2e6-b3163deaa69b service placement] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:46:52.903177 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f117e-0f95-4b45-a699-4ef5606aab75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:46:52.903844 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f117e-0f95-4b45-a699-4ef5606aab75 service neutron] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:46:52.904130 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f117e-0f95-4b45-a699-4ef5606aab75 service neutron] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:46:52.904409 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715f117e-0f95-4b45-a699-4ef5606aab75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:46:52.906222 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-715f117e-0f95-4b45-a699-4ef5606aab75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:46:52.921355 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f117e-0f95-4b45-a699-4ef5606aab75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:46:52.922979 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715f117e-0f95-4b45-a699-4ef5606aab75 service neutron] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:46:52.935193 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1450/2903] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:46:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:47:01.711032 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=6 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:02.929889 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=6 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:03.876226 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634102e-53d2-417a-b156-cd24eb0df609 service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:03.885529 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c634102e-53d2-417a-b156-cd24eb0df609 service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:03.889388 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e91c8-0047-481a-ba01-2646afd38a19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '222e3db424f0476386bc3432cc0f868e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:03.890046 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e91c8-0047-481a-ba01-2646afd38a19 service neutron] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:03.890337 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e91c8-0047-481a-ba01-2646afd38a19 service neutron] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:03.890617 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4e91c8-0047-481a-ba01-2646afd38a19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:03.892482 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-eb4e91c8-0047-481a-ba01-2646afd38a19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:03.954516 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e91c8-0047-481a-ba01-2646afd38a19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:03.955953 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4e91c8-0047-481a-ba01-2646afd38a19 service neutron] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:03.965622 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1454/2904] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:47:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:47:09.725894 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f117e-0f95-4b45-a699-4ef5606aab75 service neutron] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:09.738775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715f117e-0f95-4b45-a699-4ef5606aab75 service neutron] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:09.744724 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a17a7d-1586-4f2b-bcab-be3d6180c822 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9164f14fe6894daba1a9f2d8f1f4929c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:09.747966 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a17a7d-1586-4f2b-bcab-be3d6180c822 service placement] REQUEST_METHOD: `GET` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:09.748350 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a17a7d-1586-4f2b-bcab-be3d6180c822 service placement] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:09.749102 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a17a7d-1586-4f2b-bcab-be3d6180c822 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:09.751867 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-b8a17a7d-1586-4f2b-bcab-be3d6180c822 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:09.767918 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a17a7d-1586-4f2b-bcab-be3d6180c822 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:09.771093 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a17a7d-1586-4f2b-bcab-be3d6180c822 service placement] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:09.784731 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1451/2905] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:47:09 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:47:09.793265 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e91c8-0047-481a-ba01-2646afd38a19 service neutron] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:09.795770 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-eb4e91c8-0047-481a-ba01-2646afd38a19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:09.809039 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4e91c8-0047-481a-ba01-2646afd38a19 service neutron] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:09.813980 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf31311-05d1-4cd7-9f8f-ccb5a889f717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:09.814877 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf31311-05d1-4cd7-9f8f-ccb5a889f717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:09.815165 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf31311-05d1-4cd7-9f8f-ccb5a889f717 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:09.815442 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf31311-05d1-4cd7-9f8f-ccb5a889f717 admin admin] PATH_INFO: `/v3/users/c9f93af4621b4a9db098c299c9e32c20` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:09.816705 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf31311-05d1-4cd7-9f8f-ccb5a889f717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9f93af4621b4a9db098c299c9e32c20)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:09.818696 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf31311-05d1-4cd7-9f8f-ccb5a889f717 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:09.873704 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-cbf31311-05d1-4cd7-9f8f-ccb5a889f717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9f93af4621b4a9db098c299c9e32c20'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:09.881842 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-cbf31311-05d1-4cd7-9f8f-ccb5a889f717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9f93af4621b4a9db098c299c9e32c20'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:09.882814 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-cbf31311-05d1-4cd7-9f8f-ccb5a889f717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9f93af4621b4a9db098c299c9e32c20'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:09.896119 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-cbf31311-05d1-4cd7-9f8f-ccb5a889f717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9f93af4621b4a9db098c299c9e32c20'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:09.896915 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-cbf31311-05d1-4cd7-9f8f-ccb5a889f717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9f93af4621b4a9db098c299c9e32c20'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:09.910418 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1455/2906] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:47:09 2022] DELETE /identity/v3/users/c9f93af4621b4a9db098c299c9e32c20 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:47:10.095949 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a17a7d-1586-4f2b-bcab-be3d6180c822 service placement] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:10.107277 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a17a7d-1586-4f2b-bcab-be3d6180c822 service placement] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:10.167034 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd389976-51a3-44ec-aa82-a06fa78e2356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:10.167943 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd389976-51a3-44ec-aa82-a06fa78e2356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:10.168230 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd389976-51a3-44ec-aa82-a06fa78e2356 admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:10.168508 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd389976-51a3-44ec-aa82-a06fa78e2356 admin admin] PATH_INFO: `/v3/projects/e0d870e67f68470988dd26ac7aef3fec` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:10.169710 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd389976-51a3-44ec-aa82-a06fa78e2356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0d870e67f68470988dd26ac7aef3fec)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:10.171641 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd389976-51a3-44ec-aa82-a06fa78e2356 admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:10.216961 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-cd389976-51a3-44ec-aa82-a06fa78e2356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0d870e67f68470988dd26ac7aef3fec', 'request_id': 'req-cd389976-51a3-44ec-aa82-a06fa78e2356'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:10.222511 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-cd389976-51a3-44ec-aa82-a06fa78e2356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0d870e67f68470988dd26ac7aef3fec', 'request_id': 'req-cd389976-51a3-44ec-aa82-a06fa78e2356'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:10.229265 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-cd389976-51a3-44ec-aa82-a06fa78e2356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0d870e67f68470988dd26ac7aef3fec', 'request_id': 'req-cd389976-51a3-44ec-aa82-a06fa78e2356'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:10.241075 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-cd389976-51a3-44ec-aa82-a06fa78e2356 admin admin] The token cache is being invalidate because project e0d870e67f68470988dd26ac7aef3fec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:47:10.241383 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-cd389976-51a3-44ec-aa82-a06fa78e2356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:10.241998 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-cd389976-51a3-44ec-aa82-a06fa78e2356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:10.243519 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1452/2907] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:47:10 2022] DELETE /identity/v3/projects/e0d870e67f68470988dd26ac7aef3fec => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:47:10.247857 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf31311-05d1-4cd7-9f8f-ccb5a889f717 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:10.249257 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-cbf31311-05d1-4cd7-9f8f-ccb5a889f717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:10.262940 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf31311-05d1-4cd7-9f8f-ccb5a889f717 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:10.325186 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3781d6f-379e-4bbf-a411-fddedcaed559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:10.326082 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3781d6f-379e-4bbf-a411-fddedcaed559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:10.326364 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3781d6f-379e-4bbf-a411-fddedcaed559 admin admin] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:10.326643 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3781d6f-379e-4bbf-a411-fddedcaed559 admin admin] PATH_INFO: `/v3/users/a8337f188a2b4251a2f101fffeaa8ebf` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:10.327875 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3781d6f-379e-4bbf-a411-fddedcaed559 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8337f188a2b4251a2f101fffeaa8ebf)` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:10.329844 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3781d6f-379e-4bbf-a411-fddedcaed559 admin admin] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:10.335912 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:10.381275 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a3781d6f-379e-4bbf-a411-fddedcaed559 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8337f188a2b4251a2f101fffeaa8ebf'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:10.388984 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a3781d6f-379e-4bbf-a411-fddedcaed559 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8337f188a2b4251a2f101fffeaa8ebf'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:10.389614 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a3781d6f-379e-4bbf-a411-fddedcaed559 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8337f188a2b4251a2f101fffeaa8ebf'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:10.402235 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a3781d6f-379e-4bbf-a411-fddedcaed559 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8337f188a2b4251a2f101fffeaa8ebf'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:10.402874 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.notifications [None req-a3781d6f-379e-4bbf-a411-fddedcaed559 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8337f188a2b4251a2f101fffeaa8ebf'} {{(pid=86525) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:10.415674 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1456/2908] 10.222.0.44 () {58 vars in 1223 bytes} [Thu Jun 16 00:47:10 2022] DELETE /identity/v3/users/a8337f188a2b4251a2f101fffeaa8ebf => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 16 00:47:10.588452 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd389976-51a3-44ec-aa82-a06fa78e2356 admin admin] Authenticating user token {{(pid=86524) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:47:10.589902 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.fernet_utils [None req-cd389976-51a3-44ec-aa82-a06fa78e2356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86524) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:47:10.603125 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd389976-51a3-44ec-aa82-a06fa78e2356 admin admin] Validating token access rules against request {{(pid=86524) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:47:10.660715 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02162a-e928-4ff8-868a-a35dfc818f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5827dca4e6e6440096187e88acac47af', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ec07de477e084ea786d462c55e9192b8', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86524) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:47:10.661581 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02162a-e928-4ff8-868a-a35dfc818f2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:47:10.661867 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02162a-e928-4ff8-868a-a35dfc818f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:47:10.662144 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02162a-e928-4ff8-868a-a35dfc818f2a admin admin] PATH_INFO: `/v3/projects/4c2d99c1b5ea4df18e95adc54d0120be` {{(pid=86524) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:47:10.663382 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02162a-e928-4ff8-868a-a35dfc818f2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c2d99c1b5ea4df18e95adc54d0120be)` {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:47:10.665365 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02162a-e928-4ff8-868a-a35dfc818f2a admin admin] RBAC: Authorization granted {{(pid=86524) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:47:10.685640 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:10.713261 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-8b02162a-e928-4ff8-868a-a35dfc818f2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c2d99c1b5ea4df18e95adc54d0120be', 'request_id': 'req-8b02162a-e928-4ff8-868a-a35dfc818f2a'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:10.718669 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-8b02162a-e928-4ff8-868a-a35dfc818f2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c2d99c1b5ea4df18e95adc54d0120be', 'request_id': 'req-8b02162a-e928-4ff8-868a-a35dfc818f2a'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:10.724670 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-8b02162a-e928-4ff8-868a-a35dfc818f2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c2d99c1b5ea4df18e95adc54d0120be', 'request_id': 'req-8b02162a-e928-4ff8-868a-a35dfc818f2a'} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:10.737182 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-8b02162a-e928-4ff8-868a-a35dfc818f2a admin admin] The token cache is being invalidate because project 4c2d99c1b5ea4df18e95adc54d0120be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=86524) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jun 16 00:47:10.737775 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-8b02162a-e928-4ff8-868a-a35dfc818f2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:10.738088 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG keystone.notifications [None req-8b02162a-e928-4ff8-868a-a35dfc818f2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=86524) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jun 16 00:47:10.739628 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: [pid: 86524|app: 0|req: 1453/2909] 10.222.0.44 () {58 vars in 1232 bytes} [Thu Jun 16 00:47:10 2022] DELETE /identity/v3/projects/4c2d99c1b5ea4df18e95adc54d0120be => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 16 00:47:20.411548 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:47:20.734077 dv-cinder-843277-4-iscsi devstack@keystone.service[86524]: DEBUG dbcounter [-] [86524] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=86524) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 16 00:50:30.400950 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3781d6f-379e-4bbf-a411-fddedcaed559 admin admin] Authenticating user token {{(pid=86525) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 16 00:50:30.402474 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-a3781d6f-379e-4bbf-a411-fddedcaed559 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:50:30.542447 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3781d6f-379e-4bbf-a411-fddedcaed559 admin admin] Validating token access rules against request {{(pid=86525) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 16 00:50:30.599587 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf55aed-f95e-4344-acd5-6319fcfd1ff8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9164f14fe6894daba1a9f2d8f1f4929c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '320d79ecbc2342af8031103e7308c10d', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=86525) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 16 00:50:30.600195 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf55aed-f95e-4344-acd5-6319fcfd1ff8 service placement] REQUEST_METHOD: `GET` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 16 00:50:30.600482 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf55aed-f95e-4344-acd5-6319fcfd1ff8 service placement] SCRIPT_NAME: `/identity` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 16 00:50:30.600757 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf55aed-f95e-4344-acd5-6319fcfd1ff8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=86525) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 16 00:50:30.602534 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.fernet_utils [None req-abf55aed-f95e-4344-acd5-6319fcfd1ff8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=86525) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 16 00:50:30.613572 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf55aed-f95e-4344-acd5-6319fcfd1ff8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 16 00:50:30.615151 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf55aed-f95e-4344-acd5-6319fcfd1ff8 service placement] RBAC: Authorization granted {{(pid=86525) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 16 00:50:30.625491 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: [pid: 86525|app: 0|req: 1457/2910] 10.222.0.44 () {60 vars in 1365 bytes} [Thu Jun 16 00:50:30 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 16 00:50:40.620743 dv-cinder-843277-4-iscsi devstack@keystone.service[86525]: DEBUG dbcounter [-] [86525] Writing DB stats keystone:SELECT=89 {{(pid=86525) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}